Data Engineer

Местоположение и тип занятости

Полный рабочий деньМожно удаленно

Компания

Российская компания, предоставляющая услуги в области стратегии, управленческого консалтинга, информационных технологий

Описание вакансии

Условия работы

Role description:

  • Building high-performance spark jobs
  • handling Real time data and ingestion on AWS S3.
  • implementing CI/CD on the pipelines.

Requirements:

  • High level of experience with Python / Scala / Java
  • Technology expertise of solutioning in Spark / PySpark, SQL, AWS, Python
  • Ability to work with large and complex data sets, data lakes and data warehouses.
  • Understanding of data migration from RDBMS to AWS S3 using Sqoop or Apache Spark
  • Ability to troubleshoot and optimize complex queries on the Spark platform
  • Building high-quality high-performance spark jobs
  • Experience is handling Real time data and ingestion on AWS S3.
  • Drive a culture of collaborative reviews of designs, code and test plans
  • Knowledge of implementing CI/CD on the pipelines.
  • Deployment of a large distributed Big Data application using CI/CD Pipelines

Бонусы

  • Possibility of professional and career growth in an international company from the starting position to the Managing Director;
  • Competitive income level and regular increase base salary on the results of Performance Review;
  • VMI from the first day of work, including dentistry, in the best clinics for an employee and his family (partner, children under 18);
  • Life insurance in the amount of the employee's annual salary;
  • Additional 5 days of paid vacation per year;
  • Monthly monetary compensation for meal/car maintenance;
  • PrimeZone Corporate Privilege Program (more than 1000 leading suppliers of products and services);
  • The possibility of training and certification at the expense of the company – up to 80 hours of training per year, including in foreign Accenture centers;
  • Sports and entertainment events at the company's expense.