Data Engineer
Требования
Местоположение и тип занятости
Компания
Российская компания, предоставляющая услуги в области стратегии, управленческого консалтинга, информационных технологий
Описание вакансии
Условия работы
Role description:
- Building high-performance spark jobs
- handling Real time data and ingestion on AWS S3.
- implementing CI/CD on the pipelines.
Requirements:
- High level of experience with Python / Scala / Java
- Technology expertise of solutioning in Spark / PySpark, SQL, AWS, Python
- Ability to work with large and complex data sets, data lakes and data warehouses.
- Understanding of data migration from RDBMS to AWS S3 using Sqoop or Apache Spark
- Ability to troubleshoot and optimize complex queries on the Spark platform
- Building high-quality high-performance spark jobs
- Experience is handling Real time data and ingestion on AWS S3.
- Drive a culture of collaborative reviews of designs, code and test plans
- Knowledge of implementing CI/CD on the pipelines.
- Deployment of a large distributed Big Data application using CI/CD Pipelines
Бонусы
- Possibility of professional and career growth in an international company from the starting position to the Managing Director;
- Competitive income level and regular increase base salary on the results of Performance Review;
- VMI from the first day of work, including dentistry, in the best clinics for an employee and his family (partner, children under 18);
- Life insurance in the amount of the employee's annual salary;
- Additional 5 days of paid vacation per year;
- Monthly monetary compensation for meal/car maintenance;
- PrimeZone Corporate Privilege Program (more than 1000 leading suppliers of products and services);
- The possibility of training and certification at the expense of the company – up to 80 hours of training per year, including in foreign Accenture centers;
- Sports and entertainment events at the company's expense.