Data Engineer

Role description:

• Building high-performance spark jobs
• handling Real time data and ingestion on AWS S3.
• implementing CI/CD on the pipelines.

Requirements:

• High level of experience with Python / Scala / Java
• Technology expertise of solutioning in Spark / PySpark, SQL, AWS, Python
• Ability to work with large and complex data sets, data lakes and data warehouses.
• Understanding of data migration from RDBMS to AWS S3 using Sqoop or Apache Spark
• Ability to troubleshoot and optimize complex queries on the Spark platform
• Building high-quality high-performance spark jobs
• Experience is handling Real time data and ingestion on AWS S3.
• Drive a culture of collaborative reviews of designs, code and test plans
• Knowledge of implementing CI/CD on the pipelines.
• Deployment of a large distributed Big Data application using CI/CD Pipelines

• Possibility of professional and career growth in an international company from the starting position to the Managing Director;
• Competitive income level and regular increase base salary on the results of Performance Review;
• VMI from the first day of work, including dentistry, in the best clinics for an employee and his family (partner, children under 18);
• Life insurance in the amount of the employee's annual salary;
• Additional 5 days of paid vacation per year;
• Monthly monetary compensation for meal/car maintenance;
• PrimeZone Corporate Privilege Program (more than 1000 leading suppliers of products and services);
• The possibility of training and certification at the expense of the company – up to 80 hours of training per year, including in foreign Accenture centers;
• Sports and entertainment events at the company's expense.