Senior Data Engineer (DWH, Spark)
Зарплата
Требования
Местоположение и тип занятости
Компания
Описание вакансии
Условия работы
With over 2,000 employees of more than 88 nationalities, Exness is the place for global teamwork, incredible leadership, a learning culture, and constant development. Unlimited by time zones, Exnessians from around the world have worked seamlessly together since 2008 to provide our traders with the best possible trading experience. Today, we stand proud with over 300,000 active traders and 2.5 trillion USD in monthly trading volume.
Your role at Exness:We are looking for an experienced data engineer who will join our Technology department to be part of a team of more than 400 engineers that creates cutting-edge solutions and constantly raises the bar.
This department focuses on developing products in the trading market and creating solutions from the moment of registration of clients to the moment of withdrawal of funds. Our technologies include resolutions that support customer journeys (identity management, billing management), trading interfaces (FIX, REST, WS, Algo), back-office interfaces (Personal Area, Payment Solutions, Back Office), centers of expertise (QA, DevOps, security), technology platforms (Orchestration, internal PaaS/SaaS), and much more.
You will:- Develop data platform services for data-driven decision-making, such as:
- Developing and maintaining the data warehouse (Vertica) frameworks.
- Implementing and operating a data lake (S3 MinIO + Spark).
- Deploying and maintaining Spark on k8s.
- Maintaining and enriching an environment for the creation of the data assets such as (ETL/ELT pipelines, DDL, etc.) via the development of the data transformation tool (DBT).
- Implementing and maintaining a data catalog, data lineage, and business glossary.
- Participate actively in the development of the data platform environment, including:
- Creating and monitoring compliance with data security policies, code policies, and naming conventions.
- Participating in data platform architecture development.
- Recommending ways to improve data reliability, efficiency, and quality.
- Strong knowledge of Spark architecture, deployment and maintaining Spark on Hadoop, k8s, or standalone experience
- Experience with relational databases like Vertica, PostgreSQL, ClickHouse, and similar
- Experience with Big Data processing and data lake building
- Experience building ETLs/ELTs to take data from various data sources
- Python skills associated with data engineering activities
- Expert structured query language (SQL) knowledge
- Understanding of the base principles CI/CD in the data processing area
- Other preferred skills:
- Experience with data catalog frameworks implementation
- Practical knowledge of Apache Spark on batch and real-time data processing
- Awareness of building stream-processing systems using solutions such as Flink
- Data warehouse modeling knowledge
- MPP database experience
Бонусы
- Competitive and attractive compensation
- Health and life insurance for employees, spouses, and children, including vaccinations, tests, and vision and dental coverage
- 21 days annual leave and paid sick leave plus paid Christmas to New Year’s break
- Extensive learning opportunities, including professional training and certifications, soft skills development, free English courses, and trading workshops
- Flight tickets, hotel or apartment accommodation for your first month, migration support, and legal help for you and your family (if relocating)
- Education allowance for your children’s school and kindergarten fees
- Access to our very own sports club with dedicated coaches, free Sanctum Club memberships for you and your spouse, corporate SUPs, jet skis, etc.
- A company car with a parking space near the office
- Fun and effective team-building experiences and Exness community gatherings