Lead Data Engineer

Role

• Collaborate with business data analysts to define data structures, relationships, and entities that align with business requirements
• Configure data integration tools (Kafka, Debezium, Nifi) for integration with downstream systems, internal and external
• Prepare technical design and develop data pipelines for data transformation to target analytical model, NC or 3-d party, using NC data management tools (Airflow, DBT, Spark, pgSQL, Python, SQL) or 3rd parties toolset
• Prepare technical design and develop transformations using NC datamart engine (Airflow, pgSQL, Python, SQL)
• Implement of datasets and dashboards using NC Cloud reporting (based on Apache Superset)
• Implement monitoring for created data pipelines and reports, perform troubleshooting and fix found problems
• Work with the testing team to ensure that developed functionalities meet business requirements
• Improve reporting architecture, participate in toolset and methodology selection

Skill & Qualifications

• At least 2 years of experience in data analytics, data modelling, data integration and data visualization.
• Hands-on experience with Python.
• Strong knowledge and hands-on experience with SQL
• Experience with Big Data platforms (Hadoop, Spark, Databtricks etc.) and/or Data Warehouses, ETL is preferable
• Experience in technical design preparation and development of data transformations using data integration tools and techniques, such as ETL, ELT, APIs, Apache Kafka, and data pipelines, and in integrating data from various sources, platforms, and systems
• Experience with versions control systems like GIT
• Knowledge of CI/CD, experience in managing the software build and deployment process
• Experience with OpenShift, Kubernetes

We offer:

• Professional growth and career development in the international business environment;
• Medical insurance for employees, covering dental services;
• More than 300 hard and soft-skills programs by the corporate career development center;
• Friendly atmosphere, sports activities and corporate events;
• Salary will be discussed individually with the successful candidate.