Data Engineer
От 3 до 6 лет
Полная занятость
Удаленная работа
Описание вакансии
Responsibilities:
- Create ETL processes and data marts.
- Design linearly scalable client wrappers for interacting with exchange APIs, brokers, data aggregators, vendors, and blockchains.
- Work with FIX, HTTP, WebSocket, and gRPC protocols.
- Configure monitoring systems to ensure the reliability of ETL processes.
- Develop BI dashboards/reports using data visualization tools such as Grafana, Tableau, Lightweight Charts, and Google Sheets.
- Analyze and compare diverse data sources, their costs, and the amount of effort required to obtain them.
- Search for data from non-normalized sources, such as news, social media, or websites.
Requirements:
- Strong proficiency in SQL: aggregations, joins, subqueries, window functions (first, last, candle, histogram), indexes, query planning, and optimization.
- Proficiency in Python.
- Experience in designing database schemas: normalization/denormalization within the scope of OLAP/OLTP.
- Understanding of different data storage architectures (Data Warehouse, Data Lake).
- Experience working with databases such as PostgreSQL + TimescaleDB or ClickHouse.
- Experience with raw data, including cleaning, normalization, and enrichment (CSV, JSON, PCAP, FIXML, etc.).
- Experience with large datasets (1TB+) and understanding of data architecture for high-load systems.
Nice to have
- Proficiency in Docker, Airflow, and Kafka tools.
- Experience and/or willingness to transition to Go, Rust.
- Experience with the Hadoop ecosystem (HDFS, Hive, Spark).
- Knowledge of financial markets and basic trading statistics.
- Experience with real-time data processing and streaming data technologies.
We offer:
- Work in a modern international technology company without bureaucracy, legacy systems, or technical debt.
- Excellent opportunities for professional growth and self-realization.
- We work remotely from anywhere in the world, with a flexible schedule.
- We offer compensation for health insurance, sports activities, and non-professional training.
Вакансия опубликована:
сегодня,
Москва
Похожие вакансии
Похожие вакансии
Дата инженер/ Data Engineer
от 250 000 ₽