Senior Data Engineer (Python, Spark, SQL)

About Us:
We are a custom development team based in the UK, delivering high-quality projects for a range of businesses. With over 40 projects completed, we take pride in our work and our team. Our fully remote multicultural team delivers impactful solutions through independent, focused work. We value autonomy, clarity, and achieving meaningful outcomes for our clients and team members.

Job Description:
We are looking for an experienced Data Engineer to join our remote team to build data solutions.

What you’ll get working with us:

• You will become an important member of our team, who will have the opportunity to make your own technical decisions, influence diverse commercial projects and build awesome technology that you will proudly include in your portfolio.
• We foster a culture of independence, empowering our team members to take ownership of their work and make decisions confidently. While you’ll be expected to solve challenges on your own, the team is always there as a safety net to provide guidance and support when needed.
• If you want to switch to other tasks or try yourself in something new, then there are always tasks in the backlog related to various projects.
• We are professional, flexible, and loyal to our employees, so we want to find someone who shares our views and wants to learn and become part of a stable company.
• We not only offer the flexibility of remote work and the freedom to thrive independently, but we also ensure financial stability by paying salaries in a stable currency. This means you can focus on your work without worrying about currency fluctuations.
• Mission-Driven Teams, Your Schedule: At tny., you’ll work within a squad-mission model where each team is aligned on clear objectives and outcomes. While daily standups keep everyone in sync, you’re free to structure your workday to suit your rhythm. Focus on delivering results and advancing your squad’s mission, all while enjoying the flexibility to build a schedule that works best for you.

Responsibilities:

• Data Extraction: Ability to extract, transform, and load data from various sources.
• Data Modelling: Ability to model data and design scalable data architectures.
• Cloud Data Storage: Expertise in building scalable and secure data warehouses and data lakes to store and manage large volumes of structured and unstructured data using AWS, Google Cloud and Azure cloud platforms.
• Data Processing and Analytics: Proficiency in processing and analyzing big data using tools like Spark, or cloud-based services, as well as low-code platforms.
• Data Pipelines (ETL / ELT): Capability to design, build, and maintain efficient and reliable data pipelines that automate data flow and enable real-time or batch processing (ETL, ELT).
• Data Streaming (Kafka): Ability to build streaming event driven data solutions with Kafka.
• Data Visualization and Reporting: Create dashboards, reports, and data visualizations that help our customers make better decisions.
• Scoping and Problem Solving: Scoping projects, optimizing data processes.

Requirements:

• 3+ years of professional working experience in data engineering
• Python, SQL, PySpark
• ETL and ELT data pipelines
• Cloud data engineering experience: AWS, GCP, Azure - BigQuery, RDS, Azure SQL DB
• Pulling data from 3rd party services, APIs, SFTP
• Strong knowledge of data modelling
• Ability to work independently on projects
• Excellent problem-solving skills
• Advanced level English
• Azure data factory, AWS Glue, Airflow
• DevOps experience

Nice to have:

• Experience with low-code ETL tools like Dagster, Stitch, Fivetran

Tools:

• GitHub
• Slack