Data Platform Engineer

Join Us and Build a Cutting-Edge Data Platform!

As a Data Platform Engineer, you will be working for our client, a leader in finance, developing a cloud-based data platform to enhance data processing and analytics capabilities. This greenfield project focuses on building an ELT pipeline using Azure Databricks or BigQuery on GCP, leveraging native cloud services for data ingestion, transformation, and orchestration. You will play a key role in designing and optimizing the data infrastructure, ensuring scalability, performance, and seamless integration with business processes.

Your main responsibilities: Design and implement scalable ELT pipelines using Azure Databricks or BigQuery

• Develop and maintain cloud-native ingestion, transformation, and orchestration workflows
• Optimize database structures and data models for performance and scalability
• Ensure data quality, governance, and regulatory compliance
• Collaborate with analysts and data scientists to support advanced analytics use cases
• Automate the deployment and monitoring of data pipelines
• Troubleshoot infrastructure issues and implement best practices for resilience
• Apply security standards to protect data in processing and storage
• Work in Agile teams and contribute to continuous improvement and documentation

You’re ideal for this role if you have:

• Experience building data platforms on Azure or GCP (Databricks, BigQuery)
• Strong understanding of ELT/ETL design patterns and data pipeline development
• Hands-on experience with ingestion from various sources: Direct database querying (CDC, bulk read), API communication, Event streaming pipelines
• Proficiency in SQL, data modeling, and dimensional modeling techniques
• Programming skills in Python or Scala
• Experience with Airflow, dbt, or similar orchestration and transformation tools
• Familiarity with infrastructure as code (Terraform, ARM templates, etc.)
• Knowledge of data governance, metadata management (e.g., Azure Purview), and data quality principles
• Ability to read and interpret conceptual/logical/physical data models and ER diagrams
• Strong documentation and communication skills, especially for creating clear data contracts and mappings

#GETREADY  to meet with us!

We would like to meet you. If you are interested please apply and attach your CV in English or Polish, including a statement that you agree to our processing and storing of your personal data. You can always also apply by sending us an email at recruitment@itds.pl.

Internal number #6787