Lead Data Platform Engineer – Apache Iceberg & PySpark

Ignite data innovation — master the future of large-scale analytics with cutting-edge technologies!

Krakow-based opportunity with hybrid work model.

As a Lead Data Platform Engineer, you will be working for our client, a global financial services organization, dedicated to delivering innovative technology solutions for Investment Banking. You will play a pivotal role in shaping and optimizing data pipelines and storage strategies that drive strategic insights and operational excellence. Join us to lead transformative initiatives at the forefront of data engineering and unlock new levels of performance and efficiency.

Your main responsibilities:

• Lead the design, development, and implementation of data pipelines and table management workflows using PySpark and Apache Iceberg.
• Drive performance and cost optimization for Apache Iceberg by refining partitioning strategies, file sizing, and query efficiency.
• Manage and improve Apache Iceberg maintenance operations, including snapshot management, compaction, and metadata cleanup.
• Troubleshoot platform issues by applying deep understanding of Apache Iceberg internals such as metadata layout, schemas, and schema evolution.
• Promote engineering excellence through code reviews, automation, and best practices in CI/CD and observability.
• Support operational reliability by participating in on-call duties, incident response, and root cause analysis.
• Collaborate with cross-functional teams, influence architectural decisions, and mentor less experienced engineers.
• Partner with stakeholders to ensure solutions are secure, scalable, and compliant.

You're ideal for this role if you have:

• 7+ years of experience in data engineering or related roles.
• Strong hands-on expertise in PySpark, including DataFrame APIs, performance tuning, and job optimization.
• Practical experience with Apache Iceberg, especially in optimizing file layout, partitioning, and understanding internal architecture.
• Proven ability to automate maintenance operations and operate production data workloads independently.
• Solid software engineering fundamentals with a focus on reliable, maintainable systems.
• Excellent communication skills in English and the ability to influence across geographies.
• Ownership mindset with a focus on end-to-end delivery, discipline, and initiative.

It is a strong plus if you have:

• Certifications or additional skills in Big Data, Cloud platforms, or related fields.

Language required for the role:

• Fluent English, spoken and written.

Eligibility for the role:

• Only candidates with an existing legal right to work in the European Union will be considered for this role.

#MAKEYourCareerBETTER

Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.