Data Engineer

Join us, and transform data into actionable insights!

Krakow-based opportunity with the possibility to work 90% remotely!

As a Data Engineer, you will be working for our client, a leading global financial services organization. You will be contributing to a critical project focused on developing and optimizing data pipelines and big data solutions. This role demands expertise in various technologies, including Hadoop, Spark, and Elasticsearch, and involves working in a dynamic environment with a proactive and collaborative team attitude.

Your main responsibilities:

• Building and maintaining data pipelines using Hadoop components
• Optimizing Spark jobs for improved performance
• Working with time-series and analytics databases such as Elasticsearch
• Utilizing industry-standard version control tools like Git and GitHub
• Employing automated deployment tools such as Ansible and Jenkins
• Writing and maintaining shell scripts
• Applying big data modeling techniques using relational and non-relational databases
• Collaborating with the team to ensure smooth software development lifecycle (SDLC) processes
• Learning and adapting to changing requirements quickly
• Contributing to the development and maintenance of shared Jenkins libraries

You’re ideal for this role if you have:

• Proficiency in Scala or Python
• Experience in a Unix/Linux environment on-premises
• Hands-on experience with Hadoop components (Apache Hadoop, Scala, Apache Spark, YARN, Hive, SQL)
• Experience optimizing Spark jobs
• Knowledge of time-series/analytics databases like Elasticsearch
• Familiarity with version control tools (Git, GitHub) and automated deployment tools (Ansible & Jenkins)
• Basic shell-scripting knowledge
• Understanding of big data modeling techniques using both relational and non-relational approaches
• Experience and understanding of SDLC
• A proactive, self-starter attitude with a strong team focus

It is a strong plus if you have:

• Experience creating, updating, and maintaining shared Jenkins libraries
• Understanding or experience with Cloud design patterns
• Great communication skills
• Experience developing RESTful APIs using Java Spring Boot

#GETREADY  to meet with us!

We would like to meet you. If you are interested please apply and attach your CV in English or Polish, including a statement that you agree to our processing and storing of your personal data. You can always also apply by sending us an email at recruitment@itds.pl.

Internal number #5371