Senior Data Engineer (Azure)

Technologies we use

About the project

Your responsibilities

• Lead the migration of on-premises Cloudera and Hadoop data platforms to Azure Databricks
• Design and implement scalable ETL/ELT frameworks based on medallion architecture principles
• Develop metadata-driven data ingestion, transformation, and quality validation pipelines
• Automate deployment and orchestration using CI/CD pipelines and DevOps tools
• Collaborate with business and IT stakeholders to translate data requirements into robust technical solutions
• Optimize and refactor Spark and PySpark code to improve performance and cost efficiency
• Ensure data security, compliance, and governance across all data layers
• Mentor and guide data engineers in best practices for data lakehouse development
• Support end-to-end data delivery from ingestion to BI and API publication
• Drive innovation by identifying automation opportunities and platform improvements

Our requirements

• Proven experience in large-scale data platform migration and modernization projects
• Deep expertise in Azure Databricks, Delta Lake, and Azure Data Factory
• Strong programming skills in Python, PySpark, and SQL
• Hands-on experience with CI/CD pipelines using Azure DevOps, GitHub, or Jenkins
• Solid understanding of medallion architecture and metadata-driven data engineering
• Familiarity with orchestration tools such as Airflow or Azure Data Factory
• Strong knowledge of data governance, lineage, and regulatory compliance frameworks
• Excellent analytical and problem-solving abilities in complex data environments
• Ability to collaborate effectively with cross-functional and business teams
• A degree in Computer Science, Engineering, or a related technical discipline
• Polish (fluent / communicative)
• English (fluent / communicative)

Optional

• Experience with Hadoop, Cloudera, or Prometheus (hosting on local servers is acceptable)
• Certifications in Azure or Data Engineering

This is how we organize our work

This is how we work

What we offer

• Stable and long-term cooperation with very good conditions
• Enhance your skills and develop your expertise in the financial industry
• Work on the most strategic projects available in the market
• Define your career roadmap and develop yourself in the best and fastest possible way by delivering strategic projects for different clients of ITDS over several years
• Participate in Social Events, training, and work in an international environment
• Access to attractive Medical Package
• Access to Multisport Program
• Access to Pluralsight
• Flexible hours

Benefits

#GETREADY to meet with us!

ITDS’s Whistleblower Procedure