As a Senior Azure Data Engineer, you will be working for our client, a global financial technology leader providing infrastructure and services for capital markets, payments, and financial information management. You will be instrumental in a high-impact cloud modernization initiative focused on migrating legacy Cloudera and Hadoop data environments to a state-of-the-art Azure ecosystem. This project aims to redesign data architectures that support scalable BI analytics, regulatory reporting, and metadata-driven automation across multiple geographies, all while upholding strict data governance and performance standards.
Unleash the power of cloud innovation — lead Data Modernization in Azure!
Warszawa-based opportunity with a hybrid work model (3 remote days per week).
responsibilities :
Lead the migration of on-premises Cloudera and Hadoop data platforms to Azure Databricks
Design and implement scalable ETL/ELT frameworks based on medallion architecture principles
Develop metadata-driven data ingestion, transformation, and quality validation pipelines
Automate deployment and orchestration using CI/CD pipelines and DevOps tools
Collaborate with business and IT stakeholders to translate data requirements into robust technical solutions
Optimize and refactor Spark and PySpark code to improve performance and cost efficiency
Ensure data security, compliance, and governance across all data layers
Mentor and guide data engineers in best practices for data lakehouse development
Support end-to-end data delivery from ingestion to BI and API publication
Drive innovation by identifying automation opportunities and platform improvements
requirements-expected :
Proven experience in large-scale data platform migration and modernization projects
Deep expertise in Azure Databricks, Delta Lake, and Azure Data Factory
Strong programming skills in Python, PySpark, and SQL
Hands-on experience with CI/CD pipelines using Azure DevOps, GitHub, or Jenkins
Solid understanding of medallion architecture and metadata-driven data engineering
Familiarity with orchestration tools such as Airflow or Azure Data Factory
Strong knowledge of data governance, lineage, and regulatory compliance frameworks
Excellent analytical and problem-solving abilities in complex data environments
Ability to collaborate effectively with cross-functional and business teams
A degree in Computer Science, Engineering, or a related technical discipline
Polish (fluent / communicative)
English (fluent / communicative)
offered :
Stable and long-term cooperation with very good conditions
Enhance your skills and develop your expertise in the financial industry
Work on the most strategic projects available in the market
Define your career roadmap and develop yourself in the best and fastest possible way by delivering strategic projects for different clients of ITDS over several years
Participate in Social Events, training, and work in an international environment
Access to attractive Medical Package
Access to Multisport Program
Access to Pluralsight
Flexible hours
benefits :
sharing the costs of sports activities
private medical care
flexible working time
fruits
integration events
corporate gym
saving & investment scheme
no dress code
coffee / tea
drinks
christmas gifts
birthday celebration
sharing the costs of a streaming platform subscription
