122 580
18 317
Senior Data Engineer (Azure) Miejsce pracy: Warszawa Technologies we use Expected Azure Databricks Delta Lake Azure Data Factory Python PySpark SQL Azure DevOps Optional Hadoop Cloudera Prometheus Microsoft Azure Operating system Linux About the project As a Senior Azure Data Engineer, you will be working for our client, a global financial technology leader providing infrastructure and services for capital markets, payments, and financial information management. You will be instrumental in a high-impact cloud modernization initiative focused on migrating legacy Cloudera and Hadoop data environments to a state-of-the-art Azure ecosystem. This project aims to redesign data architectures that support scalable BI analytics, regulatory reporting, and metadata-driven automation across multiple geographies, all while upholding strict data governance and performance standards. Unleash the power of cloud innovation — lead Data Modernization in Azure! Warszawa-based opportunity with a hybrid work model (3 remote days per week). Your responsibilities Lead the migration of on-premises Cloudera and Hadoop data platforms to Azure Databricks Design and implement scalable ETL/ELT frameworks based on medallion architecture principles Develop metadata-driven data ingestion, transformation, and quality validation pipelines Automate deployment and orchestration using CI/CD pipelines and DevOps tools Collaborate with business and IT stakeholders to translate data requirements into robust technical solutions Optimize and refactor Spark and PySpark code to improve performance and cost efficiency Ensure data security, compliance, and governance across all data layers Mentor and guide data engineers in best practices for data lakehouse development Support end-to-end data delivery from ingestion to BI and API publication Drive innovation by identifying automation opportunities and platform improvements Our requirements Proven experience in large-scale data platform migration and modernization projects Deep expertise in Azure Databricks, Delta Lake, and Azure Data Factory Strong programming skills in Python, PySpark, and SQL Hands-on experience with CI/CD pipelines using Azure DevOps, GitHub, or Jenkins Solid understanding of medallion architecture and metadata-driven data engineering Familiarity with orchestration tools such as Airflow or Azure Data Factory Strong knowledge of data governance, lineage, and regulatory compliance frameworks Excellent analytical and problem-solving abilities in complex data environments Ability to collaborate effectively with cross-functional and business teams A degree in Computer Science, Engineering, or a related technical discipline Polish (fluent / communicative) English (fluent / communicative) Optional Experience with Hadoop, Cloudera, or Prometheus (hosting on local servers is acceptable) Certifications in Azure or Data Engineering This is how we organize our work This is how we work agile scrum What we offer Stable and long-term cooperation with very good conditions Enhance your skills and develop your expertise in the financial industry Work on the most strategic projects available in the market Define your career roadmap and develop yourself in the best and fastest possible way by delivering strategic projects for different clients of ITDS over several years Participate in Social Events, training, and work in an international environment Access to attractive Medical Package Access to Multisport Program Access to Pluralsight Flexible hours Benefits sharing the costs of sports activities private medical care flexible working time fruits integration events corporate gym saving & investment scheme no dress code coffee / tea drinks christmas gifts birthday celebration sharing the costs of a streaming platform subscription access to 100 projects access to Pluralsight Recruitment stages first online interview second online interview GETREADY to meet with us! ITDS Business Consultants is involved in many various, innovative and professional IT projects for international companies in the financial industry in Europe. We offer an environment for professional, ambitious, and driven people. We would like to meet you. If you are interested please apply and attach your CV in English or Polish, including a statement that you agree to our processing and storing of your personal data. ITDS’s Whistleblower Procedure You can report violations in accordance with ITDS’s Whistleblower Procedure available here: ITDS Polska Sp. z o.o. ITDS supports financial service providers to take the next steps. We identify what’s possible, every day. Opportunities in the areas of technology, organization, and digitization. We see where banks, insurers, payment companies, or fintech can go and how they can get there. That’s why we want to stimulate you to ramp up your ambition. Forget what you perceive as restraints and step towards the new reality. ITDS in Poland - Pure player in new Technologies & Financial Industry 300 IT implementation professionals 20 clients in the Banking, Insurance, Payment & Fintech Industry ITDS excels in digital strategy delivery and implementation of best-of-breed lending solutions. ITDS has delivered successful strategic projects throughout Europe since 1998. We combine the experience we’ve accumulated with in-depth knowledge of technologies, business processes, and EU legislation to unlock new business opportunities. Informujemy, że administratorem danych jest ITDS z siedzibą w Warszawie, ul. Złota 59 (dalej jako "administrator"). Masz prawo do żądania dostępu do swoich danych osobowych, ich sprostowania, usunięcia lub ograniczenia przetwarzania, prawo do wniesienia sprzeciwu wobec przetwarzania, a także prawo do przenoszenia danych oraz wniesienia skargi do organu nadzorczego. Dane osobowe przetwarzane będą w celu realizacji procesu rekrutacji. Podanie danych w zakresie wynikającym z ustawy z dnia 26 czerwca 1974 r. Kodeks pracy jest obowiązkowe. W pozostałym zakresie podanie danych jest dobrowolne. Odmowa podania danych obowiązkowych może skutkować brakiem możliwości przeprowadzenia procesu rekrutacji. Administrator przetwarza dane obowiązkowe na podstawie ciążącego na nim obowiązku prawnego, zaś w zakresie danych dodatkowych podstawą przetwarzania jest zgoda. Dane osobowe będą przetwarzane do czasu zakończenia postępowania rekrutacyjnego i przez okres możliwości dochodzenia ewentualnych roszczeń, a w przypadku wyrażenia zgody na udział w przyszłych postępowaniach rekrutacyjnych - do czasu wycofania tej zgody. Zgoda na przetwarzanie danych osobowych może zostać wycofana w dowolnym momencie. Odbiorcą danych jest serwis Hello HR oraz inne podmioty, którym powierzyliśmy przetwarzanie danych w związku z rekrutacją. Naruszenia można zgłaszać zgodnie z Procedurą zgłaszania nieprawidłowości ITDS dostępną tutaj: