.
Lead Data Engineer
  • Warszawa
Lead Data Engineer
Warszawa, Warszawa, mazowieckie, Polska
emagine Polska
23. 5. 2024
Informacje o stanowisku

Industry:  Life science/Healthcare

Work model:  100% remote

Assignment type:  B2B

Start:  ASAP/1 month notice period

Project language:  English

We’re looking for a Lead Data Engineer to help us drive improvements in our data pipeline development for stakeholders across the organization. You’ll be a part of the Data Management Centre of Excellence within Digital, Data & IT, where we focus on creating high-value, innovative data products


About the department


You will join our team of architects, developers, analysts, and data engineers in a global, high performing department with a variety of technical, analytical, and multinational backgrounds. We are expanding our offerings to the global organisation, so we need extra resources to succeed with our journey and ambitious vision.

We do data acquisition and ingestion; data analysis and data engineering; evangelising the use of data and advanced analytics; and supporting data science users of our platform. We are cloud native and we work primarily on AWS. We deliver solutions using Scrum methodology. We have built and are operating the enterprise data lake, data mesh and data science platform on AWS to support our vision, which is to be able to deliver world class management of data.



Responsibilities:

  • Providing technical expertise and guidance for the components that make up our data ecosystem on AWS
  • In collaboration with your colleagues, leading and defining the end-to-end architecture of our data pipeline solutions
  • Taking the role of hands-on developer, tester, integration and deployment specialist on data pipelines
  • Build, evangelize and improve data pipeline templates, that other colleagues can utilize to build validated solutions in a streamlined fashion
  • Driving continuous improvement using behaviour-driven design principles, DevOps practices, and awareness of compliance requirements
  • Coaching and sharing knowledge with colleagues through demos, co-development and sparring, ensuring that expertise is spread across our Data Engineers to enable collaborative ways of working



Requirements:

  • At least 8 years’ experience working with contemporary cloud technologies, preferably AWS.
  • Experience deploying with CI/CD and working with modern build, test and deployment tools, ideally in large organisations
  • Strong skills with Python and at least one more of the following programming languages: TypeScript, Go, Java, Scala, C++, C# or Rust.
  • Strong skills in SQL and experienced with modern data warehouses and data modelling principles
  • Experienced with containerization using Docker or similar tools
  • Experienced with Spark (preferably on AWS Glue)
  • Experienced with software development best practices for writing, reviewing and refactoring code
  • The ability to understand complex technical matters, form an educated opinion, and communicate with impact to a variety of stakeholders with different levels of technical expertise.
  • Experience working with a regulated industry would be an advantage



  • Praca Warszawa
  • Warszawa - Oferty pracy w okolicznych lokalizacjach


    102 073
    17 509