.
Data Engineer
  • Lublin
Data Engineer
Lublin, Lublin, Lublin Voivodeship, Polska
Sunscrapers
22. 11. 2024
Informacje o stanowisku

Are you ready to take on the challenge?


We’re looking for a Data Engineer to join our team in Warsaw or remotely.


Advance your career with Sunscrapers, a leading force in software development that is now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. Enjoy a competitive compensation package that reflects your skills and expertise while working in a company that values ambition, technical excellence, trust-based partnerships, and actively supports contributions to R&D initiatives.


As a Data Engineer, you’ll play a pivotal role in building a robust data platform that drives engagement solutions for leading healthcare brands. Your work will directly support the development of omnichannel digital health experiences, empowering consumers to access the programs, benefits, and care they need.


In this role, you’ll leverage cutting-edge technologies such as Apache Spark, Databricks, and Delta Tables to design and implement scalable data solutions. You’ll enable actionable insights by integrating diverse data sources, building efficient pipelines, and supporting data-driven decision-making.


Your responsibilities will include:

  • Design and optimize data infrastructure using Python, PySpark, Apache Spark, and Delta Spark,
  • Implement strong data governance frameworks to ensure quality, security, and compliance,
  • Connect Delta Tables to a SQL engine (like Databricks SQL) for efficient querying and analytics,
  • Leverage strong DevOps expertise to deploy and maintain data systems in Azure,
  • Create batch and streaming pipelines for data processing.


Whats important for us?

  • At least 3 years of professional experience as a data engineer,
  • Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar,
  • Excellent command of spoken and written English (at least C1),
  • Experience in designing data infrastructure using Python, PySpark, Apache Spark, and Delta Spark,
  • Experience in managing production spark clusters either in Databricks,
  • Proficiency in SQL and experience with Delta Lake architectures,
  • Great analytical skills and attention to detail - asking questions and proactively searching for answers,
  • Creative problem-solving skills,
  • Great customer service and troubleshooting skills.


Youll score extra points for:

  • Familiarity with CI/CD pipelines and containerization (Docker, Kubernetes),
  • Experience with real-time data tools like Kafka or Azure Event Grid, 
  • Experience with BigQuery,
  • Experience in managing data governance in the healthcare space.


What do we offer?

  • Working alongside a talented team that’s changing the image of Poland abroad.
  • Flexible working hours and remote work possibility.
  • Comfortable office in a penthouse in central Warsaw equipped with all the necessary tools to conquer the universe (Macbook, external screen, ergonomic chairs).
  • Fully equipped kitchen with fruit, hot and cold drinks.
  • Multisport card & Private medical care.
  • Culture of good feedback: evaluation meetings, mentoring.
  • We value and appreciate our engineers eagerness to learn and improve so we strongly encourage and support their growth!

  • Praca Lublin
  • Lublin - Oferty pracy w okolicznych lokalizacjach


    98 217
    16 287