Informacje o stanowisku
What You’ll Do
- Design, build, and optimize scalable data pipelines for ingestion, transformation, and storage.
- Collaborate with cross-functional teams to understand data requirements and implement best practices in data architecture.
- Ensure data quality, integrity, and security across all data systems.
- Work within a cloud environment (preferably AWS) to deploy, monitor, and manage data workflows.
- Apply Agile methodologies and TDD principles to ensure efficient and reliable development cycles.
- Support ad hoc data requests and contribute to process improvement initiatives.
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 3+ years of experience in data engineering or a similar role.
- Strong proficiency in Python and familiarity with frameworks such as Spark or Scala.
- Proven experience in building distributed, cloud-based data systems (AWS preferred).
- Working knowledge of PySpark, Databricks, and Agile development methodologies.
- Familiarity with Git, Jenkins, and test-driven development (TDD).
- Solid grasp of data modeling, data warehousing, and data architecture principles.
- Knowledge of graph databases is a plus.
What You’ll Do
- Design, build, and optimize scalable data pipelines for ingestion, transformation, and storage.
- Collaborate with cross-functional teams to understand data requirements and implement best practices in data architecture.
- Ensure data quality, integrity, and security across all data systems.
- Work within a cloud environment (preferably AWS) to deploy, monitor, and manage data workflows.
- Apply Agile methodologies and TDD principles to ensure efficient and reliable development cycles.
- Support ad hoc data requests and contribute to process improvement initiatives.
,[ Requirements: Data pipelines, AWS, Cloud, Databricks, UNITY, Spark Streaming, Python, Microservices, Spark, PySpark, Scala, Kubernetes, MongoDB Additionally: Sport subscription, Training budget, Private healthcare, Flat structure, International projects, Small teams, Free coffee, Canteen, Bike parking, Playroom, Free snacks, Free beverages, In-house trainings, Modern office, Startup atmosphere.
Praca WarszawaTechnolog WarszawaTechnolog żywności WarszawaWarszawa - Oferty pracy w okolicznych lokalizacjach
