We are looking for a Senior Data Engineer with strong expertise in Azure Databricks. The ideal candidate will be skilled in building and optimizing data solutions, with excellent analytical abilities and a strong focus on communication and collaboration with business stakeholders, internal teams, and external partners.
Responsibilities
- Design, build, and optimize data pipelines using Azure Databricks.
- Work with batch and streaming data processing.
- Collaborate with business stakeholders, internal teams, and external partners.
- Implement and maintain workflows and data solutions.
- Use Azure DevOps for CI/CD processes (Repos, Pipelines, YAML).
- Manage data with Unity Catalog.
Must-have competences & skills
- Proven experience with Azure Databricks (data engineering, pipelines, performance tuning).
- Strong skills in Python, PySpark, and SQL.
- Experience with batch and streaming data.
- Familiarity with Azure DevOps (Repos, Pipelines, YAML).
- Experience with Unity Catalog.
- Excellent communication and stakeholder management skills.
- Experience with SQL Server is a plus.
Additional requirements
- Proficiency in Polish and English.
Compensation & Details
- Hourly Rate: up to 140 PLN
- Location: Wroclaw, Poland
- Work arrangement: hybrid, 2 days at the office, full-time