Informacje o stanowisku

technologies-expected :

• Python
• SQL
• Terraform
• PySpark
• CI/CD
• Azure Services

• We are looking for an experienced Data Engineer / Data Architect to lead the design, development, and optimization of enterprise-scale data solutions on Microsoft Azure, with additional expertise in Google Cloud Platform (GCP). This is a hands-on individual contributor role focused on building scalable and efficient data platforms, developing complex ETL/ELT pipelines, and enabling seamless multi-cloud integration. The ideal candidate combines strong technical depth with practical experience in data architecture, governance, and automation (CI/CD) within large-scale enterprise environments.

• Azure-Centric Data Engineering
• Design and deploy Azure data platforms:
• Data Lakes: Azure Data Lake Storage (ADLS Gen2) with Delta Lake optimizations.
• ETL/ELT: Azure Data Factory, Synapse Analytics, and Databricks workflows.
• Data Warehousing: Synapse Dedicated Pools, Azure SQL DB.
• Optimize Spark workloads (e.g. Azure Databricks) for performance tuning (partitioning, caching).
• Implement real-time pipelines: Azure Event Hubs, Stream Analytics, and IoT Hub integrations.
• Ensure data governance:
• Enforce data quality with Azure Purview (lineage tracking, sensitivity labeling).
• Implement RBAC and Azure Active Directory (AAD) integration for secure access.
• Build real-time analytics pipelines:
• Process streaming data via Azure Event Hubs/Stream Analytics with windowing and watermarking strategies.
• Operational Excellence
• Automate CI/CD pipelines.
• Lead disaster recovery (DR)
• Manage data lifecycle

• Core Azure Expertise
• Advanced SQL, PySpark, and Python.
• Infrastructure-as-Code (Terraform, ARM/Bicep).
• Performance tuning (partitioning, indexing, query optimization).
• Azure Services:
• Data Factory (ADF), Synapse, Databricks, Cosmos DB.
• DevOps (Azure Pipelines, Repos), Monitor, and Security Center.
• GCP Proficiency (nice to have):
• BigQuery (partitioned tables, materialized views).
• Cloud Storage, Dataflow, Pub/Sub.
• IAM and VPC networking.
• Looker, Dataproc, Composer (Airflow).

• Opportunity to lead end-to-end design of advanced, enterprise-scale data platforms in Azure and multi-cloud environments.
• Work with modern technologies (Azure, Databricks, Terraform, GCP) in a highly technical, hands-on role.
• Supportive, growth-oriented environment with opportunities for certification and continuous learning.
• A training budget to support your technical and professional development
• Private medical care and co-financing of a sports card
• Flexible working hours and the option to work fully remotely

• sharing the costs of sports activities
• private medical care
• sharing the costs of foreign language classes
• sharing the costs of professional training & courses
• remote work opportunities
• flexible working time
• integration events

Warszawa - Oferty pracy w okolicznych lokalizacjach