122 250
18 528
Data Engineer (Databricks Specialist) Miejsce pracy: Warszawa Technologies we use Expected Databricks PySpark Python SQL Microsoft Azure Microsoft Power BI Optional Kafka Event Hubs About the project We’re seeking an experienced Data Engineer with deep expertise in Databricks and modern data architectures. You’ll design, develop, and optimize large-scale data pipelines that power analytics, reporting, and AI initiatives—ensuring exceptional performance, scalability, and cost efficiency across the platform. This role focuses heavily on advanced Databricks optimization and backend data engineering for business intelligence tools such as Power BI. Your responsibilities Design, implement, and maintain scalable data pipelines serving as the data backbone for analytics and reporting. Develop layered data transformations (bronze, silver, gold layers) using Databricks and Delta Lake. Engineer and optimize batch and streaming pipelines for various data domains and use cases. Implement data governance, lineage, and observability frameworks to ensure trust and transparency. Collaborate with analysts, BI developers, and cloud engineers to deliver efficient data solutions. Apply Databricks performance optimization strategies to keep pipelines reliable and efficient. Our requirements Strong understanding of the Databricks platform: clusters, jobs, Delta Lake, and Lakehouse design principles. Expertise in PySpark, Python, and SQL for large-scale data transformation and optimization. Proven experience in advanced Databricks optimization. Experience designing modern data architecture patterns, including Lambda, Kappa, batch, and streaming. Familiarity with Azure Cloud services, orchestration tools, and data security concepts. Hands-on experience with Kafka, Event Hubs, or other streaming data frameworks. Strong teamwork, problem-solving, and communication skills. Understanding of Power BI as a data consumer and how to optimize backend models for BI performance. Optional Experience with data lineage and governance tools (e.g., Unity Catalog, Purview, Collibra). Exposure to MuleSoft or other integration frameworks. Experience deploying and automating Databricks workloads using CI/CD pipelines (GitHub, Azure DevOps). What we offer A chance to shape the data foundation of an evolving analytics landscape. Hands-on experience with modern data technologies and streaming architectures. A collaborative and forward-thinking environment that values innovation and technical excellence. Tangible impact on the company you work for. Collaboration with professionals from the IT and Supply Chain industry in a fun environment. Exposure to cutting-edge technologies and business frameworks. “We Get Things Done”– we value work in an agile high-growth company. This can be achieved with the right balance of planning and pragmatis. Benefits private medical care flexible working time integration events video games at work coffee / tea Multisport card Co-financed lunches Free on-site parking Recruitment stages CV check HR Interview Technical Interview Final Interview Hylogic sp. z o.o. Hylogic is at the heart of redefining the SCM landscape for the Fortune 500 giants, with a primary focus on the FMCG industry. We are a fast-growing IT consulting company specializing in supply chain planning transformation and advanced planning solutions.