We’re seeking an experienced Data Engineer with deep expertise in Databricks and modern data architectures. You’ll design, develop, and optimize large-scale data pipelines that power analytics, reporting, and AI initiatives—ensuring exceptional performance, scalability, and cost efficiency across the platform. This role focuses heavily on advanced Databricks optimization and backend data engineering for business intelligence tools such as Power BI.
responsibilities :
Design, implement, and maintain scalable data pipelines serving as the data backbone for analytics and reporting.
Develop layered data transformations (bronze, silver, gold layers) using Databricks and Delta Lake.
Engineer and optimize batch and streaming pipelines for various data domains and use cases.
Implement data governance, lineage, and observability frameworks to ensure trust and transparency.
Collaborate with analysts, BI developers, and cloud engineers to deliver efficient data solutions.
Apply Databricks performance optimization strategies to keep pipelines reliable and efficient.
requirements-expected :
Strong understanding of the Databricks platform: clusters, jobs, Delta Lake, and Lakehouse design principles.
Expertise in PySpark, Python, and SQL for large-scale data transformation and optimization.
Proven experience in advanced Databricks optimization.
Experience designing modern data architecture patterns, including Lambda, Kappa, batch, and streaming.
Familiarity with Azure Cloud services, orchestration tools, and data security concepts.
Hands-on experience with Kafka, Event Hubs, or other streaming data frameworks.
Strong teamwork, problem-solving, and communication skills.
Understanding of Power BI as a data consumer and how to optimize backend models for BI performance.
offered :
A chance to shape the data foundation of an evolving analytics landscape.
Hands-on experience with modern data technologies and streaming architectures.
A collaborative and forward-thinking environment that values innovation and technical excellence.
Tangible impact on the company you work for.
Collaboration with professionals from the IT and Supply Chain industry in a fun environment.
Exposure to cutting-edge technologies and business frameworks.
“We Get Things Done”– we value work in an agile high-growth company. This can be achieved with the right balance of planning and pragmatis.
