We are seeking a highly skilled and consultative Senior Data Engineer with Databricks expertise to join our team.
responsibilities :
As a Data Engineer, you will provide technical leadership and guide customers to successful implementations of big data projects, ranging from architecture and design to data engineering to model deployment. You will lead clients through migrations and architect solutions from concept to production. You will provide structured mentorship for other team members and technical support for pre-sales efforts.
requirements-expected :
Experience leading design and end-to-end development of distributed Databricks-based solutions, including Lakehouse architectures, ETL pipelines, streaming and batch processing, and integration with clients cloud and on-premises enterprise systems.
Hands-on experience in building big data pipelines.
Hands-on programming experience in Python.
Expert knowledge of SQL, Spark (or PySpark), including data ingestion from a variety of sources such as APIs, relational databases, etc.
Hands-on experience using dbt within Databricks ecosystem.
Solid understanding of data governance, security, and compliance.
Hands-on experience with platform optimization: cluster configuration, partitioning strategies, caching, autoscaling, and job orchestration.
Ability to clearly articulate core Databricks concepts and explain their practical applications.
Bachelors degree in computer science, Information Systems, Engineering, or equivalent work experience.
