We are looking for a highly skilled Senior Data Engineer to join our innovative data team. The ideal candidate will have extensive experience in data extraction, transformation, and loading (ETL) processes, as well as a strong background in cloud data tools. You will be responsible for building and optimizing data pipelines, ensuring data quality, and collaborating with cross-functional teams to deliver actionable insights.
We are looking for a highly skilled Senior Data Engineer to join our innovative data team. The ideal candidate will have extensive experience in data extraction, transformation, and loading (ETL) processes, as well as a strong background in cloud data tools. You will be responsible for building and optimizing data pipelines, ensuring data quality, and collaborating with cross-functional teams to deliver actionable insights.
,[Data Management, Work closely with data modelers and business analysts., Create and integrate data structures suitable for analysis, including developing DDLs to create various MS Cloud SQL Server tables and views in Pond (a subset of the Data Lake) DB., Databricks Development., Configure the Ingestion Framework (IF) tables to utilize the existing framework for loading staging and Data Lake Core (DLC) tables. , Algorithm Development., Build large-scale batch and real-time data pipelines using data processing frameworks in cloud platforms or on-premise environments. , Leverage best practices in continuous integration and delivery to enhance data workflows. , Data Governance. , Recommend and implement automation in existing and future integration flows to improve efficiency. , Data Quality Improvement. Requirements: Python, Java, Scala, MS SQL Server, Azure Data Factory, Azure Databricks, PySpark, Power BI, ADLS, SQL Additionally: Free coffee, Bike parking, Free parking, Modern office, No dress code.