Wrocław, Wrocław, Lower Silesian Voivodeship, Polska
SNI sp. z o.o.
5. 11. 2024
Informacje o stanowisku
technologies-expected :
azure databricks
Azure Data Factory
Python
SQL
Azure OpenAI Service
Azure Data Lake
Generative AI
MLOps
about-project :
We are looking for Senior Data Engineer with experience in AI projects to join our team and help us integrate AI solutions into our applications. In this role, you will be responsible for supporting internal users and processes by solving maintenance and data quality issues, and ensuring the efficient operation of our organizations systems.
responsibilities :
Build a common data platform. One of the main goals is to migrate and re-design solutions from On-premises platform to the cloud in Azure.
Provide interactive reports for customers to help them achieve their goals.
Focus on data ingestion & replication to our common and shared platform in the cloud.
Develop data pipelines between various applications i.e., Azure, SAP, Salesforce, Oracle, MS Dynamics 365.
requirements-expected :
At least 4-5 years of experience in Data Engineering
Expertise in Azure cloud service platform
Proven experience with large databases and data warehouses
Expertise in Databricks: Delta Tables, DLT, Unity Catalog, performance tuning, etc.
Good knowledge in Azure services: Azure Data Factory, Azure SQL Database, Azure Key Vault, Azure OpenAI Service
Proficiency in Python and PySpark
Knowledge of modern Data Modeling and Design concepts
Ability to design simplified E2E Azure solution architecture
Agile - flexibility to execute available tasks in a rapidly changing environment
Familiarity with authentication mechanisms in Azure
Ability to use Version Control (Git) with Azure DevOps