.
Data Engineer with Python and SQL
  • Wroclaw
Data Engineer with Python and SQL
Wrocław, Wroclaw, Polska
R&D Viessmann Climate Solutions PL
23. 10. 2024
Informacje o stanowisku

Viessmann is a leader of technological progress in the heating industry, with its Wrocław based R&D Center developing the company’s products in the field of software and electronics. We use only state-of-the-art technology and equipment to translate the results of our work into innovative solutions to be applied in the near and more distant future.

The Data Team at Viessmann works on building and deploying novel analytical algorithms based on the data from our IoT products. The person in this position will work on the full stack; from data pipelines and processing to creating user facing applications. The team is a Wrocław & Allendorf based unit of Viessmann.

Your responsibilities:

  • Build and run Azure based Data Platform
  • Handle multiple Terabytes of different domains data with focus on IoT data using Stream and Batch processing
  • Craft and maintain world-class, high traffic analytical applications and services with a team of experienced data engineers and scientists
  • Develop data models and process raw data at scale to make it available for analysis
  • Build scalable data pipelines using state-of-the-art technologies in the Microsoft Azure Cloud
  • Implement, run and deploy algorithms in cooperation with data scientists using the Hadoop ecosystem (e.g. Spark, Hive, HDFS) and the Microsoft Azure Stack

Requirements:

What we expect:

  • Certification University degree in Computer Science or related fields of study (Mathematics, Physics)
  • 3-5 Years of experience architecting and building Data Lake, Azure Big Data architecture, Enterprise Analytics Solutions, and optimizing big data data pipelines, architectures and data sets.
  • Advanced hands-on SQL, TSQL, Python, pySpark, Hive, HDFS (2+ of these) knowledge and experience working with relational databases for data querying and retrieval.
  • Experience with Design and Architecture of Azure big data frameworks Azure Data Lake, Azure Data Factory, Azure Databricks, Azure ML, SQL Data Warehouse, HDInsights, Stream Analytics - or their Open Source counterparts: Kafka, Spark, Blob Storages. Experience with Design and Architecture of relational SQL and NoSQL databases.
  • Knowledge of DevOps Processes (including CI/CD) and infrastructure as a code fundamentals
  • Profound knowledge of Data Quality issues and methods of dealing with them
  • Fluent in English, German language will be considered as a plus

  • Praca Wrocław
  • Wrocław - Oferty pracy w okolicznych lokalizacjach


    98 217
    16 287