A Data Engineers role involves crafting, constructing, and upholding the structure, tools, and procedures essential for an organization to gather, store, modify, and scrutinize extensive data amounts. This position involves creating data platforms using typically provided infrastructure and establishing a clear path for Analytics Engineers who utilize the system.
responsibilities :
Working alongside Platform Engineers to assess and choose suitable technologies and tools for the project
R&D, maintenance, and monitoring of the platforms components
Implementing intricate data intake procedures
Constructing efficient data models
Implementing and executing policies aligned with the companys strategic plans concerning used technologies, work organization, etc.
Ensuring compliance with industry standards and regulations in terms of security and data privacy applied in the data processing layer
Providing training and fostering knowledge-sharing
requirements-expected :
Proficiency in a programming language like Python and SQL
Knowledge of the BigQuery DWH platform
Working with Spark messaging systems
Experience as a programmer and knowledge of software engineering, good principles, practices, and solutions
Familiarity with cloud Google Cloud Platform (GCP)
Knowledge of at least one orchestration and scheduling tool, for example, Airflow, Prefect, Dragster, etc.
Familiarity with DevOps area and tools - GKE, Docker
Experience with Version Control System, preferably GIT
Ability to actively participate/lead discussions with clients to identify and assess concrete and ambitious avenues for improvement
offered :
Salary: 110 - 160 PLN net + VAT/h B2B (depending on knowledge and experience)
100% remote work
Flexible working hours
Possibility to work from the office located in the heart of Warsaw
Opportunity to learn and develop with the best Big Data experts
