A Data Engineers role involves crafting, constructing, and upholding the structure, tools, and procedures essential for an organization to gather, store, modify, and scrutinize extensive data amounts. This position involves creating data platforms using typically provided infrastructure and establishing a clear path for Analytics Engineers who utilize the system.
responsibilities :
Working alongside Platform Engineers to assess and choose suitable technologies and tools for the project
Supporting and diagnosing technical problems of the data processing layer
Implementing intricate data intake procedures
Constructing efficient data models
Implementing and executing policies aligned to the strategic plans of the company concerning used technologies, work organization, etc.
Ensuring compliance with industry standards and regulations in terms of security and data privacy applied in the data processing layer
Providing training and fostering knowledge-sharing
requirements-expected :
Proficiency in a programming language like Python and SQL
Deep understanding of data warehousing concepts and experience with platforms such as Snowflake, BigQuery, or Redshift
Experience as a programmer and knowledge of software engineering, good principles, practices, and solutions
Familiarity with cloud GCP / AWS
Familiarity with DevOps area and tools - GKE, Docker
Familiarity with tools like Airflow
Experience with distributed computing frameworks (e.g., Spark, Hadoop) and data integration tools
Experience with CI/CD tools and practices for automated testing, deployment, and monitoring (e.g., Jenkins, GitLab CI, GitHub Actions)
offered :
Salary: 110 - 160 PLN net + VAT/h B2B (depending on knowledge and experience)
100% remote work
Flexible working hours
Possibility to work from the office located in the heart of Warsaw
Opportunity to learn and develop with the best Big Data experts
