We are currently looking for a Data Engineer who likes the sound of all that! In this role, you would be part of the Data & Analytics team and would evaluate requirements, design, code, and maintain high-performance data systems to drive informed decision-making.
What Youll Do
Create data pipelines to ingest data from dissimilar sources (performance, reliability, monitoring).
Server data models as a product to the entire organisation through implementation and debugging.
Collaborate with the other teams to address data sourcing and provision requirements.
Coordinate with the Product & Technology teams to ensure all platforms collect and provide appropriate data.
Liaise with the other Data & Analytics teams to ensure reporting and analytics needs can be addressed by the central data lake.
Support the Data Quality and Security initiatives by building into the architecture the necessary data access, integrity, and accuracy controls
requirements-expected :
3+ years of experience in Data Engineering
3+ years of experience in ETL/ELT development in cloud env.
Degree in Computer Science, Software Development, Engineering , or a related technical field.
Proficient in Python and SQL
Understanding of RDBMS, Columnar and NoSQL engines & performance
Experience with cloud architecture and tools: Microsoft Azure, Amazon or GCP
Experience with orchestration tools such as Apache AirFlow or UC4
Understanding of distributed logging platforms
Familiarity with DWH modeling will be considered an advantage.
Familiarity with DevOps methodologies and concepts will be considered an advantage
Background in stream data processing technologies such as NiFi, Kinesis, Kafka will be considered an advantage
Exposure to Java will be considered an advantage
Prior exposure to the Snowflake ecosystem will be considered an advantage
