Informacje o stanowisku

 Join our team as a Senior Data Engineer! 

As a Senior Data Engineer you will work in the team that is responsible for all cross-cutting cloud/Hadoop topics in the Big Data & Advanced Analytics key area. You will be in charge of cloud and data engineering in the cloud migration and development of cloud-native applications, mentoring others in technical concepts and implementing best practices for our Cloud-based data ingestion solutions. Furthermore, in your role you will be responsible for the investigation, preparation and migration of our Products from our On-Premise infrastructure to the Cloud native (GCP and Azure).

A dynamic and representative working environment in a collegial atmosphere and attractive benefits ensure that you feel at home from the start.

What you will be doing? 

1. Working in a task orientated and Test Driven Team to investigate our Product and choose the candidates for On-Premise to Cloud migration
2. Implement and maintain cloud-native landing and solutions
3. Develop future-proof software solutions to Connect cloud and on-premise and viseversa
4. Integrate security standards, policies and controls into service offerings

Alternative tasks:

1. Focusing on stability, performance tuning and innovation of the applications
2. Coaching colleagues and end users, actively contributing to knowledge sharing and to a learning culture

Which technology & skills are important for us? 

1. Cloud Data Development:
2. Design and develop cloud-based data storage solutions using Google Cloud Platform services such as Cloud Composer, Dataproc, Dataflow and Pub/Sub
3. Build and maintain data pipelines to ensure data accuracy, consistency, and real-time processing
4. Optimize data infrastructure for performance, scalability and reliability
5. Infrastructure as Code (IaC):
6. Utilize Terraform to create and manage cloud resources efficiently
7. Implement CI/CD pipelines for automated deployment and continuous integration
8. Microservices and API:
9. Work with microservices architecture and design APIs for seamless data integration
10. Scripting and Testing:
11. Proficient in Python and SQL for ETL processes, schema evolution pipeline development and performance tuning
12. Develop, test, and deploy solutions using Dataproc, Dataflow, and Cloud Functions
13. Scala Expertise:
14. Leverage Scala for Dataproc pipeline development, enhancement and performance tuning

How?

Hybrid on Wersalska 6 street (two days per week)

Below you can find more information about cluster and Commerzbank.

The Big Data cluster is the enabler for data scientists and provides a huge collection of data and a data science workbench in one place.

• BI technology within the lake infrastructure
• Establish a stable, state-of-the-art technology base with on-prem and cloud solutions
• Set up data lake as single data and analytics hub and effectively ingest most important data sources
• Establish data quality and metadata management
• Provide Data Marts and sandboxes for segments and functions with the most important combination of data sources

Commerzbank is a leading international commercial bank with branches and offices in almost 50 countries. The world is changing, becoming digital, and so we are. We are leaving the traditional bank behind us and are choosing to move forward as a digital enterprise. This is exactly why we need talented people who will join us on this journey. We work in inter-locational and international teamwork in agile methodologies.

What we offer? 

Łódź - Oferty pracy w okolicznych lokalizacjach