.
Senior Data Engineer - Big Data
  • Łódź
Senior Data Engineer - Big Data
Łódź, Łódź, Łódź Voivodeship, Polska
Commerzbank AG
4. 5. 2024
Informacje o stanowisku

technologies-expected :


  • Python
  • SQL
  • Terraform
  • Scala

about-project :


  • As a Senior Data Engineer you will work in the team that is responsible for all cross-cutting cloud/Hadoop topics in the Big Data & Advanced Analytics key area. You will be in charge of cloud and data engineering in the cloud migration and development of cloud-native applications, mentoring others in technical concepts and implementing best practices for our Cloud-based data ingestion solutions. Furthermore, in your role you will be responsible for the investigation, preparation and migration of our Products from our On-Premise infrastructure to the Cloud native (GCP and Azure).
  • A dynamic and representative working environment in a collegial atmosphere and attractive benefits ensure that you feel at home from the start.

responsibilities :


  • Working in a task orientated and Test Driven Team to investigate our Product and choose the candidates for On-Premise to Cloud migration
  • Implement and maintain cloud-native landing and solutions
  • Develop future-proof software solutions to Connect cloud and on-premise and viseversa
  • Integrate security standards, policies and controls into service offerings
  • Alternative tasks:
  • Focusing on stability, performance tuning and innovation of the applications
  • Coaching colleagues and end users, actively contributing to knowledge sharing and to a learning culture

requirements-expected :


  • Cloud Data Development:
  • Design and develop cloud-based data storage solutions using Google Cloud Platform services such as Cloud Composer, Dataproc, Dataflow and Pub/Sub
  • Build and maintain data pipelines to ensure data accuracy, consistency, and real-time processing
  • Optimize data infrastructure for performance, scalability and reliability
  • Infrastructure as Code (IaC):
  • Utilize Terraform to create and manage cloud resources efficiently
  • Implement CI/CD pipelines for automated deployment and continuous integration
  • Microservices and API:
  • Work with microservices architecture and design APIs for seamless data integration
  • Scripting and Testing:
  • Proficient in Python and SQL for ETL processes, schema evolution pipeline development and performance tuning
  • Develop, test, and deploy solutions using Dataproc, Dataflow, and Cloud Functions
  • Scala Expertise:
  • Leverage Scala for Dataproc pipeline development, enhancement and performance tuning

offered :


  • Friendly and multicultural environment
  • 26 days of holiday from the very beginning

benefits :


  • private medical care
  • sharing the costs of professional training & courses
  • life insurance
  • remote work opportunities
  • flexible working time
  • integration events
  • corporate sports team
  • retirement pension plan
  • preferential loans
  • no dress code
  • video games at work
  • coffee / tea
  • leisure zone
  • pre-paid cards
  • redeployment package
  • employee referral program
  • extra leave
  • Multisport
  • Skills@Work - personal & professional development program
  • Employee Assistance Program (psychological support)
  • E-learning platform: OReilly, library, tutorials

  • Praca Łódź
  • Łódź - Oferty pracy w okolicznych lokalizacjach


    118 346
    18 862