In your role as a Data Engineer DevOps, you will be responsible for the continuous development and maintenance of the provisioning data processes. We collect data from many systems across various data domains and makes this data available for analytics on the Data Lake and Google Cloud. On the daily basis we are provisioning over 4 TB of data supplying Data Lake that contains over 3PB of data.
Data Engineer DevOps is responsible for the establishing, enhancing a group-wide data quality and data processing which is one of the foundations of Commerzbank transformation to a digital technology company. You will enhance the platform with new features, optimize the exiting implementations, improve performance of processes.
responsibilities :
Monitoring of production environment for data completeness Hadoop Data Lake and Google Cloud
Managing incidents on Production environment, automate current processes
Supporting team in Cloud journey
Quick investigating of issues, either creating bugfix or dispatching issue to developers to fix it (depends on issue)
Deploying changes to Production environment
Daily cooperation with users, product owners and other IT teams in Poland and abroad
Alternative tasks:
Enhance existing monitoring in Grafana
Finding innovative solutions for product design
Coaching colleagues and end users, actively contributing to knowledge sharing and to a learning culture
requirements-expected :
Strong problem-solving attitude and analytical skills
Good knowledge of Unix knowledge, shell scripting and SQL/HQL
Knowledge of Data Lake HDFS and CI/CD
Basic knowledge of UC4 Job scheduling and monitoring and reporting issues
offered :
Friendly and multicultural environment
26 days of holiday from the very beginning
benefits :
private medical care
sharing the costs of professional training & courses
life insurance
remote work opportunities
flexible working time
integration events
corporate sports team
retirement pension plan
preferential loans
no dress code
video games at work
coffee / tea
leisure zone
pre-paid cards
redeployment package
employee referral program
extra leave
Multisport
Skills@Work - personal & professional development program
Employee Assistance Program (psychological support)
