Data Engineer
Miejsce pracy: Łódź
About the project
In your role as a Data Engineer you will be working in the Big Data Cluster, which is the enabler for data scientists and provides a huge collection of data and a data science workbench in one place.
On a daily basis you will develop products based on database technology which are running in the On-Premise or Cloud. Your responsibilities will encompass the full Software Development Lifecycle including analysis, architecture, testing and also supporting during production issues during normal working hours.
The Big Data cluster is the enabler for data scientists and provides a huge collection of data and a data science workbench in one place.
•BI technology within the lake infrastructure
•Establish a stable, state-of-the-art technology base with on-prem and cloud solutions
•Set up data lake as single data and analytics hub and effectively ingest most important data sources
•Establish data quality and metadata management
•Provide Data Marts and sandboxes for segments and functions with the most important combination of data sources
Your responsibilities
- Setting up data pipelines / ETL processes on cloud platforms (in particular Google Cloud)
- Ensuring data quality and integrity throughout the data lifecycle
- Focusing on stability, performance tuning and innovation of the applications/ monitoring
- Talking to sources about their source systems technologies and how to retrieve the data in an efficient way (file formats like csv, XML, JSON)
- Designing data structures (e.g. table partitioning, data formats)
- Exchange with the data platform team to give feedback and improvement ideas
- Taking care of proper up-to-date documentation of data and metadata
- Actively contributing to knowledge sharing and to a learning culture
- Working in the international projects in agile methodologies
Our requirements
- Good knowledge of Data warehouse, relational and non-relational database solutions
- Basic knowledge of SQL/ Data Engineering
- Basic knowledge of modern software development practices such as CI/CD
- Basic knowledge of Cloud, Python
- English level B2
Optional
- Basic knowledge of banking area
- Basic knowledge of Apache Kafka
This is how we work on a project
- Continuous Deployment
- Continuous Integration
What we offer
- Friendly and multicultural environment
- 26 days of holiday from the very beginning
Benefits
- private medical care
- sharing the costs of professional training & courses
- life insurance
- remote work opportunities
- flexible working time
- integration events
- corporate sports team
- retirement pension plan
- preferential loans
- no dress code
- video games at work
- coffee / tea
- leisure zone
- pre-paid cards
- redeployment package
- employee referral program
- extra leave
- Multisport
- Skills@Work - personal & professional development program
- Employee Assistance Program (psychological support)
- E-learning platform: OReilly, library, tutorials
Commerzbank AG
Commerzbank is a leading international commercial bank with branches and offices in almost 50 countries. The world is changing, becoming digital, and so we are. We are leaving the traditional bank behind us and are choosing to move forward as a digital enterprise. This is exactly why we need talented people who will join us on this journey. We work in inter-locational and international teamwork in agile methodologies.
Please add the following clause to your application:1. I consent to the processing of personal data contained in this document by Commerzbank AG with its registered office in Frankfurt am Main, Germany, 60261 Kaiserplatz, operating through the Branch in Poland with its registered office in Łódź, 91-203 Łódź, ul. Wersalska 6, KRS 0000631053, for the implementation of the current recruitment process and for the future recruitment for a period of 6 months, in accordance with the Regulation of the European Parliament and of the Council (EU) 2016/679 of 27 April 2016 on the protection of individuals with regard to the processing of personal data the free flow of such data and the repeal of Directive 95/46 / EC (RODO) and in accordance with the Act of 10 May 2018 on the protection of personal data (Journal of Laws of 2018, item 1000). I provided my personal data voluntarily and I declare that they are truthful. I have the right to withdraw this consent at any time. The withdrawal of consent shall not affect the lawfulness of processing based on consent before its withdrawal.2. I have read the content of the information clause, including information about the purpose and methods of processing personal data and the right to access to my personal data and about the right to correct, rectify and delete it.
INFORMATION CLAUSE FOR A CANDIDATEPursuant to Article 13(1-2) of the General Data Protection Regulation of 27 April 2016 (hereinafter referred to as GDPR), I inform that: Your personal data are controlled by Commerzbank AG with its registered office in Frankfurt am Main, Germany, 60261 Kaiserplatz, acting through a Branch in Poland with its registered office in Łódź, 91-203 Łódź, ul. Wersalska 6, KRS 0000631053; Your personal data will be processed for the purpose of carrying out the recruitment process pursuant to Article 6(1)(c) of GDPR and pursuant to Article 6(1)(a) of GDPR; Your personal data may be made available to other recipients, such as entities processing personal data on behalf of the Data Controller and other entities involved in the process of Data Controller’s business activity organisation, such as banks and courier companies, postal operators, Social Insurance Institution [ZUS, tax offices and other entities entitled under the rules of the law; The personal data provided by you will be - based on your consent - transferred to a third country: the United States of America, for which the European Commission has not issued a decision confirming the appropriate level of protection specified in art. 45 item 3 GDPR. Your data will be protected in a third country by: Standard data protection clauses approved by the European Commission / [supervisory authority binding corporate rules an approved code of conduct combined with enforceable data recipients commitments to appropriate safeguards. an approved certification mechanism combined with enforceable data recipients obligations for appropriate safeguards. administrative contract / arrangement approved by the supervisory authority.The recipient of your personal data in the abovementioned the third country is Breezy HR, Inc.; Address: 1534 Oak Street, Suite 301; Jacksonville, FL 32204 Your personal data will be stored during the recruitment process and to the extent to which personal data are processed pursuant to the consent granted, until a withdrawal of such consent; You have the right to access your personal data as well as the right to rectify, erase (so-called right to be forgotten), restrict the processing of data, the right to data portability, the right to object to processing, the right to withdraw consent at any time without affecting the lawfulness of processing based on consent before its withdrawal; If you believe that the processing of your personal data is in breach of the provisions of the General Data Protection Regulation of 27 April 2016, you shall have the right to file a complaint to a supervisory authority responsible for the protection of personal data – Chairman of Data Protection Office; To the extent provided for in Article 221 of the Polish Labour Code, the provision of your personal data constitutes a statutory requirement, the non-fulfilment of which renders it impossible to conclude and continue the employment relationship, whereas the provision of personal data subject to consent to their processing, is voluntary; Your personal data will not be processed by automated means, including through profiling.
