Senior Data Engineer
Miejsce pracy: Warszawa
Technologies we use
Expected
- Microsoft SQL Server
- Oracle
- Redshift
- PostgreSQL
- Teradata
- MongoDB
- Cosmos DB
- DynamoDB
- Neo4j
- HBase
- Redis
- InfluxDB
- SQL
- Python
- Spark
- Hadoop
- Azure
- Data Factory
- Apache Flink
- Apache Kafka
- Apache Airflow
- Debezium
- AWS
About the project
• Location of office: Warsaw
• Mode of work: 100% remote
• Type of employment: B2B contract
• Rate: up to 180 PLN NET/H
• Project language: English (min B2)
Your responsibilities
- Designing new solutions and coming up with initiatives for improvements to existing solutions within data platforms - both as part of orders coming from the business (functional changes) and from technology (architectural changes)
- Development of data platforms and ETL/ELT processes: technical support and active participation in the development of data platforms.
- Work on building and optimizing ETL/ELT processes that are responsible for processing large data sets.
- Implement processes to ensure optimal data processing
- Standardize and streamline technical processes: implementing and optimizing code, test and documentation management standards
- Selecting and configuring tools and development environments that support data engineering processes to maintain code quality and facilitate code scaling
- Ensure standards compliance and code review: responsible for applying existing platform development standards and monitoring the quality of delivered solutions
- Work directly with technology as a Data Engineer and Data Analyst to maintain a high level of technology sophistication, understand current challenges, and drive improvements based on actual technical need
- Act as a mentor to the team, providing subject matter support in the areas of solution design, code standardization, process optimization and best practice implementation
Our requirements
- Minimum 5 years of experience in designing and building Business Intelligence, ETL/ELT, Data Warehouse, Data Lake, Data Lakehouse, Big Data, OLAP class solutions
- Practical knowledge of various relational (e.g., SQL Server, Oracle, Redshift, PostgreSQL, Teradata) and non-relational database engines (e.g., MongoDB, Cosmos DB, DynamoDB, Neo4j, HBase, Redis, InfluxDB)
- Strong proficiency in SQL and Python (minimum 5 years of experience)
- Familiarity with data engineering and orchestration tools, particularly Spark/Databricks (including structured streaming mechanisms, DLT, etc.), Hadoop/CDP, Azure/Fabric Data Factory, Apache Flink, Apache Kafka, Apache Airflow, dbt, Debezium, and more
- Understanding of data governance, data quality, and batch/streaming data processing challenges
- Knowledge of architectural patterns in data, including Data Mesh, Data Vault, Dimensional Modeling, Medallion Architecture, and Lambda/Kappa Architectures
- Proficiency in using git repositories (Bitbucket, GitHub, GitLab)
- Experience with data services on the Azure and/or AWS platforms
- Flexibility, self-reliance, and efficiency, with a strong sense of responsibility for assigned tasks
- Practical knowledge of English at a minimum B2 level (C1+ preferred)
This is how we organize our work
This is how we work
- in house
- at the clients site
- agile
Development opportunities we offer
- intracompany training
- mentoring
- technical knowledge exchange within the company
What we offer
- B2B contract with salary range up to 180 PLN NET/H
- 100% remote job
- Opportunity to be involved in global projects
- Additional benefits
- Trainings and certification budget- (Microsoft certifications, AWS, Databricks)
- Learning time - 60 paid hours per year
Benefits
- sharing the costs of sports activities
- private medical care
- sharing the costs of professional training & courses
- life insurance
- remote work opportunities
- flexible working time
- integration events
Cyclad
In Cyclad we work with top international IT companies in order to boost their potential in delivering outstanding, cutting edge technologies that shape the world of the future. For our client, we are seeking a WebLogic Engineer to support the maintenance and troubleshooting of our infrastructure. Join a dynamic, multilingual team of engineers who are dedicated to delivering mission-critical systems while ensuring top-notch availability, performance, and security.
Please enclose the following statement in your application:I hereby give consent for my personal data contained in the submitted application documents to be processed by Cyclad sp. z o.o., ul. Chłodna 48/1, 00-872 Warszawa, including my image, in relation to my participation in the recruitment process. I acknowledge that the above consent may be withdrawn at any time.
If you are interested in participating in future recruitment processes, please enclose the following statement in your application:I hereby give consent for my personal data contained in the submitted application documents to be processed by Cyclad Sp. z o.o., Cyclad sp. z o.o., ul. Chłodna 48/1, 00-872 Warszawa, including my image, in relation to my participation in future recruitment processes. I acknowledge that the above consent may be withdrawn at any time.The Personal Data Controller is Cyclad Sp. z o.o., ul. Chłodna 48/1, 00-872 Warszawa, e-mail: office@cyclad.pl, contact with the Data Protection Officer is available via e-mail: IOD@cyclad.pl. Personal data collected through job applications (CV) within the scope provided for in labor regulations shall be processed in order to allow performance of the ongoing recruitment pursuant to Art. 6(1)(a) of Regulation (EU) no. 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of individuals with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (further referred to as GDPR). In case of giving consent to processing of data for future recruitment processes – personal data shall be processed under theconsent, pursuant to Art. 6(1)(a) of the GDPR. If the Application form contains data referred to in Art. 9(1) of the GDPR, it shall be necessary to have the candidates consent for the processing of such data (Art. 9(2)(a) of the GDPR). The consent can be revoked at any time. Withdrawal of the consent shall not affectthe lawfulness of the processing that had been performed under the consent prior to its withdrawal. Personal data provided by the candidate related to:- participation in a selected recruitment process will be stored until the recruitment process is completed for a given position,- participation in future recruitment processes will be stored until the candidates consent to the processing of their data for this purpose is withdrawn, no longer, however, than for 5 years since the last update of the candidate’s data.Personal data may be disclosed to employees or associates of the Company, entities providing support to the Company on the basis of outsourced services or in accordance with data processing agreements, to entities authorized under the law, as well as to entities collaborating with the Company within the scope of job placement, in order to conduct recruitment processes. After the employee’s consent, personal data may also be disclosed to a potential employer for whom the recruitment process is being conducted.Submission of the candidate’s personal data within the scope under Art. 221 of the Labor Code is obligatory for participation in the recruitment process. Submission of other data by the candidate is voluntary. No submission of personal data within the required scope or objection to the processing ofsuch data shall result in lack of possibility to include the Application in the recruitment processes conducted by the Company.The candidate has the right to access and rectify the contents of their data, remove such data, limit its processing, transfer such data, submit objection to the processing and revoke the consent at any time, without affecting the lawfulness of the processing conducted under such consent before it waswithdrawn. The candidate also has the right to file a complaint with the President of the Office for Personal Data Protection when they consider the processing of their personal data to be a violation of the provisions of the GDPR.