Develocraft is looking for a Data Engineer for one of our international clients, which operates in several different areas. Among its many tasks are the provision of IT security services, Big Data, risk management, cloud services, broad process automation, and the development of existing applications and platforms.
responsibilities :
Designing and building data pipelines
Collaborating with other team members
Implementing new features with PySpark
Conducting tests in Apache Airflow
Deploying in Kubernetes
Optimizing data
Working with the latest technologies and constantly improving
requirements-expected :
5+ years of professional experience as Data Engineer
Good knowledge of Python
Knowledge of PySpark, Airflow and Kedro
Experience with building data pipelines
Knowledge of data manipulation and transformation
Ability to set up and optimize SQL and NoSQL data stores
