Get AI-powered advice on this job and more exclusive features.
We are looking for a freelancer who is interested in participating in individual projects and applying their expert knowledge of Apache Airflow. The Data Engineer will be responsible for developing and maintaining data platforms and delivering solutions together with our team of Data Engineers through complex challenges. This key role involves participating in the entire engineering lifecycle and ensuring successful data platform implementation. The ideal candidate will design and build data pipelines, act as a trusted advisor on Airflow technology for clients, and enhance process effectiveness. A Data Engineer collaborates with the project team on project delivery and standards, bringing expertise in Data Warehouse and Lakehouse development for large-scale customers. Essential skills include communication, collaboration, problem-solving, a data-driven mindset, and a passion for automation.
What makes you a great fit?
Key technologies
- Airflow | Data Platforms | SQL | Python | CI/CD | Azure | Data Services
- 3+ years of experience in configuration/release management, deployment, maintenance and familiarity with various Data Platforms and practices in data area
- Strong experience in Airflow pipeline orchestration and optimization
- Very good coding skills with knowledge of best practices in SQL, Python
- Conceptual and technical knowledge on CI/CD Pipelines, Automation Practices, Technical Operations Monitoring
Nice to have
- Knowledge of Docker, AKS
- Experience with Vertica, AWS EMS
- Experience in Azure Data services and Databricks
What will you do?
- Design and build cloud-based data pipelines and architectures.
- Integrate data from various structured and unstructured sources and formats.
- Implement automation for data workflows and support CI/CD processes.
- Optimize performance and resource usage of cloud data solutions.
- Maintain up-to-date knowledge of new technologies in data and cloud engineering.
- Monitoring, troubleshooting, and optimizing data systems for performance and cost.
- Supporting deployment of analytics and machine learning solutions on cloud platforms.
- Documenting processes, infrastructure, and best practices for future scalability.
Your Journey With Us Starts Here
- Initial Screening: If you meet our requirements, our recruiter will reach out to you for a chat about your motivations and expectations. Get ready to share your passion!
- Technical Interview: Youll be invited to showcase your skills in an interview with one of our technical experts or team members. This is your chance to shine and demonstrate your expertise.
- Final Interview: Youll have the opportunity to meet your future Team Lead. This is the moment to learn more about the role, the team, and to ask any questions you might have.
Seniority level
Employment type
Job function
Industries
- Information Services and IT Services and IT Consulting
Referrals increase your chances of interviewing at Elitmind by 2x
Get notified about new Data Engineer jobs in Warsaw, Mazowieckie, Poland.
Warsaw, Mazowieckie, Poland 12 months ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
