.
Senior Data Engineer
  • Warsaw
Senior Data Engineer
Warszawa, Warsaw, Masovian Voivodeship, Polska
Algoteque
9. 12. 2024
Informacje o stanowisku

ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce. We deliver our services both in fixed-price and time-and-materials models, helping our customers achieve their business and IT strategies.

Job Description :

We are looking for a skilled Senior Data Engineer to join our data team. The ideal candidate will have experience in building data pipelines, implementing data models, and following best practices in data product development. Proficiency in AWS, GitLab CI/CD, dbt, Snowflake, SQL, Python, Git, DevOps, and experience with orchestration tools like Airflow and AutoMateNow, as well as data governance tools like Monte Carlo and Collibra, is required.Key Responsibilities:- Data Pipelines: Develop and maintain scalable ETL/ELT pipelines for diverse data sources.- Data Modeling: Build and manage data models and architecture to ensure performance and integrity.- Automation & CI/CD: Implement CI/CD pipelines with GitLab for automated testing and deployment.- Database Management: Optimize Snowflake databases for performance and cost-efficiency.- Scripting & Coding: Write SQL queries and Python scripts for data transformation.- Orchestration: Use Airflow and AutoMateNow for workflow automation.- Data Governance: Implement tools like Monte Carlo and Collibra for data governance and observability.- Collaboration: Work closely with data scientists and analysts to deliver quality data solutions.

Profile / Requirements :

Requirements:- 5+ years of experience in data engineering.- Strong knowledge of AWS services (S3, Redshift, Lambda, Glue).- Proficiency in GitLab CI/CD, dbt, Snowflake, SQL, Python.- Experience with DevOps practices and data orchestration tools.- Familiarity with data governance technologies.

  • Praca Warszawa
  • Warszawa - Oferty pracy w okolicznych lokalizacjach


    90 164
    14 572