Wieliczka, Wieliczka, Lesser Poland Voivodeship, Polska
CLEDAR Sp. z o.o.
10. 11. 2024
Informacje o stanowisku
technologies-expected :
Python
SQL
AWS
Google Cloud Platform
Microsoft Azure
Git
about-project :
Were seeking a Senior Data Engineer to architect, build, and scale our data warehouse solutions and data products. Youll work with a modern data stack and have the opportunity to shape our data infrastructure while solving complex data engineering challenges.
responsibilities :
Design, implement, and optimize data pipelines using Apache Airflow and Python
Build real-time data streaming solutions using Apache Kafka
Architect and maintain our data warehouse infrastructure
Develop RESTful APIs using FastAPI to expose data products
Create and maintain database migrations using Alembic
Develop and optimize complex SQL queries across different database environments
Create robust data quality monitoring and testing frameworks
Collaborate with data scientists and analysts to enable efficient data access
Mentor junior engineers and contribute to technical decision-making
Design and implement data models that balance performance and maintainability
requirements-expected :
5+ years of experience in data engineering roles
Strong expertise in Python development and SQL optimization
Hands-on experience with:
a) Apache Airflow for workflow orchestration
b) Apache Kafka for stream processing
c) PostgreSQL or similar RDBMS
d) Analytics databases (StarRocks, DuckDB, or similar MPP databases)
e) FastAPI for building data APIs
f) DBT for data transformation and documentation
Alembic for database migrations and schema management
Understanding of data modeling concepts (dimensional modeling)
Understanding of data transformation best practices and testing methodologies
Experience with data quality management and testing frameworks
Familiarity with cloud platforms (AWS/GCP/Azure)
Version control (Git) and CI/CD practices
offered :
Flexible working hours: Agree on working hours that suit your lifestyle
Possibility to work 100% remotely or from our office in Wieliczka
Certifications: We support your learning and will fund your certification ambitions
Access to books and online resources
Events and conferences: We support you in staying on top of the latest tech trends
Medical insurance: Saltus private medical insurance
Top quality equipment: Aside from an Apple MacBook, you’ll get the gear you need to thrive in your role
Dogs in the workplace: We are an animal-friendly bunch and welcome dogs in the office
benefits :
private medical care
sharing the costs of foreign language classes
sharing the costs of professional training & courses
