Join our team where you can participate delivering data driven solutions based on Medallion data design pattern.
Introducing Medallion Architecture, with its Raw, Silver, and Gold layers, we expect to extend existing toolset for data management, increase flexibility and governance as well as reduce complexity of organizing and processing data across organization.
Our solution will be delivered as a self-service framework to various teams owning data sources.
We are working in fully AWS cloud environment, using latest services to build our framework and platform solutions from Proof of Concept to Production usage stage.
By joining our team, you will be playing a vital role in changing mindset for data management approach
responsibilities :
Implement and maintain components of our Medallion Architecture–based framework
Collaborate with senior engineers and other development teams to achieve technical excellence
Contribute to the development and maintenance of CI/CD processes for deployment and testing
Support troubleshooting and resolution of technical issues in production environments
Stay updated on emerging trends and best practices in data engineering and apply them under guidance
Take ownership of smaller features or subsystems, with mentoring support from senior colleagues
requirements-expected :
Solid proficiency in programming languages – Java with Spring or Python
Experience with AWS cloud services and Big Data solutions, including DMS, Lambda functions, EventBridge, S3 tables, AWS Glue, Amazon ECS, Lake Formation, and Amazon MSK.
Familiarity with infrastructure as a code - Terraform
Experience working with data tools and standards: Spark, Iceberg, Kafka, Kafka Streams, Presidio (or its alternatives)
Understanding of relational (MySQL, Postgres, MS SQL) and NoSQL (DynamoDB, MongoDB) databases
Ability to collaborate effectively with cross-functional teams and contribute to solution delivery
Eagerness to learn new technologies and grow into more complex responsibilities