Informacje o stanowisku

As a Data Engineer with Scala, your mission will be to develop, test and deploy the technical and functional specifications from the Solution Designers / Business Architects / Business Analysts, guaranteeing the correct operability and compliance with the internal quality levels. Our Client is focusing on developing a DataHub.

Your skills

• At least 3-4 years of experience in programming
• Including at least 2 years of experience in Spark with Scala
• Experience in working with Big Data - Spark, Hadoop, Hive
• Experience with different database structures (Postgres, SQL, Hive)
• Continuous Integration (Git, GitHub, Jenkins)
• Practical knowledge of Agile processes & tooling: Jira, Confluence, Kanban, Scrum etc.
• Fluent English is a must (both written and spoken)

Nice to have

• Azure Databrics
• CI/CD: Jenkins, Github Actions
• Orchestration: Control-M, Airflow
• Python, Bash scripting
• Management and automation of IT processes with the ControlM tool
• Software development life cycle
• Basics of cybersecurity & Quality (SonarQube and related tools)
• Basics of Cloud computing (Docker, Kubernetes, OS3, Azure, AWS)

As a Data Engineer with Scala, your mission will be to develop, test and deploy the technical and functional specifications from the Solution Designers / Business Architects / Business Analysts, guaranteeing the correct operability and compliance with the internal quality levels. Our Client is focusing on developing a DataHub.

,[You will develop end-to-end ETL processes with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc., You will use Scrum methodology, and be part of a high performance team, You will document your solutions in tools such as JIRA, Confluence, ALM, You will certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team delivery Requirements: Scala, Spark, SQL, Big data, Data management, english, Hadoop, Hive, Data engineering, Azure Databricks, Jenkins, GitHub Actions, Control-M, Airflow, Python, Bash, SonarQube, Docker, Kubernetes, AWS Additionally: International projects, Working in a highly experienced team, On-line training and certifications, On-line foreign languages lessons, Access to e-learning platform, Friendly atmosphere, Sport subscription, Private healthcare, Lunch card, Trainings, Integration events, Free coffee, Canteen, Playroom, Free beverages, Modern office, Bike parking, Free parking, In-house trainings, In-house hack days.

Praca Warszawa

Warszawa - Oferty pracy w okolicznych lokalizacjach