Informacje o stanowisku

Overview

As a Backend Spark developer, your mission will be to develop, test and deploy the technical and functional specifications from the Solution Designers / Business Architects / Business Analysts, guaranteeing the correct operability and the compliance with the internal quality levels.

Responsibilities

• You will develop end-to-end ETL processes with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc.
• You will use Scrum methodology, and be part of a high performance team
• You will document your solutions in the Group Santander tools: JIRA, Confluence, ALM…
• You will certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team delivery

Required qualifications

• At least 2 years of experience working with Spark and Scala.
• Knowledge of good practices in writing code: clean code, software design patterns, functional style of writing code, TDD.
• At least 2 years of experience working with Spark with Scala, software design patterns, and TDD.
• Experience in working with big data – Spark, Hadoop, Hive. Knowledge of Azure Databricks is considered as a plus.
• Agile approach for software development
• Experience and expertise across data integration and data management with high data volumes.
• Experiencie working in agile continuous integration/DevOps paradigm and tool set (Git, GitHub, Jenkins, Sonar, Nexus, Jira)
• Experience with different database structures, including (Postgres, SQL, Hive)
• English (at least B2+)

Preferred qualifications

• CI/CD: Jenkins, GitHub Actions
• Orchestration: Control-M, Airflow
• Scripting: Bash, Python
• Software development life cycle (HP ALM,..)
• Basics of cybersecurity & Quality (Sonar, Fortify…)
• Basics of Cloud computing (Docker, Kubernetes, OS3, Azure, AWS)

Warszawa - Oferty pracy w okolicznych lokalizacjach