Informacje o stanowisku

Overview

As a Backend Spark developer, your mission will be to develop, test and deploy the technical and functional specifications from the Solution Designers / Business Architects / Business Analysts, guaranteeing the correct operability and the compliance with the internal quality levels.

Responsibilities

• You will develop end-to-end ETL processes with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc.


• You will use Scrum methodology, and be part of a high performance team


• You will document your solutions in the Group Santander tools: JIRA, Confluence, ALM…


• You will certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team delivery

Qualifications

Required qualifications

• At least 2 years of experience working with Spark and Scala.


• Knowledge of good practices in writing code: clean code, software design patterns, functional style of writing code, TDD.


• At least 2 years of experience working with Spark with Scala, software design patterns, and TDD.


• Experience in working with big data – Spark, Hadoop, Hive. Knowledge of Azure Databricks is considered as a plus.


• Agile approach for software development


• Experience and expertise across data integration and data management with high data volumes.


• Experiencie working in agile continuous integration/DevOps paradigm and tool set (Git, GitHub, Jenkins, Sonar, Nexus, Jira)


• Experience with different database structures, including (Postgres, SQL, Hive)


• English (at least B2+)

Preferred qualifications

• CI/CD: Jenkins, GitHub Actions


• Orchestration: Control-M, Airflow


• Scripting: Bash, Python


• Software development life cycle (HP ALM,..)


• Basics of cybersecurity & Quality (Sonar, Fortify…)


• Basics of Cloud computing (Docker, Kubernetes, OS3, Azure, AWS)

Warszawa - Oferty pracy w okolicznych lokalizacjach