.
Data engineer with Python- Data Platforms & Services
  • Warsaw
Data engineer with Python- Data Platforms & Services
Warszawa, Warsaw, Masovian Voivodeship, Polska
BEC Poland
8. 6. 2024
Informacje o stanowisku

Data engineer with Python- Data Platforms & Services

Miejsce pracy: Warszawa

Technologies we use

Expected

  • Python
  • PySpark
  • PyTest
  • C
  • Linux

About the project

We are looking for a Data Engineer with Python skills to join our Data Delivery & Compliance team inside the Data & Cloud Domain. Our Team plays a key role as the raw data delivered (~8000 tables) is key to the whole BI/reporting ecosystems of our customers and other domains, including critical AML data.

The team consist of Data engineers and a Team Architect responsible of maintaining and building all the ETL systems to load raw data from the source (Mainframe IBM DB2) into the different EDW environments (IBM Netezza, Azure Cloud). We are supporting existing systems (Tech stack: Informatica, Netezza, PL/SQL, SQL, python) and building completely new ones, mostly in Python and PySpark. Our work is shared between Operations and Development.

We are looking for someone with a strong Python and Spark experience to help us build great apps.

Warning: the role is not 100% Python related, our Team is also responsible of the current stack (mainly Informatica, PL/SQL, Netezza).

You will be based in Warsaw and you will be working with teams across Denmark and Poland. All teams are organized as Agile teams with Product Owners and running Scrum.

Your responsibilities

  • Develop, test and maintain high-quality ETL systems using: PySpark, PyTest, GNU toolchain, SQL, Linux, GIT
  • Optimizing performance of loading data to DWH/DMs for big volume tables (100-200+ GB)
  • Identify corner cases logic and propose a solution to implement it
  • Contribute to code reviews and ensure that code is written to a high standard
  • Experience with parallel processing is a plus (our C programs are parallelized)
  • Eager to have a mentor role and coach other developers in the Team to upskill with Python and code quality

Our requirements

  • Bachelor or Masters Degree in software development, computer science, or similar
  • Minimum 5 years experience from a similar position working with at least 2 years specifically with Python and above-mentioned tools in your development tasks: PySpark, PyTest, C (Low level algorithms, data structures, memory management), GNU toolchain, Linux
  • Understand that a team member also participates in the creation of Features and User stories
  • English: Fluent

Optional

  • C (Low level algorithms, data structures, memory management)
  • Informatica Power Center
  • PL/SQL
  • Spark Databricks
  • Microsoft Azure

This is how we organize our work

This is how we work

  • in house
  • agile

Team members

  • big data developer

Development opportunities we offer

  • development budget
  • external training
  • intracompany training
  • mentoring
  • soft skills training
  • substantive support from technological leaders
  • support of IT events

What we offer

  • Flexible working hours
  • Mental health support
  • Free lunch at the office
  • Professional development
  • Referral bonus up to PLN 10,000
  • PLN 600 on a benefit platform a month
  • Passion clubs and social events (Tennis, salsa dancing, board games, family picnics and more!)

Benefits

  • sharing the costs of sports activities
  • private medical care
  • sharing the costs of foreign language classes
  • sharing the costs of professional training & courses
  • remote work opportunities
  • flexible working time
  • fruits
  • integration events
  • corporate gym
  • corporate sports team
  • no dress code
  • coffee / tea
  • leisure zone
  • extra social benefits
  • birthday celebration
  • employee referral program
  • family picnics

Recruitment stages

  • Send us your CV
  • Screening call
  • Meet our talent partner and technical expert
  • Meet your future manager and team
  • Time to sign the contract

MAKE US AWARE OF YOUR TALENT

We are an equal opportunities employer. We hire top talent regardless of race, religion, color, national origin, sexual orientation, gender identity, and age. We encourage all qualified candidates to apply. See our full list of vacancies at https://www.bec.dk/en/vacancies/

You can also learn more about BEC by browsing our company culture book: wearebec.pdf

BEC Poland

BEC is a financial technology company creating IT solutions for Danish banks. Together, we enable their customers to invest online, take out loans and transfer money. In other words, everything it takes to run a bank.

We have 1,700+ employees spread across five locations in Denmark and Poland. We collaborate in a flat hierarchy with a high degree of mutual trust. Here, great ideas have no rank, and we invite everybody to chip in to create the strongest banking solutions for Danish society.

  • Praca Warszawa
  • Warszawa - Oferty pracy w okolicznych lokalizacjach


    95 687
    16 851