.
Datalake Expert
  • Warsaw
Datalake Expert
Warszawa, Warsaw, Masovian Voivodeship, Polska
7N Sp. z o.o.
18. 12. 2024
Informacje o stanowisku

Datalake Expert

Miejsce pracy: Warszawa

Technologies we use

Expected

  • SQL
  • Terraform
  • Python
  • AWS

Optional

  • Airflow
  • Azkaban
  • Docker
  • Kubernetes
  • Java
  • Scala
  • Kotlin
  • Kafka

About the project

For our client, a leading US financial services company, we are ooking for a Datalake Expert.

The Data Team is responsible for designing, building, deploying, and maintaining a web-scale, cloud-native data platform.

The company works in tribes and squads that focus on specific products and projects – and depending on their strengths and interests, team members have the opportunity to move between them, joining an agile team that fosters collaboration and innovation.

Location: 100% remote work possible; however, candidates who can work hybrid from the Warsaw office are preferred.

Your responsibilities

  • Executes standard software solutions, design, development, and technical troubleshooting
  • Writes secure and high-quality code using the syntax of at least one programming language with limited guidance
  • Designs, develops, codes, and troubleshoots with consideration of upstream and downstream systems and technical implications
  • Applies knowledge of tools within the Software Development Life Cycle toolchain to improve the value realized by automation
  • Applies technical troubleshooting to break down solutions and solve technical problems of basic complexity
  • Gathers, analyzes, and draws conclusions from large, diverse data sets to identify problems and contribute to decision-making in service of secure, stable application development
  • Learns and applies system processes, methodologies, and skills for the development of secure, stable code and systems
  • Adds to team culture of diversity, equity, inclusion, and respect

Our requirements

  • At least 5+ years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer considered)
  • Understanding of distributed systems and cloud technologies (perfectly AWS)
  • Understanding of data streaming and scalable data processing frameworks (Kafka, Spark Structured Streaming, Flink, Beam etc.)
  • Experience with SQL (any dialect) and Data tools
  • Experience in the all stages of software development lifecycle (requirements, design, architecture, development, testing, deployment, release and support)
  • Experience with large scale datasets , data lake and data warehouse technologies on at least TB scale (ideally PB scale of datasets) with at least one of {BigQuery, Redshift, Snowflake}
  • Experience in Infrastructure as Code (ideally Terraform) for Cloud based data infrastructure
  • Excellent knowledge of Python
  • Excellent written and verbal communication skills in English

Optional

  • Experience with a scheduling system (Airflow, Azkaban, etc.)
  • Understanding of (distributed and non-distributed) data structures, caching concepts, CAP theorem
  • Understanding of security frameworks / standards and privacy
  • Desired – experience in automating deployment, releases and testing in continuous integration, continuous delivery pipelines
  • A solid approach to writing unit level tests using mocking frameworks, as well as automating component, integration and end-to-end tests
  • Experience with containers and container-based deployment environment (Docker, Kubernetes, etc.)
  • Good experience with using a JVM language (Java/Scala/Kotlin, preferably Java 8+)

This is how we organize our work

This is how we work

  • at the clients site
  • you focus on product development
  • scrum

Development opportunities we offer

  • assistance in preparation to public speeches
  • conferences abroad
  • conferences in Poland
  • development budget
  • external training
  • industry-specific e-learning platforms
  • intracompany training
  • mentoring
  • soft skills training
  • substantive support from technological leaders
  • support of IT events
  • technical knowledge exchange within the company

What we offer

  • Financial transparency: the salary is: 28 560 - 35 280 PLN (170 - 210 PLN/h) + VAT​
  • Clear wage model. 7N Consultants know exactly what’s 7N fee for its agent role on the project
  • Professional development support. We subsidize trainings, technical certificates, conference participation, and foreign language classes. Additionally, 7N Consultants have opportunities to take part in internal training sessions and develop their interpersonal skills within the framework of the 7N Secret Code
  • Access to e-learning platforms: internal – 7N Academy with recordings of technical trainings (e.g. AWS, Azure, AI, DevOps, Data Science, etc.), inspiring webinars (e.g. healthy eating, personal finance, language learning, etc.), and external platforms: Coursea, Mentorix
  • Cloud Path - a development program that includes online trainings on AWS and Azure, ending in a certification exam. Each participant receives access to e-learning platforms: Microsoft ESI, Google Cloud Platform
  • An opportunity to join 7N Inspiration Team - a group of 7N Consultants who consistently and actively share their professional knowledge and expertise
  • Career Development Program – a mentoring program that includes exploring your individual predispositions and preferences for career paths; providing insight into the latest trends and valuable positions in the IT industry. Participants meet with Career Agents and/or 7N Mentors
  • Cooperation with real experts – the average professional experience of a 7N consultant is 10 years
  • Comprehensive and personal project support from one of a 7N Agent. Priority regarding project continuity and quality
  • Numerous (10-12 each year) high-end events – both online and offline
  • Healthcare, Benefit Multisport and life insurance subsidies regardless of cooperation model. Access to Mindgram, a psychological support and professional development platform
  • Professional and quality-oriented recruitment process led by the most experienced recruiters in the industry

Benefits

  • sharing the costs of sports activities
  • private medical care
  • sharing the costs of foreign language classes
  • sharing the costs of professional training & courses
  • life insurance
  • integration events
  • employee referral program
  • access to internal trainings – 7N Academy
  • Cloud Path – cloud development program
  • access to external e-learning platforms
  • Microsoft ESI
  • Google Cloud Platform
  • Coursea
  • Mentorix
  • career development program
  • technical training
  • inspirational training
  • numerous high-end events
  • access to the Mindgram platform
  • 7N Inspiration Team

7N Sp. z o.o.

7N provides top-notch care to the best IT experts. The relationship with our consultants is based on professionalism, mutual respect, and transparent financial conditions.

While working with us, you can expect the support of a dedicated agent who will support you in your career development, personal growth, and entertainment aspects. In this way, you can focus on the things that you care about the most in your life.

We work with 1600 consultants and 160 clients worldwide. You can find us in 14 offices in 7 countries: Denmark, Poland, Sweden, Norway, Finland, USA, and India.

We are a Danish IT consulting company with over 30 years of experience. Our expertise focuses on helping our clients in all aspects of IT projects in the public and private sectors.

We aim to work with the top 3% of IT professionals, keeping up with the Scandinavian standards.

In Poland, we work with more than 1000 consultants in 3 cities: Warsaw, Gdańsk, and Wrocław.

Klikając w przycisk „Aplikuj” lub w inny sposób wysyłając zgłoszenie rekrutacyjne, zgadzasz się na przetwarzanie Twoich danych osobowych przez 7N Sp. z o.o. z siedzibą w: Puławska 182, 02-670 Warszawa (Pracodawca), jako administratora danych osobowych w celu przeprowadzenia rekrutacji na stanowisko wskazane w ogłoszeniu.
Twoje dane osobowe będą przetwarzane w oparciu o następujące podstawy prawne: (a) aby podjąć działania na Twoje żądanie przed zawarciem umowy (np. informacje o oczekiwanym wynagrodzeniu i dostępności do rozpoczęcia pracy); (b) w oparciu o nasz prawnie uzasadniony interes (np. imię, nazwisko, data urodzenia, dane kontaktowe, wykształcenie, kwalifikacje zawodowe, przebieg dotychczasowego zatrudnienia); c) w oparciu o Twoją zgodę, która wyrażona jest poprzez przeslanie dokumentów aplikacyjnych zawierających takie informacje jak np. wizerunek czy zainteresowania.
Podanie wszystkich danych osobowych, o których mowa powyżej jest dobrowolne, natomiast dane wymienione w lit. a) i b) są niezbędne do wzięcia udziału w rekrutacji. Niepodanie danych skutkuje brakiem możliwości rozpatrzenia kandydatury. Podanie pozostałych danych jest dobrowolne, ale może pomóc w sprawnym przeprowadzeniu procesu rekrutacji.
Masz prawo żądać dostępu do Twoich danych (w tym uzyskania ich kopii), sprostowania danych, ich usunięcia, ograniczenia przetwarzania, przeniesienia, jak również wniesienia sprzeciwu wobec ich przetwarzania. Masz także prawo wniesienia skargi do Prezesa Urzędu Ochrony Danych Osobowych.
Twoje dane osobowe mogą zostać przekazane dostawcom usługi publikacji ogłoszeń o pracę, dostawcom systemów do zarządzania rekrutacjami, dostawcom usług IT (hosting), dostawcom systemów informatycznych.
Podane przez Ciebie dane osobowe nie będą wykorzystywane w celu profilowania albo podejmowania decyzji w sposób zautomatyzowany.
Twoje dane osobowe będą przetwarzane przez okres maks. 1 roku od zakończenia publikacji ogłoszenia, chyba, że wyraziłeś odrębną zgodę na wykorzystanie Twoich danych osobowych w przyszłych rekrutacjach.
W celu realizacji praw lub w przypadku jakichkolwiek pytań związanych z przetwarzaniem Twoich danych osobowych skontaktuj się z nami pod adresem: migol@7n.com.

  • Praca Warszawa
  • Warszawa - Oferty pracy w okolicznych lokalizacjach


    74 319
    12 613