Senior Big Data Engineer ( Scala / Python ) - Data&AI
Poznań
Senior Big Data Engineer ( Scala / Python ) - Data&AI
Poznań, Poznań, Greater Poland Voivodeship, Polska
Allegro
25. 4. 2024
Informacje o stanowisku
technologies-expected :
Scala
Python
Java
AWS
Google Cloud Platform
Microsoft Azure
Apache Spark
about-project :
The salary range for this position is (contract of employment):
mid: 14 200 - 19 690 PLN in gross terms
senior: 18 400 - 25 410 PLN in gross terms
A hybrid work model that incorporates solutions developed by the leader and the team
responsibilities :
As part of the Data & AI area, we implement projects based on the practical "data science" and "artificial intelligence" applications of an unprecedented scale in Poland. Data & AI is a group of over 150 experienced BigData engineers organized into over a dozen teams with various specializations. Some of them build dedicated tools for creating and launching BigData processes or implementing ML models for the entire organization. Others work closer to the client and are responsible for the implementation of the search engine, creating recommendations, building a buyer profile or developing an experimental platform. There are also research teams in the area whose aim is to find solutions to non-trivial problems requiring the use of machine learning.
We are looking for BigData engineers who want to build a highly scalable and fault-tolerant data ingestion for millions of Allegro customers. The platform collects 5 billion clickstream events every day (up to 150k / sec) from all Allegro sites and Allegro mobile applications. This is a hybrid solution using a mix on-premise and Google Cloud Platform (GCP) services like Spark, Kafka, Beam, BigQuery, Pubsub or Dataflow.
requirements-expected :
Are programming in languages such as Scala, Python or Java
Strong understanding of distributed systems, data storage, and processing framework - Spark.
Have knowledge of GCP (especially Composer) or other public cloud environments like Azure or AWS
Use good practices (clean code, code review, TDD, CI/CD)
Navigate efficiently within Unix/Linux systems
Possess a positive attitude and team-working skills
Are eager for personal development and keeping their knowledge up to date
Know English at B2 level
offered :
Possibility to learn and work with backend (Spring, Kotlin), frontend (angular) and AI technologies within the team.
A hybrid work model that you will agree on with your leader and the team. We have well-located offices (with fully equipped kitchens and bicycle parking facilities) and excellent working tools (height-adjustable desks, interactive conference rooms)
Annual bonus up to 10% of the annual salary gross (depending on your annual assessment and the companys results)
A wide selection of fringe benefits in a cafeteria plan – you choose what you like (e.g. medical, sports or lunch packages, insurance, purchase vouchers)
English classes that we pay for related to the specific nature of your job
A 16" or 14" MacBook Pro with M1 processor and, 32GB RAM or a corresponding Dell with Windows (if you don’t like Macs) and other gadgets that you may need
Working in a team you can always count on — we have on board top-class specialists and experts in their areas of expertise
A high degree of autonomy in terms of organizing your team’s work; we encourage you to develop continuously and try out new things
Wide range of internal and external trainings and time to participate, hackathons, team tourism, training budget and an internal educational platform, MindUp (including training courses on work organization, means of communications, motivation to work and various technologies and subject-matter issues)
If you want to learn more, check it out https://jobs.allegro.eu/benefits/
benefits :
sharing the costs of sports activities
private medical care
sharing the costs of foreign language classes
sharing the costs of professional training & courses