94 438
12 245
Correct Context is looking for a Scala/Spark Big Data Developer for Comscore in Poland and around. Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. Comscore leads in measuring and analyzing audiences across diverse digital platforms. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors. Real big data projects (PB scale) ~ An international team (US, PL, IE, CL) ~ Flexible work time ⏰~ Fully remote or in-office work in Wroclaw, Poland ~14,000 - 20,000 PLN net/month B2B ~ Private healthcare (PL) ~ As a Big Data Developer, youll: Design, implement, and maintain petabyte-scale Big data pipelines using Scala, Spark, Kubernetes and a lot of other tech Optimize – working with Big data is very specific, sometimes it’s IO/CPU-bound, depending on the process, we need to figure out a faster way of doing things. At least empirical knowledge of calculation complexity, as in Big data, even simple operations, when you multiply by the size of the dataset can be costly Writing great and performant Big Data Scala code Cooperate with other Big data teams Work with technologies like AWS, Kubernetes, Airflow, EMR, Hadoop, Linux/Ubuntu, Kafka, and Spark 2+ years of experience with Linux ~ Solid knowledge of Linux (bash, threads, IPC, filesystems; being power-user is strongly desired, understanding how OS works so you can benefit from performance optimizations in production but also in daily workflows)~1+ years of experience with Spark, primarily using Scala for Big data processing (that includes understanding of how Spark works and why)~ Huge need to drive projects of the future, improve stuff, risk taking mindset - covered by examples ~ Great communication skills (you can drive end-to-end projects, and guide dev team members)~ Professional working proficiency in English (both oral and written)~ Good software debugging skills, not only prints, but also using debugger ~ Deep understanding of at least one technical area (please let us know which one is this and prepare a story of the biggest battle story about this you had)~ If you dont have all the qualifications, but youre interested in what we do and you have a solid Linux understanding - lets talk! The recruitment process for the Scale/Spark Big Data Developer position has following steps: # Technical survey - 10min # Technical screening - 30 min video call # Technical interview - 60min video call # Technical/Managerial interview- 60 min video call # Final Interview - Technical/Managerial - 30 min video call