We are looking for a talented Scala/Spark/Hadoop/Big Data Developer to help deliver a cutting-edge global reporting solution.
As part of a large financial institution, we are undergoing a major transformation in our technology stack. We are developing a new customer account reporting engine that will replace legacy reporting solutions across various markets. The project involves consolidating all customer account and payment transaction data into Hadoop, requiring integration with numerous data formats and systems. The goal is to deliver reports to millions of customers, processing billions of transactions each month.
responsibilities :
Design and implement a high-performance, flexible, scalable, and easily maintainable global reporting solution.
Collaborate closely with Product Owners, Solution Architects, Analysts, Testers, and Developers.
Work in an Agile environment, applying the SAFe framework.
Manage complex data integrations and ensure seamless performance with Spark and Hadoop-based technologies.
requirements-expected :
3+ years of hands-on experience with Scala and functional programming.
Proven expertise in writing Spark-based applications in Scala.
Familiarity with the Hadoop technology stack (Hive, Oozie, Kafka).
Experience with containerized technologies like Docker and Kubernetes.
