112 795
20 210
Join our team as a Big Data Engineer and bring your 5 years of Spark and Scala expertise to build cutting-edge solutions in an Agile and DevOps environment Roles & Responsibilities: To develop end-to-end ETL process with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc… To use Scrum methodology, and be part of a high-performance team To document your solutions in the project partner tools: JIRA, Confluence, ALM. To certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team's delivery Requirement:- More than 5 years of experience with Spark with Scala, software design patterns, and TDD Experience working with big data – Spark, Hadoop, Hive is a must – Azure Databricks be a plus Agile approach for software development Experience and expertise across data integration and data management with high data volumes Experience working in Agile Continuous integration/DevOps paradigm and tool set (Git, GitHub, Jenkins, Sonar, Nexus, Jira) Experience with different database structures, including (Postgres, SQL, Hive) English (at least B2)