.
Senior Data Engineer || Big Data Engineer @ DCV Global Recruitment
  • Kraków
Senior Data Engineer || Big Data Engineer @ DCV Global Recruitment
Kraków, Kraków, Lesser Poland Voivodeship, Polska
DCV Global Recruitment
10. 5. 2024
Informacje o stanowisku


Senior Data Engineer:

  • Experienced in Scala, Python or Java and Unix/Linux environment on-premises
  • Experience with developing RESTful APIs using Java Spring Boot
  • Hands-on experience building data pipelines using Hadoop components (Apache Hadoop, Scala, Apache Spark, YARN, Hive, SQL)
  • Experience optimizing Spark jobs Experience with time-series/analytics dbs such as Elasticsearch Experience with industry standard version control tools (Git, GitHub) and automated deployment tools (Ansible & Jenkins)Basic shell-scripting knowledge
  • Understanding of big data modelling techniques using relational and non-relational techniques
  • Needs to be a Self-starter, proactive and with a team focused attitude
  • Willingness to learn and quick to adapt to changing requirements
  • Experience and understanding of SDLC (Software Development Lifecycle)
  • Good to have: Create/Update/Maintain shared Jenkins library
  • Understanding or experience of Cloud design patterns Great communication skills

Big Data Engineer (Hadoop)

  • Experience in Python, pySpark and Unix/Linux environment on-premises
  • Hands-on experience building data pipelines using Hadoop components (Apache Hadoop, Apache Spark, YARN, Hive, SQL)
  • Experience with industry standard version control tools (Git, GitHub) and automated deployment tools (Ansible & Jenkins)
  • Experience optimizing Spark jobs
  • Basic shell-scripting knowledge
  • Understanding of big data modelling techniques using relational and non-relational techniques
  • Needs to be a Self-starter, proactive and with a team focused attitude.
  • Willingness to learn and quick to adapt to changing requirements.
  • Experience and understanding of SDLC (Software Development Lifecycle)
  • Ability to work with business users and the team stakeholders such as project managers and architects.
  • Excellent data analysis skills with experience dealing with large and complex data sets.
  • Good knowledge of Structured Query Language (SQL)
  • Highly analytical with excellent attention to detail.
  • Experienced in analysing business requirements and turning them into effective functional solutions.
  • Excellent communication, both written and spoken (in English).
  • Demonstrable track record of delivery.
  • Strong interpersonal skills and ability to both lead and contribute within a small team.

Nice To Have:

  • Experience with time-series/analytics dbs such as Elasticsearch
  • Experience in Scala
  • Experience with developing RESTful APIs using Java Spring Boot
  • Familiar with Cloud technology components (preferred: GCP)
,[ Requirements: Scala, REST API, Spring Boot, Data pipelines, Spark, Yarn, Hive, SQL, Elasticsearch, Git, GitHub, Ansible, Data modelling, Hadoop, SDLC, Jenkins, Design Patterns, Communication skills, Data analysis, GCP

  • Praca Kraków
  • Kraków - Oferty pracy w okolicznych lokalizacjach


    111 631
    18 246