Informacje o stanowisku
Senior Data Engineer:
- Experienced in Scala, Python or Java and Unix/Linux environment on-premises
- Experience with developing RESTful APIs using Java Spring Boot
- Hands-on experience building data pipelines using Hadoop components (Apache Hadoop, Scala, Apache Spark, YARN, Hive, SQL)
- Experience optimizing Spark jobs Experience with time-series/analytics dbs such as Elasticsearch Experience with industry standard version control tools (Git, GitHub) and automated deployment tools (Ansible & Jenkins)Basic shell-scripting knowledge
- Understanding of big data modelling techniques using relational and non-relational techniques
- Needs to be a Self-starter, proactive and with a team focused attitude
- Willingness to learn and quick to adapt to changing requirements
- Experience and understanding of SDLC (Software Development Lifecycle)
- Good to have: Create/Update/Maintain shared Jenkins library
- Understanding or experience of Cloud design patterns Great communication skills
Big Data Engineer (Hadoop)
- Experience in Python, pySpark and Unix/Linux environment on-premises
- Hands-on experience building data pipelines using Hadoop components (Apache Hadoop, Apache Spark, YARN, Hive, SQL)
- Experience with industry standard version control tools (Git, GitHub) and automated deployment tools (Ansible & Jenkins)
- Experience optimizing Spark jobs
- Basic shell-scripting knowledge
- Understanding of big data modelling techniques using relational and non-relational techniques
- Needs to be a Self-starter, proactive and with a team focused attitude.
- Willingness to learn and quick to adapt to changing requirements.
- Experience and understanding of SDLC (Software Development Lifecycle)
- Ability to work with business users and the team stakeholders such as project managers and architects.
- Excellent data analysis skills with experience dealing with large and complex data sets.
- Good knowledge of Structured Query Language (SQL)
- Highly analytical with excellent attention to detail.
- Experienced in analysing business requirements and turning them into effective functional solutions.
- Excellent communication, both written and spoken (in English).
- Demonstrable track record of delivery.
- Strong interpersonal skills and ability to both lead and contribute within a small team.
Nice To Have:
- Experience with time-series/analytics dbs such as Elasticsearch
- Experience in Scala
- Experience with developing RESTful APIs using Java Spring Boot
- Familiar with Cloud technology components (preferred: GCP)
,[ Requirements: Scala, REST API, Spring Boot, Data pipelines, Spark, Yarn, Hive, SQL, Elasticsearch, Git, GitHub, Ansible, Data modelling, Hadoop, SDLC, Jenkins, Design Patterns, Communication skills, Data analysis, GCP
Praca KrakówKraków - Oferty pracy w okolicznych lokalizacjach