.
Data Engineer with Java Scala
  • Poznań
Data Engineer with Java Scala
Poznań, Poznań, Greater Poland Voivodeship, Polska
emagine Polska
6. 2. 2024
Informacje o stanowisku

Industry:  Ship supply/ eCommerce.

Work model: Remote + 2-3 days per month in the Warsaw office

Contract: 12 months + extension

Rate: up to 200 PLN/h on B2B contract

Recruitment process: 1 or 2 stages (online meetings)

 

PROJECT:

You will be working on a global marketplace that connects buyers and suppliers empowering trade through reduced costs and increased convenience. 

 

Tech stack: Microsoft Azure, Airflow, Scala, Docker, Kubernetes, CI/CD pipelines (Azure DevOps), Azure Storage, Azure Databricks, Terraform.



TASKS & RESPONSIBILITIES:

  • Designing, delivering, and maintaining ETL and data pipeline solutions 
  • Drive the integration of customers systems and data with the company’s platform, ensuring to deliver a high-quality product 
  • Influencing technologies and solutions.
  • Assuring CI/CD pipelines.
  • Testing created solutions.

 

 

SKILLS:

  • 4+ years of experience as a Data Engineer/Data Developer or in a Software engineering role with focus on data
  • Experience with at least one JVM, object-oriented or functional/scripting language – i.e. Scala, Java .
  • Understand coding best practices.
  • Experience in writing automated unit tests.
  • Hands-on with GIT.
  • Experience working with relational data sets using SQL .
  • DevOps and CI/CD focus.
  • Big data: Spark, Databricks, and Hadoop
  • Experience building, and optimizing data pipelines, and architectures.
  • Agile mindset.
  • Relevant education in Computer Science, Engineering, Mathematics, Economics, Information Management, or Statistics.

 

 

It’s a plus if you have worked with:

  • Python
  • Azure, AWS or other cloud providers
  • Data pipeline and workflow tools: Airflow, ADF, Luigi, etc.
  • Infrastructure: Docker, Kubernetes, and Helm; we’re using Airflow running on Kubernetes
  • Stream-processing systems: Kafka and Spark Streaming



WE OFFER:

  • Challenging international projects in a Scandinavian business culture
  • Long-term cooperation
  • Flexible working hours
  • Co-financed benefits: Medicover card, Multisport card
  • Internal reference bonus

  • Praca Poznań
  • Poznań - Oferty pracy w okolicznych lokalizacjach


    163 629
    23 889