.
Data Engineer (Databricks)
  • Warsaw
Data Engineer (Databricks)
Warszawa, Warsaw, Masovian Voivodeship, Polska
BitPeak Sp. z o.o.
14. 12. 2024
Informacje o stanowisku

technologies-expected :


  • Microsoft Azure
  • SQL
  • Hadoop
  • Kafka
  • Apache Hive
  • Databricks

about-project :


  • The person in this role will work with project teams developing a modern data platform in a cloud environment for global brands. They will work in an international environment, specializing in BI & Big Data cloud architecture and the latest technologies in that area, and promote the principles of the DataOps manifesto.

responsibilities :


  • Design, build, and optimize scalable data pipelines in Databricks platform using SQL/Python/Spark
  • Developing existing projects in the Microsoft Azure environment to gain valuable insights for the business
  • Ensuring that data is modelled and processed according to the architecture and both functional and non-functional requirements
  • Planning and implementing processing pipelines for structured and unstructured data (e.g. video and images)
  • Working to automate and optimize internal processes in Azure
  • Collaborating with cross-functional and international teams both internally and externally

requirements-expected :


  • Minimum 3 years experience working with Databricks platform (Delta Lake, Workflows/Jobs, DLT, Unity Catalog)
  • Strong experience with programming in Python
  • Solid understanding of SQL and relational databases
  • Knowledge of Data Warehouse, Business Intelligence and ETL/ELT data processing
  • Familiarity with Medallion Architecture
  • Very good knowledge of English (particular emphasis on written English)
  • Proactive approach to tasks, problem-solving attitude and critical thinking skills
  • Flexibility, independence and responsibility for assigned tasks
  • A constant desire to improve your skills and learn new technologies
  • Knowledge of Azure cloud components for data storage and processing: Azure Data Lake Storage, Azure Event Hubs, Azure Data Factory, SQL Database, Synapse, Fabric
  • Experience with other big data technologies such as Hadoop, Hive, Kafka, and Flink would be an asset

offered :


  • Global projects in clouds — we work with clients from all over the world based on modern cloud technologies
  • Certification reimbursement — we fund exams, certifications from Microsoft, AWS, Databricks, Snowflake
  • Time to learn — 60 paid hours per year
  • Flexible approach — you can choose to work from home or meet at our offices
  • Personalized benefits — medical care, subsidized sports packages, language tuition, new employee referral bonus (up to PLN 15,000) as well as annual and media bonus

benefits :


  • sharing the costs of sports activities
  • private medical care
  • sharing the costs of foreign language classes
  • sharing the costs of professional training & courses
  • flexible working time
  • integration events
  • no dress code
  • leisure zone
  • employee referral program
  • charity initiatives
  • Learning Time

  • Praca Warszawa
  • Warszawa - Oferty pracy w okolicznych lokalizacjach


    94 936
    15 467