.
Principal Data Engineer
  • Kraków
Principal Data Engineer
Kraków, Kraków, Lesser Poland Voivodeship, Polska
SOFTWARE MIND
5. 11. 2024
Informacje o stanowisku

technologies-expected :


  • AWS
  • RDBMS
  • SQL
  • Google Big Query
  • Snowflake
  • MemSQL
  • Apache Ignite
  • Redshift

about-project :


  • Our client provides global enterprises with a real-time Carbon Planning & Intelligence platform to power forward-looking emissions management, so they can close the gap between climate-related actions and intentions.
  • The right person for this role will be a highly, internally motivated, strong backend technical contributor with strong experience expertly balancing quality and time to market over short, medium, and long time horizons. It is important that you work fluidly through the whole lifecycle of delivering value and delight to our customers, from pain to medicine. How you prioritize and manage your focus is key. You have seen a wide range of problems and efficiently pattern match solutions, which you leverage to facilitate collaboration across both technical and non-technical audiences. Most of all, you’re interested in using your software engineering capabilities to make a foundational contribution to reversing climate change.

responsibilities :


  • Develop and maintain data architecture strategy
  • Own data warehouse – the backend of our B2B SaaS platform
  • Work directly with customers on data ingest and reporting requirements
  • Manage the process of data ingestion into data warehouse
  • Establish an enterprise ETL technical architecture for ingestion of all third party and customer data feeds
  • Perform data cataloging analytics on source data including data provided by clients and determine business rules for data ingestion
  • Write requirements for and then implement ETL and data pipelines including exception-handling protocols and processes
  • Perform continuous improvement of ETL processes
  • Build core datasets
  • Implement manual and automated data quality management
  • Define and uphold SLAs
  • Become a subject matter expert in travel and expense data
  • Collaborate with Software Development, Data Scientists, Product Management, and Customer Success
  • Democratize compliant and secure access to data through self-serve channels
  • Establish data governance policies and procedures
  • Monitor and troubleshoot data infrastructure issues
  • Manage the planning, implementation and testing of Continuity of Business and Disaster Recovery for data warehouse
  • Provide technical leadership and share knowledge, for instance, through code reviews, pairing, ADRs, and presentations

requirements-expected :


  • 5+ years of data architecture, data modeling, data warehousing concepts, methodologies, and best practices
  • Experience working directly with customers
  • Experience scaling and re-architecting data platforms and infrastructure through orders of magnitude of growth and scaling data volume
  • Experience working on data infrastructure-focused engineering teams building a data lake or data warehouse from scratch
  • Experience with state-of-the-art ETL tools, techniques and processes
  • Experience with AWS and cloud-based data services
  • RDBMS; SQL; query optimization; performance troubleshooting
  • Familiarity with DBT or SQLMesh
  • Familiarity with several data warehousing platforms like Google Big Query, Snowflake, MemSQL (SQL Store), Apache Ignite, Redshift, Databricks
  • 0 to 1 startup experience
  • Exceptional common sense and the ability to manage ambiguity

benefits :


  • sharing the costs of sports activities
  • private medical care
  • sharing the costs of foreign language classes
  • sharing the costs of professional training & courses
  • life insurance
  • remote work opportunities
  • flexible working time
  • integration events
  • corporate library
  • no dress code
  • video games at work
  • coffee / tea
  • drinks
  • parking space for employees
  • leisure zone
  • charity initiatives

  • Praca Kraków
  • Kraków - Oferty pracy w okolicznych lokalizacjach


    109 179
    17 765