Informacje o stanowisku

Opis stanowiska
Project Background
SAS UK’s BigData platform is the largest in scope, hosting 5+ PiB of data and 250,000+ SAS programs. It supports critical finance and compliance workloads. Due to high complexity and delays, a dedicated Engineering POD is required to accelerate delivery.
Scope -
File rationalization and conversion (Parquet, Altair WPD) -
Partitioning and loading large datasets (Hive, Teradata, PostgreSQL) -
Development and validation of migration pipelines -
Setup of parallel run and production environments with data sync
Key Responsibilities -
Define and lead the end-to-end testing strategy for BigData / SAS SPDE migration -
Design and execute tests for data conversion and pipeline validation -
Coordinate with engineering teams and manage defect lifecycle -
Collaborate with stakeholders (tenants, ITSOs, architecture, network, vendors) -
Support user onboarding and training
Location: Krakow preferred (other cities can be consider as well, however candidate has to be ready to travel to client's office in Krakow min once a month)
Wymagania stanowiska
Required Skills -
Expertise in BigData and data platform testing -
Strong knowledge of: -
OS: Linux, shell scripting -
Storage: Hadoop/HDFS, S3/VAST, Teradata, PostgreSQL -
Formats: Avro, ORC, Parquet (SPDE a plus) -
Table Formats: Delta, Iceberg -
Engines: Hive, Spark (Starburst/Databricks a plus) -
Languages: SAS, Python -
Automation: large-scale data pipelines -
Other: DML, partitioning, Altair SLC -
Self-starter with strong communication skills, English C1
Nice to Have -
Experience with Altair tools and vendor coordination -
Familiarity with SAS Macros, DI, DI Studio, and stored processes

Kraków - Oferty pracy w okolicznych lokalizacjach