As a Senior Test Engineer, you will be responsible for ensuring the quality, reliability, and performance of large-scale Data & AI solutions.
You will design and develop automated testing frameworks for complex data pipelines and distributed systems, perform regression and performance testing, and implement data quality validation within Azure-based environments.
You will work closely with Data Engineers and DevOps teams to integrate testing into CI/CD pipelines, ensuring high standards of data governance, security, and compliance.
Additionally, you will define testing strategies, best practices, and documentation for modern Data & AI platforms.
responsibilities :
Design and develop automated testing frameworks for complex data pipelines and distributed systems.
Perform regression and performance testing.
Implement data quality validation within Azure-based environments.
Work closely with Data Engineers and DevOps teams to integrate testing into CI/CD pipelines.
Define testing strategies, best practices, and documentation for modern Data & AI platforms.
requirements-expected :
Strong expertise in Python, PySpark, SQL, and test automation frameworks.
Experience with Azure Data Services (Databricks, Data Factory, Storage Accounts).
Proven experience in testing big data pipelines, distributed systems, and ETL workflows.
Hands-on experience with CI/CD tools (Azure DevOps, Jenkins) and automated testing integration.
Solid understanding of data governance, data quality frameworks, and monitoring tools.
