Informacje o stanowisku

technologies-expected :

• Databricks
• Python
• Terraform
• Microsoft Azure

• Azure Databricks

• Design and implement infrastructure to host and manage up to 1,500 ML scoring processes within Databricks environment.
• Operationalize ML scoring pipelines with scalable, secure, and monitored infrastructure.
• Ensure integration with AI and BI tools and optimized data pipelines.
• Enable rapid scaling of AI capabilities.

• Set up Databricks clusters, jobs, and workflows for ML scoring use cases.
• Implement scalable infrastructure capable of running thousands of ML scoring tasks.
• Develop deployment processes for ML models using Databricks MLflow or equivalent.
• Build frameworks to orchestrate scoring of >1,500 ML models or scoring jobs.
• Integrate logging, alerting, and dashboards to monitor scoring throughput.
• Work alongside Dev Ops Engineers to automate provisioning and deployments.
• Define operational SLAs for scoring workloads.
• Ensure role-based access control and credential management.
• Implement policies for secure handling of model artifacts and scoring data.

• Azure knowledge.
• Experience with Databricks, MLflow, Jobs, Workflows, Delta Lake.
• MLOps skills.
• Python knowledge for workflow scripting.
• Terraform skills for Infrastructure as Code.
• Proven ML Ops experience in production ML environments.
• Experience in CI/CD pipelines for ML model deployment (e.g., Azure DevOps, GitHub Actions).
• Proficiency with monitoring tools (e.g., Datadog, Prometheus, Grafana).
• Knowledge of model lifecycle management, versioning, and reproducibility.
• Understanding of Infrastructure as Code and cloud environment automation.Knowledge of model lifecycle management, versioning, and reproducibility.
• English Level: B2
• Hybrid work from clients office in Warsaw/Poznań/Lublin

Lublin - Oferty pracy w okolicznych lokalizacjach