Scraping Engineer (Python, Selenium)

93_8697

Obowiązki

• Design, develop, and optimize web scraping pipelines using Python and Selenium
• Handle dynamic content, authentication flows, and anti-bot mechanisms with precision
• Ensure compliance with legal and ethical standards in data extraction
• Containerize scraping solutions using Docker and orchestrate deployments with Kubernetes
• Collaborate with cross-functional teams via Azure DevOps for CI/CD and agile delivery
• Monitor and maintain scraping jobs, ensuring high reliability and data accuracy
• Continuously improve scraping efficiency and adapt to changing website structures

Wymagania

• 3+ years of hands-on experience in Python and Selenium for web automation and scraping
• Strong understanding of HTML, CSS, JavaScript, and browser behavior
• Experience with Azure DevOps, Docker, and Kubernetes in production environments
• Familiarity with data storage formats (JSON, CSV) and databases (SQL, NoSQL)
• Fluent in English, with excellent communication and documentation skills
• Availability to work within European time zones

Źródło: 7n/Praca