.
Web Scraping Engineer
  • Warsaw
Web Scraping Engineer
Warszawa, Warsaw, Masovian Voivodeship, Polska
HEADFOUND GmbH
15. 3. 2025
Informacje o stanowisku

technologies-expected :


  • Python
  • Kubernetes
  • BeautifulSoup
  • Scrapy
  • SQL
  • MongoDB

technologies-optional :


  • Azure Cloud
  • IP Rotation services
  • Microsoft Power BI

about-project :


  • Develop cutting-edge data extraction tools for the recruiting industry.

responsibilities :


  • Develop & Maintain: Design, implement, and scale web scrapers to extract recruiting data from online platforms.
  • Containerization & Orchestration: Build and manage containerized applications in a Kubernetes environment.
  • Monitoring & Optimization: Develop dashboards to track scraper performance and data reliability.
  • IP Rotation & Stability: Utilize and optimize IP rotation techniques to ensure robust data extraction.
  • Data Storage & Integration: Efficiently store, structure, and process scraped data using SQL and MongoDB for seamless integration across systems.
  • Independent Collaboration: Work closely with external teams and stakeholders, integrating solutions seamlessly across different systems.
  • Documentation & Knowledge Sharing: Clearly document processes, code, and system architectures for transparency and efficiency.

requirements-expected :


  • Python: Strong proficiency in writing efficient, clean, and scalable code.
  • Kubernetes: Hands-on experience with container orchestration and deployment.
  • Web Scraping: Expertise in frameworks like BeautifulSoup or Scrapy for recruiting data extraction.
  • SQL & MongoDB: Experience working with relational (SQL) and NoSQL (MongoDB) databases to store and process extracted data.
  • Self-Sufficiency: Ability to work independently and drive projects forward with minimal supervision.
  • Collaboration: Experience working with external teams, integrating solutions, and managing stakeholder expectations.

offered :


  • A flexible, independent work environment with the freedom to shape your own workflows.
  • Exciting projects in recruiting technology, working with innovative external teams.
  • Opportunities for continuous learning and professional growth.
  • Competitive compensation based on expertise and project scope.
  • The position is available in both full-time and part-time, offering flexibility to match your preferences and availability.

benefits :


  • private medical care
  • remote work opportunities
  • Multisport card

  • Praca Warszawa
  • Warszawa - Oferty pracy w okolicznych lokalizacjach


    89 125
    9 748