Oxylabs

Experienced Web Scraping Engineer - Python (Remote)

Oxylabs
Apply
19 hours ago
Warsaw, PolandSenior

Responsibilities

  • Develop scalable web scrapers.
  • Define resilient scraping strategies and unblock websites for scraping.
  • Improve system observability.
  • Develop backend solutions for scraping and parsing problems of varying scale.
  • Maintain the existing system and develop new scraping and parsing features.

Requirements

  • Experience working with Python.
  • Understanding of data structures, algorithms, computability, and complexity.
  • Version control experience using Git.
  • Knowledge of techniques for unblocking websites for scraping.
  • Ability to use different scraping techniques and open-source tools to build scrapers.
  • Comfort with browser developer tools.
  • Knowledge of networking and TLS/SSL.
  • Experience with browser automation.
  • Knowledge of asynchronous programming.
  • Preferred qualifications include web development knowledge, CSS selectors and XPath parsing, Go or C++ experience, browser source-code experience, frontend framework knowledge, and experience with Pydantic, FastAPI, SQLAlchemy, Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, Grafana, Prometheus, or scraping-domain machine learning.

Benefits

  • Remote work.
  • Gross salary from 23,000 PLN per month, with flexibility based on skills and experience.

Tech Stack

Apache KafkaC++DockerElasticsearchFastAPIGitGoGrafanaKibanaKubernetesMySQLPrometheusPythonRedis

Categories

Oxylabs

About Oxylabs

201-500 employees

Oxylabs builds proxy networks, web scraping APIs, and ready-made datasets for enterprises that need large-scale access to public web data. Its products include residential and datacenter proxies, scraping and parsing services, and tools for use cases like pricing intelligence, SEO monitoring, ad verification, and market research. Founded in 2015 and headquartered in Vilnius, Lithuania, the privately held company serves customers that include Fortune 500 firms.

Contact me