Senior Python Data Scraping Engineer (Freelance)

4 days ago

Remote, IsraelSenior

Responsibilities

Own end-to-end data extraction workflows across complex websites and deliver complete, accurate, structured datasets.
Use custom workflows and available tools to accelerate data collection, validation, and task execution.
Extract data reliably from JavaScript-rendered and interactive websites while adapting to changing site behavior.
Apply validation, cross-source consistency checks, formatting controls, and systematic verification to maintain data quality.
Scale scraping operations through batching or parallelization, monitor failures, and maintain stability against minor site structure changes.

At least 5 years of relevant experience in data engineering, web scraping, automation, or software development.
Strong Python web scraping experience with BeautifulSoup, Selenium or similar tools, including dynamic content such as JavaScript, AJAX, and infinite scroll.
Experience extracting data from complex structures including hierarchies, archived pages, and inconsistent HTML.
Experience with data cleaning, normalization, validation, and delivery in CSV, JSON, or Google Sheets formats.
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
Experience with AWS or equivalent cloud infrastructure and Docker in real workflows.
Hands-on experience with LangChain, OpenRouter, or similar LLM frameworks for automation tasks.
Upper-intermediate English proficiency at B2 level or above.
A GitHub link is a plus; strong attention to detail and independent troubleshooting ability are expected.
A bachelor’s or master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is preferred.

Freelance, part-time, remote work arrangement.
Estimated workload of 10–20 hours per week during active project phases, with no guaranteed workload.
Compensation of up to $25 per hour equivalent, depending on level and pace of contribution.

1,001-5,000 employees