Senior Python Data Scraping Engineer (Freelance)

4 days ago

Remote, United States +3 moreSenior

Responsibilities

Own end-to-end data extraction workflows across complex websites and deliver accurate, structured datasets.
Use custom workflows and tools to accelerate data collection, validation, and task execution.
Extract data from dynamic and interactive web sources, including JavaScript-rendered content and changing site structures.
Enforce data quality through validation, cross-source consistency checks, formatting controls, and systematic verification.
Scale scraping operations through batching or parallelization, monitor failures, and maintain stability against site changes.
Handle anti-bot mechanisms and troubleshoot scraping workflows independently.

At least 5 years of relevant experience in data engineering, web scraping, automation, or software development.
Strong Python web scraping experience with tools such as BeautifulSoup and Selenium, including dynamic content and APIs via proxies.
Experience extracting data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
Experience with data cleaning, normalization, validation, and delivery in structured formats including CSV, JSON, and Google Sheets.
Experience with AWS or equivalent cloud infrastructure and Docker in real workflows.
Hands-on experience with LLM frameworks such as LangChain and OpenRouter for automation tasks.
Strong attention to detail, independent troubleshooting ability, and a self-directed work ethic.
Upper-intermediate English proficiency at B2 level or above.
A GitHub link is a plus.
A bachelor's or master's degree in engineering, applied mathematics, computer science, or a related technical field is preferred.

Remote freelance position with part-time work estimated at 10–20 hours per week during active project phases.
Work is performed for the Tendem project through Mindrift.
Compensation is stated as up to $45 per hour equivalent, depending on contribution level and pace.

1,001-5,000 employees