2 days ago
Remote, Poland or Warsaw, PolandSenior
Responsibilities
- Design and build distributed scraping architectures that scale across thousands of domains.
- Reverse engineer APIs and mobile applications using Frida, mitmproxy, Charles Proxy, Burp, and similar tools.
- Detect and bypass anti-bot measures, including JavaScript checks, browser behavior detection, fingerprinting, WAFs, and JavaScript challenges.
- Lead technical innovation by identifying edge cases, prototyping new approaches, and sharing knowledge.
- Set up anomaly detection and monitoring to identify scraping blockers and failures early.
- Collaborate with Customer Success, Operations, and Data teams to deliver high-quality actionable data.
Requirements
- At least 5 years of experience with Python and large-scale scraping projects.
- Deep understanding of anti-bot technologies, fingerprinting, WAFs, JavaScript challenges, and bypass techniques.
- Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser drivers.
- Experience handling residential, datacenter, and rotating proxies, session management, cookie injection, and TLS tuning.
- Strong debugging skills across browsers, HTTP traffic, and device-level interactions.
- Familiarity with Parquet, Avro, or real-time stream processing.
- Knowledge of MongoDB, InfluxDB, and Redis, including optimization.
- Experience with real-device simulation for mobile scraping is a bonus.
- Experience building and maintaining distributed task queues such as Celery and Kafka is a bonus.
- Experience with high-security platforms, mobile-first environments, Linux, AWS, GCP, Kubernetes, Cloud Run, or Cloud Functions is a bonus.
Benefits
- Flexible working environment and flexible hours.
- Volunteer time off.
- LinkedIn Learning.
- Employee Assistance Program (EAP).
- Competitive salary and opportunities for rapid growth.
Tech Stack
Categories
BackendData Engineering