1 month ago
Remote, Americas +3 moreMid Level
Responsibilities
- Design, develop, and maintain Scrapy web crawlers.
- Use the Zyte platform and open-source projects for distributed information extraction, retrieval, and data processing.
- Identify and resolve performance and scalability issues in distributed crawling at scale.
- Debug and fix problems in open-source projects, including Scrapy.
Requirements
- At least 3 years of software development experience in Python.
- Solid Python knowledge.
- Familiarity with Linux/UNIX, HTTP, HTML, JavaScript, and networking.
- Good written and spoken English communication.
- Availability to work full time.
- Scrapy experience is preferred.
- Familiarity with crawling, extraction, and data-processing techniques and tools such as NLTK, pandas, scikit-learn, MapReduce, and NoSQL is preferred.
Benefits
- Fully remote work with flexibility to work from where you perform best.
- 35 days of paid holidays.
- Conference attendance and opportunities to meet team members globally.
- Work with open-source technologies and tools.
- Join a self-motivated, multicultural, globally distributed team.
Tech Stack
Categories
