18 hours ago
Pune, IndiaMid Level
Responsibilities
- Build scalable web crawlers to extract structured and unstructured web data.
- Manage dynamic content extraction from JavaScript-heavy, AJAX, and infinite-scroll websites using browser automation.
- Optimize crawling performance through concurrent execution, asynchronous programming, and container multi-threading.
- Design, develop, and maintain scalable Python and PHP backend microservices.
- Build web applications and internal tools using the PHP CodeIgniter framework.
- Develop Python-based RESTful APIs for data integration.
- Design PostgreSQL schemas and write optimized SQL queries.
- Troubleshoot production issues and maintain system stability.
- Collaborate with Product, QA, DevOps, and other engineering teams.
Requirements
- At least 3 years of professional software engineering experience.
- Deep proficiency with Python parsing packages including Scrapy, BeautifulSoup, LXML, and Requests.
- Hands-on experience with Selenium, Playwright, or Pyppeteer for browser automation.
- Strong PHP and CodeIgniter development experience.
- Experience with PostgreSQL schema design, query optimization, and performance tuning.
- Strong foundation in microservices and RESTful API development.
- Ability to independently own projects from concept through delivery.
- Strong communication and collaboration skills.
- Preferred experience with AWS, Azure, or GCP; CI/CD pipelines; Docker; Kubernetes; Git; logging, monitoring, and observability tools; and JIRA.
- Preferred familiarity with Agile/Scrum frameworks.
Benefits
- Flexible working environment.
- Volunteer time off.
- LinkedIn Learning.
- Employee Assistance Program.
- Location: Pune or Chennai.