1 month ago
Bengaluru, IndiaStaff+
Responsibilities
- Design, develop, and maintain scalable data pipelines and microservices using Python.
- Build document parsing and extraction pipelines for PDFs, HTML, structured data, and unstructured data at million-document scale.
- Implement AI-driven solutions using large language models, LangGraph, AgenticAI, and prompt engineering.
- Design high-performance data storage and retrieval solutions using DynamoDB and other databases.
- Implement and manage real-time Kafka-based data streaming for event-driven architectures.
- Architect and deploy secure, scalable, and cost-optimized services within AWS.
- Lead code reviews, system design, technical decision-making, and performance optimization.
- Troubleshoot complex distributed-systems issues and mentor junior engineers.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
- 7 to 10 years of professional software development experience in a product-based company operating through rapid scaling.
- Expert-level proficiency in Python and Java.
- Experience parsing documents and extracting structured data from PDFs, HTML, XML, and other unstructured formats.
- Deep hands-on experience with NoSQL databases, specifically DynamoDB, and performance-oriented data modeling.
- Experience with Kafka or similar message brokers for event-driven systems.
- Strong experience with AWS services and cloud-native application development.
- Experience with Kubernetes and infrastructure-as-code tools such as CDK, Terraform, or CloudFormation.
- Experience building and maintaining ETL/ELT data pipelines and handling large-scale datasets.
- Strong understanding of distributed-systems design and the ability to work proactively in an ambiguous, fast-paced environment with excellent communication skills.
Tech Stack
Categories
About Nielsen
Nielsen shapes the world’s media and content as a global leader in audience insights, data and analytics. Through our understanding of people and their behaviors across all channels and platforms, we empower our clients with independent and actionable intelligence so they can connect and engage with their audiences—now and into the future. Nielsen operates around the world in more than 55 countries. Learn more at http://nlsn.co/6006JMfty and connect with us on social media (LinkedIn, Twitter, Facebook and Instagram).