3 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Design, develop, and maintain scalable data pipelines and microservices using Python.
- Build document parsing and extraction pipelines for PDFs, HTML, structured data, and unstructured data at million-document scale.
- Implement AI-driven solutions using large language models, LangGraph, AgenticAI, and prompt engineering.
- Design high-performance data storage and retrieval solutions using DynamoDB and other databases.
- Implement and manage real-time Kafka-based data streaming for event-driven architectures.
- Architect and deploy secure, scalable, and cost-optimized services within AWS.
- Lead code reviews, system design, technical decision-making, and performance optimization.
- Troubleshoot complex distributed-systems issues and mentor junior engineers.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
- 7 to 10 years of professional software development experience in a product-based company operating through rapid scaling.
- Expert-level proficiency in Python and Java.
- Experience parsing documents and extracting structured data from PDFs, HTML, XML, and other unstructured formats.
- Deep hands-on experience with NoSQL databases, specifically DynamoDB, and performance-oriented data modeling.
- Experience with Kafka or similar message brokers for event-driven systems.
- Strong experience with AWS services and cloud-native application development.
- Experience with Kubernetes and infrastructure-as-code tools such as CDK, Terraform, or CloudFormation.
- Experience building and maintaining ETL/ELT data pipelines and handling large-scale datasets.
- Strong understanding of distributed-systems design and the ability to work proactively in an ambiguous, fast-paced environment with excellent communication skills.
Tech Stack
Categories
About Nielsen
Nielsen provides audience measurement and analytics that quantify who watches, listens, and buys across TV, digital, radio, and streaming. It sells ratings, cross-platform datasets, and advertising effectiveness tools to media owners, advertisers, and agencies on subscription and consulting agreements. Founded in 1923 and headquartered in New York, it operates in 55+ countries and is known for U.S. TV ratings.