Product Software Engineer II
The Walt Disney Company19 hours ago
Bengaluru, IndiaMid Level
Responsibilities
- Build and maintain scalable streaming and batch data pipelines for low-latency ingestion and high-throughput processing.
- Develop embedding-generation workflows, vector-store integrations, semantic-search and retrieval pipelines, and AI-assistant data foundations.
- Design AI-optimized data models, storage patterns, reusable ingestion components, and integrations with shared AI platform services.
- Implement observability, monitoring, data-quality validation, schema-evolution safeguards, governance, compliance, auditability, and failure-recovery capabilities.
- Own the development lifecycle from prototyping and implementation through testing, deployment, optimization, and documentation.
- Collaborate with infrastructure, ML engineering, product, and governance teams to deliver production-ready AI capabilities.
- Mentor junior team members and influence technical direction through design proposals, architecture reviews, and hands-on delivery.
Requirements
- 5+ years of data engineering experience, including at least 1 year in a lead or senior technical role.
- Experience building and scaling streaming data pipelines in large-scale distributed environments.
- Strong Python, Java, and SQL skills, with expert-level ability in either Python or Java.
- Experience with streaming technologies such as Kafka, Flink, Spark, or Kinesis.
- Experience with embedding pipelines and vector stores such as Pinecone, Weaviate, FAISS, or pgvector.
- Strong knowledge of data modeling, storage optimization, and large-scale retrieval patterns.
- Hands-on experience with workflow orchestration tools such as Airflow or Dagster.
- Familiarity with testing, monitoring, and automation for data pipelines.
- Experience integrating AI-ready data stores with LLM orchestration frameworks such as LangChain or LangGraph is preferred.
- Knowledge of observability and monitoring tools such as Datadog or Prometheus is preferred.
- Experience with enterprise data governance, compliance, security, lineage, auditability, data frameworks, registries, or multi-team accelerators is preferred.
- Ability to write design documentation, lead system architecture reviews, and influence data engineering practices.
- Bachelor’s degree or higher in computer science or a related quantitative field, or equivalent practical experience demonstrating advanced technical expertise.
Tech Stack
Categories
Data Engineering
About The Walt Disney Company
The Walt Disney Company is a diversified entertainment business that produces films and television, operates theme parks and resorts, and runs streaming services including Disney+, Hulu, and ESPN+. It earns revenue from subscriptions and advertising, theatrical distribution, licensing and merchandise, and park admissions and experiences. Founded in 1923 and headquartered in Burbank, California, Disney owns brands such as Pixar, Marvel, Lucasfilm, and 20th Century Studios and serves audiences worldwide.