Amazon

Software Development Engineer - Agentic Data Infrastructure, Partner Data And Analytics

Amazon
Apply
2 days ago
Chennai, IndiaMid Level

Responsibilities

  • Design and build MCP servers and data access APIs.
  • Engineer real-time streaming infrastructure using Spark Structured Streaming, Kafka/MSK, Kinesis, and Lambda.
  • Build agent orchestration infrastructure including tool registries, execution planners, state stores, and handoff protocols.
  • Develop trust and validation infrastructure for reliable agent-generated outputs.
  • Extend Iceberg-based lakehouse infrastructure with metadata contracts, schema registries, and catalog APIs.
  • Design, build, test, deploy, operate, and document observable, self-healing, and resilient systems.
  • Participate in on-call operations, conduct root-cause analysis, and permanently resolve operational issues.

Requirements

  • Have 3+ years of experience with big data technologies such as AWS, Hadoop, Spark, Pig, Hive, Lucene/Solr, or Storm/Samza.
  • Have a bachelor’s degree in Computer Science, Computer Engineering, or equivalent experience.
  • Be proficient in one or more of Java, Python, Kotlin, TypeScript, Scala, or Rust.
  • Have experience designing and operating production services, including API design, distributed-system patterns, and service-oriented architectures.
  • Have strong fundamentals in data structures, algorithms, concurrency, and system design.
  • Have experience with data infrastructure such as Iceberg lakehouse architectures, Athena or Trino query engines, or metadata/catalog systems.
  • Preferred: experience with agentic AI infrastructure, tool registries, agent orchestration, LLM integration, or agent state management.
  • Preferred: familiarity with GenAI infrastructure patterns, RAG, embedding stores, or evaluation frameworks.

Tech Stack

Apache HadoopApache HiveApache KafkaApache PigApache SparkApache StormAWSJavaKotlinPythonRustScalaTypeScript

Categories

BackendData Engineering
Amazon

About Amazon

10,000+ employees

Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.

Contact me