Amazon

Data Engineer, Agentic Data Platform, Partner Data And Analytics

Amazon
Apply
2 days ago
Chennai, IndiaMid Level

Responsibilities

  • Build schema-aware, version-controlled foundational data layers optimized for programmatic access.
  • Engineer high-throughput, event-driven pipelines using Spark Structured Streaming, Kafka, and Kinesis.
  • Define data discovery, metric disambiguation, and multi-step analytical query capabilities for the Curated Data Layer.
  • Build agents that automate schema-drift detection, pipeline healing, metric onboarding, data quality checks, and dataset publishing.
  • Develop output validation, confidence scoring, regression testing, and escalation workflows for agentic data systems.
  • Migrate legacy ETL to Iceberg-based incremental processing and unify metric definitions across 12+ surfaces.
  • Build operational infrastructure serving thousands of metrics to human users and AI agents.

Requirements

  • At least 3 years of data engineering experience.
  • At least 4 years of SQL experience.
  • Experience with data modeling, data warehousing, and ETL pipeline development.
  • Experience building large-scale, high-throughput, 24x7 data systems.
  • Experience coding, scripting, or automating in at least one language such as Python, C, C++, Java, Ruby, or PowerShell.
  • Preferred experience with AWS technologies including Redshift, S3, AWS Glue, EMR, Kinesis, Firehose, Lambda, and IAM roles and permissions.
  • Preferred familiarity with REST, GraphQL, or MCP API design patterns for data services used by downstream applications, GenAI agents, and LLM-powered systems.

Benefits

  • Amazon provides workplace accommodations and adjustments during the application and hiring process, including interview and onboarding support, for applicants with disabilities.

Tech Stack

Amazon RedshiftApache KafkaAWSCC++GraphQLJavaPowerShellPythonRubySQL

Categories

Data Engineering
Amazon

About Amazon

10,000+ employees

Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.

Contact me