10 days ago
Hyderābād, IndiaMid Level
Responsibilities
- Design and build scalable near-real-time streaming and batch data pipelines for Amazon’s global transportation network.
- Build data products and tools covering data ingestion, processing, backfill, storage, vending, and operational support.
- Partner with operations and analytics stakeholders to gather requirements and deliver datasets and data tools.
- Own data quality and improve datasets that support operational excellence and customer experience.
- Collaborate cross-functionally to standardize analytics capabilities and build AI-powered automation.
- Use AWS cloud technologies to transform raw data into actionable metrics.
- Participate in code reviews, design discussions, operational best practices, security compliance, documentation, runbook creation, mentoring, and on-call pipeline monitoring.
Requirements
- At least 3 years of data engineering experience.
- Experience with data modeling, data warehousing, and ETL pipeline development.
- Experience with SQL.
- Experience with at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS.
- Experience building and operating highly available, distributed systems for extracting, ingesting, and processing large datasets.
- Experience with big data technologies such as Hadoop, Hive, Spark, or EMR.
- Preferred experience with AWS technologies including Redshift, S3, AWS Glue, EMR, Kinesis, Firehose, and IAM roles and permissions.
- Preferred experience with non-relational databases or data stores, including object, document, key-value, graph, or column-family stores.
- Preferred knowledge of batch and streaming architectures such as Kafka, Kinesis, Flink, Storm, or Beam.
Tech Stack
Amazon RedshiftApache BeamApache FlinkApache HadoopApache HiveApache KafkaApache SparkApache StormAWSJavaPythonScalaSQL
Categories
Data Engineering
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.