2 days ago
Hyderābād, IndiaEntry Level
Responsibilities
- Design, build, and maintain real-time and batch data pipelines that acquire, process, and store data from databases, APIs, and external data providers.
- Develop and optimize ETL processes to clean, enrich, and structure data for analysis and reporting.
- Implement and manage data warehousing solutions, data models, and storage systems for efficient retrieval and query performance.
- Establish data quality standards, validate data, and resolve quality issues proactively.
- Optimize pipelines and storage for large data volumes, performance, and reliability.
- Implement access controls, encryption, and compliance practices to protect data privacy and security.
- Collaborate with data scientists, analysts, and stakeholders to provide data infrastructure supporting their requirements.
- Document pipelines, data models, and processes, and implement monitoring to detect failures and performance bottlenecks.
- Evaluate emerging data engineering technologies and recommend infrastructure improvements.
Requirements
- At least 2 years of data engineering experience.
- Experience with SQL, data modeling, data warehousing, and ETL pipeline development.
- Experience with one or more query languages, such as SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, or Scala.
- Experience with one or more scripting languages, such as Python or KornShell.
- Knowledge of database, data warehouse, or data lake solutions.
- Preferred: experience with Hadoop, Hive, Spark, or EMR.
- Preferred: knowledge of normalization and relational versus dimensional data models.
- Preferred: experience with AWS Redshift, S3, Glue, EMR, Kinesis, Firehose, Lambda, and IAM roles and permissions.
- Preferred: experience using generative AI tools, crafting prompts, evaluating AI-generated outputs, and identifying opportunities to integrate AI solutions into products or services.
Tech Stack
Categories
Data Engineering
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.