2 months ago
Hyderābād, IndiaEntry Level
Responsibilities
- Design, build, and maintain robust pipelines that acquire, process, and store data from databases, APIs, and external providers.
- Develop and optimize processes to clean, enrich, and structure raw data for analysis and reporting.
- Implement and manage data warehousing solutions for efficient storage, retrieval, and query performance.
- Establish data quality standards, validate data, and resolve data quality issues.
- Optimize pipelines and storage for large data volumes, performance, and reliability.
- Implement data privacy and security controls, including access controls, encryption, and regulatory compliance.
- Collaborate with data scientists, analysts, and stakeholders to provide required data infrastructure.
- Document data pipelines, data models, and processes for knowledge sharing and troubleshooting.
- Implement monitoring to detect pipeline failures and performance bottlenecks.
- Evaluate industry trends and emerging technologies to improve data infrastructure.
Requirements
- At least 1 year of data engineering experience.
- Experience with SQL, data modeling, data warehousing, and building ETL pipelines.
- Experience with one or more query languages, such as SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, or Scala.
- Experience with one or more scripting languages, such as Python or KornShell.
- Knowledge of database, data warehouse, or data lake solutions.
- Preferred: experience with Hadoop, Hive, Spark, or EMR.
- Preferred: knowledge of schema design concepts including normalization and relational versus dimensional models.
- Preferred: experience with AWS technologies including Redshift, S3, AWS Glue, EMR, Kinesis, Firehose, Lambda, and IAM roles and permissions.
- Preferred: experience using generative AI tools, crafting prompts, and evaluating AI-generated outputs.
- Preferred: experience identifying opportunities to integrate AI solutions into products and services.
Tech Stack
Categories
Data Engineering
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.