6 days ago
Hyderābād, IndiaSenior
Responsibilities
- Build and optimize data pipelines, data warehouses, and data lakes on AWS and Databricks.
- Manage and maintain AWS and Databricks environments.
- Implement quality checks and monitoring to ensure data integrity, accuracy, and consistency.
- Maintain system uptime and optimal performance.
- Translate cross-functional business requirements into technical solutions.
- Explore and implement tools and technologies to improve ETL platform performance.
Requirements
- 5 to 9 years of professional experience.
- Bachelor’s degree in computer science preferred; another engineering field may be considered.
- Proficiency in SQL for extracting, transforming, analyzing, and optimizing queries against complex datasets and big data platforms.
- Proficiency in Python, PySpark, and Airflow for scalable data ingestion, transformation, and loading processes.
- Experience with SQL/NoSQL databases and vector databases for large language models is preferred.
- Experience with data modeling and performance tuning for OLAP and OLTP databases is preferred.
- Experience with Apache Spark and Apache Airflow is preferred.
- Experience with software engineering best practices, Git or Subversion, Jenkins or Maven, automated unit testing, and DevOps is preferred.
- Experience with AWS, GCP, or Azure cloud services is preferred.
- AWS Certified Data Engineer and Databricks certification are preferred.
- Strong analytical, troubleshooting, communication, teamwork, presentation, prioritization, and problem-solving skills.
Tech Stack
Categories
Data Engineering
About Amgen
Amgen is a public biotechnology company that discovers, develops, manufactures, and sells biologic and biosimilar therapeutics for patients with serious diseases. Its portfolio and pipeline span oncology, cardiovascular disease, osteoporosis, inflammation, and rare diseases, marketed globally through direct sales and partnerships. Founded in 1980 and headquartered in Thousand Oaks, California (NASDAQ: AMGN), Amgen is a component of the Dow Jones Industrial Average and completed the acquisition of Horizon Therapeutics in 2023.