2 months ago
Hyderābād, IndiaMid Level
Responsibilities
- Design, develop, maintain, and deploy data solutions for data generation, collection, processing, and integration.
- Build and contribute to data pipelines and ETL/ELT processes using Databricks and other big-data technologies.
- Implement data-quality, security, privacy, governance, and reusable-code practices.
- Develop and maintain data models, data dictionaries, and technical documentation.
- Use cloud platforms, preferably AWS, to build scalable and efficient data solutions.
- Own data pipeline projects from inception through deployment, including scope, timelines, risks, and technical estimates.
- Collaborate with data architects, data scientists, product teams, business SMEs, and cross-functional stakeholders to meet data requirements.
- Identify and resolve complex data challenges and evaluate tools that improve ETL platform performance.
- Participate in sprint planning and communicate technical implementation estimates.
Requirements
- Bachelor’s degree and 2 to 4 years of experience in Computer Science, IT, or a related field.
- Proficiency with Databricks, Python, PySpark, and Scala for data processing and ETL workflows.
- Hands-on experience building Databricks ETL pipelines and handling big-data processing.
- Strong SQL knowledge and experience with relational databases such as PostgreSQL and MySQL.
- Familiarity with Apache Hadoop, Apache Spark, and Kafka.
- Experience with AWS data services such as EKS, EC2, S3, EMR, RDS, Redshift/Spectrum, Lambda, Glue, and Athena is preferred.
- Understanding of data modeling, data warehousing, data integration, and machine-learning pipelines and frameworks.
Tech Stack
Categories
Data Engineering
About Amgen
Amgen is a public biotechnology company that discovers, develops, manufactures, and sells biologic and biosimilar therapeutics for patients with serious diseases. Its portfolio and pipeline span oncology, cardiovascular disease, osteoporosis, inflammation, and rare diseases, marketed globally through direct sales and partnerships. Founded in 1980 and headquartered in Thousand Oaks, California (NASDAQ: AMGN), Amgen is a component of the Dow Jones Industrial Average and completed the acquisition of Horizon Therapeutics in 2023.