17 days ago
Hyderābād, IndiaSenior
Responsibilities
- Develop and maintain scalable ETL pipelines that ingest, process, and transform large datasets from diverse sources.
- Design and manage relational and non-relational data stores, schemas, cloud data platforms, and storage solutions for analytical and operational workloads.
- Integrate APIs, third-party sources, and internal databases into unified, high-quality datasets.
- Architect batch and real-time data processing solutions with appropriate governance, security, performance, scalability, and reliability.
- Use orchestration tools to automate ETL workflows and improve operational efficiency.
- Own data products and platforms across design, development, deployment, production support, incident management, and continuous improvement.
- Lead solution architecture, technical design, architecture reviews, code reviews, and engineering standards.
- Lead and mentor Data and AI Engineers through technical direction, coaching, and troubleshooting guidance.
- Establish practices for automation, testing, observability, monitoring, release readiness, and production support.
- Lead complex production incident resolution, root-cause analysis, preventive actions, and reliability improvements.
- Partner with Product Owners, business stakeholders, Architects, Analysts, data scientists, and engineering teams to deliver sustainable data solutions.
- Provide technical leadership during critical incidents, major releases, and other business-critical situations when required.
Requirements
- At least 8 years of relevant work experience, including at least 4 years designing and developing scalable data pipelines, ETL frameworks, and database management systems.
- Bachelor’s degree in Computer Science or IT, or a Bachelor’s in Computer Applications from a recognized institution.
- Proficiency in SQL and database technologies including PostgreSQL, MySQL, Oracle, or SQL Server.
- Hands-on experience with Apache Spark, Hadoop, or Databricks.
- Strong programming skills in Python, Scala, or Java for data processing and automation.
- Experience with AWS, Azure, or GCP and cloud data services such as AWS Glue, Redshift, Big Query, or Snowflake.
- Deep hands-on experience architecting AWS-based data solutions using services including S3, Glue, Lambda, Redshift, Athena, Step Functions, SNS/SQS, IAM, CloudWatch, Kinesis, and EMR.
- Hands-on experience or strong working knowledge of Amazon Bedrock, including Knowledge Bases, Guardrails, and Agents, as well as SageMaker, OpenSearch Serverless vector capabilities, and infrastructure as code using CDK or CloudFormation.
- Ability to make architecture decisions involving scale, security, reliability, performance, cost, and maintainability.
- Strong analytical, troubleshooting, technical decision-making, communication, stakeholder-management, and risk-management skills.
- Demonstrated ability to lead, mentor, influence, and remain technically hands-on.
Benefits
- Vanguard provides financial, physical, and personal wellness support through its Total Rewards programs.
- The role is based in Hyderabad, Telangana, India.
- Vanguard uses a hybrid working model for most employees, combining flexibility with in-person collaboration and learning.
Tech Stack
Amazon RedshiftApache AirflowApache HadoopApache SparkAWSAzureDatabricksGoogle Cloud PlatformJavaMicrosoft SQL ServerMySQLPostgreSQLPythonScalaSnowflakeSQL
Categories
Data Engineering
About Vanguard
Vanguard is an investment management company offering low-cost index and active mutual funds, ETFs, brokerage, retirement plans, and financial advice for individual, institutional, and advisor clients. Founded in 1975 by John C. Bogle and headquartered in Valley Forge, PA, it operates a client-owned structure in which its funds own the firm. Its business model centers on asset-based management and advisory fees.