17 days ago
Hyderābād, IndiaSenior
Responsibilities
- Develop and maintain ETL pipelines that ingest, process, and transform large datasets from diverse sources.
- Build and manage relational and non-relational data storage solutions with strong availability, performance, and scalability.
- Integrate APIs, third-party data sources, and internal databases into unified datasets.
- Design optimized data schemas, data models, cloud data platforms, and storage solutions for analytical and operational workloads.
- Use orchestration tools to automate ETL workflows and support reliable batch and real-time data processing.
- Lead solution architecture, technical design, architecture reviews, code reviews, and reusable engineering practices.
- Lead and mentor Data and AI Engineers through technical direction, coaching, and engineering guidance.
- Own delivery across design, development, deployment, production reliability, incident management, release support, and continuous improvement.
- Establish practices for automation, testing, observability, monitoring, release readiness, production support, and DevOps.
- Lead complex production incident resolution, root-cause analysis, preventive actions, and reliability improvements.
- Partner with product owners, business stakeholders, architects, analysts, and engineering teams to deliver sustainable data solutions.
- Provide technical leadership during critical incidents, major releases, and business-critical situations outside regular working hours when required.
Requirements
- At least 8 years of relevant work experience, including at least 4 years designing and developing scalable data pipelines, ETL frameworks, and database management systems.
- Bachelor’s degree in Computer Science or IT, a B.E./B.Tech, or a Bachelor’s in Computer Applications from a recognized institution.
- Proficiency in SQL and database technologies such as PostgreSQL, MySQL, Oracle, or SQL Server.
- Experience with big data frameworks such as Apache Spark, Hadoop, or Databricks.
- Strong programming skills in Python, Scala, or Java for data processing and automation.
- Experience with AWS, Azure, or GCP and cloud data services such as AWS Glue, Redshift, Big Query, or Snowflake.
- Deep hands-on experience architecting AWS-based data solutions using services including S3, Glue, Lambda, Redshift, Athena, Step Functions, SNS/SQS, IAM, CloudWatch, Kinesis, and EMR.
- Hands-on experience or strong working knowledge of Amazon Bedrock, Knowledge Bases, Guardrails, Agents, SageMaker, Lambda, S3, OpenSearch Serverless vector capabilities, Step Functions, and infrastructure as code using CDK or CloudFormation.
- Ability to make architecture decisions involving scale, security, reliability, performance, cost, and maintainability.
- Strong analytical, problem-solving, troubleshooting, communication, stakeholder-management, technical decision-making, and mentoring skills.
- Ability to navigate ambiguity, balance priorities, and manage risks, dependencies, and trade-offs while remaining technically hands-on.
Benefits
- Hybrid work model based in Hyderabad, Telangana, supporting flexibility and in-person collaboration.
- Benefits and Rewards packages with financial, physical, and personal wellness support.
- Resources and programs supporting employees and their loved ones across key areas of life.
Tech Stack
Amazon RedshiftApache AirflowApache HadoopApache SparkAWSAzureDatabricksGoogle BigQueryGoogle Cloud PlatformJavaMicrosoft SQL ServerMySQLPostgreSQLPythonScalaSnowflakeSQL
Categories
Data Engineering
About Vanguard
Vanguard is an investment management company offering low-cost index and active mutual funds, ETFs, brokerage, retirement plans, and financial advice for individual, institutional, and advisor clients. Founded in 1975 by John C. Bogle and headquartered in Valley Forge, PA, it operates a client-owned structure in which its funds own the firm. Its business model centers on asset-based management and advisory fees.