20 hours ago
Hyderābād, IndiaSenior / Staff+
Responsibilities
- Provision and configure Databricks accounts, workspaces, Unity Catalog, and supporting AWS infrastructure.
- Design, deploy, and manage multi-environment Databricks platforms using Terraform and CloudFormation.
- Configure and manage AWS networking, security, compute, storage, database, monitoring, and related services.
- Implement Unity Catalog governance, access controls, audit logging, lineage tracking, and secure data sharing.
- Automate deployment and lifecycle management with Databricks Asset Bundles, Databricks CLI, REST APIs, Git integration, and pipelines.
- Monitor platform reliability, usage, cluster utilization, DBU consumption, infrastructure costs, and user experience.
- Support migration and onboarding of enterprise applications, data engineering workloads, AI/ML platforms, and GenAI use cases.
- Troubleshoot infrastructure, networking, security, authentication, integration, and connectivity issues.
- Partner with technical and business stakeholders and serve as a primary advisor for Databricks platform adoption.
Requirements
- At least five years of experience in cloud engineering, infrastructure management, or cloud operations.
- Bachelor's degree in computer science, information technology, or a related B.E./B.Tech discipline, or equivalent experience.
- Strong Databricks administration and platform engineering experience, including Unity Catalog, Workflows, SQL Warehouses, Cluster Policies, Delta Lake, Auto Loader, Structured Streaming, and Lakehouse architectures.
- Hands-on experience with Databricks Asset Bundles, Databricks CLI, REST APIs, Git integration, Terraform, CloudFormation, and platform automation.
- Expertise with AWS services including VPC, IAM, EC2, S3, KMS, Lambda, RDS, and CloudWatch.
- Experience with RBAC, governance, security controls, enterprise compliance, production platforms, and mission-critical workloads.
- Experience implementing CI/CD pipelines using GitHub Actions, Jenkins, or equivalent tools.
- Proficiency in Python, SQL, TypeScript, REST APIs, and scripting for platform automation.
- Strong troubleshooting skills in cloud infrastructure, networking, security, and performance optimization.
- Preferred certifications include Databricks Certified Platform Administrator, Databricks Data Engineer Associate or Professional, and AWS Solutions Architect Associate or Professional.
- Experience with AI/ML and GenAI platforms, regulated or highly governed enterprise environments, GitHub, and Bitbucket/Bamboo is preferred.
Benefits
- Vanguard provides financial wellness programs and competitive offers.
- Benefits include physical wellness support and resources for personal wellness.
- The role is based in Hyderabad, Telangana, India.
- Vanguard uses a hybrid working model for most employees, balancing flexibility with in-person collaboration.
Categories
About Vanguard
Vanguard is an investment management company offering low-cost index and active mutual funds, ETFs, brokerage, retirement plans, and financial advice for individual, institutional, and advisor clients. Founded in 1975 by John C. Bogle and headquartered in Valley Forge, PA, it operates a client-owned structure in which its funds own the firm. Its business model centers on asset-based management and advisory fees.