28 days ago
Bengaluru, IndiaSenior
Responsibilities
- Own Databricks workspace- and account-level architecture, including Unity Catalog, compute policies, Lakeflow Jobs, identity, secrets, audit logging, storage integration, upgrades, and environment promotion.
- Design, build, and review infrastructure-as-code, CI/CD, observability, reusable standards, automation, reference implementations, and paved-road patterns for the data platform.
- Operate the platform reliably by managing availability, capacity, incidents, root-cause analysis, disaster recovery/business continuity, and platform SLOs.
- Manage Databricks FinOps, including consumption monitoring, cost optimization, budgets, anomaly management, chargeback, and showback.
- Implement platform security and governance controls covering identity federation, SCIM, service principals, network controls, secrets, RBAC, ABAC, tags, row- and column-level security, masking, PII, lineage, and audit.
- Enable and operate platform capabilities for AI/ML workloads, including MLflow, Model Serving, vector search, and GenAI infrastructure patterns.
- Treat the platform as an internal product by defining self-service capabilities, tracking adoption and reliability, reducing developer friction, and owning the platform roadmap.
- Mentor engineers, lead code reviews and technical discussions, contribute to architecture decisions and engineering standards, and provide secondary coverage for an adjacent platform area.
Requirements
- 3–5 years of professional data platform or data engineering experience, including at least 2 years administering and operating Databricks in production as an enterprise platform.
- Experience designing, building, and reviewing infrastructure-as-code using Terraform or an equivalent, and CI/CD for data platforms using GitHub Actions, AWS CodePipeline, or similar tools.
- Strong Python and PySpark skills and advanced SQL knowledge.
- Experience with monitoring, alerting, incident management, runbooks, capacity management, and performance management.
- Experience with Databricks cost management and FinOps practices.
- Experience with platform security and compliance, including identity, service principals, secrets, network controls, audit logging, RBAC, PII handling, and controls such as SOX.
- Understanding of distributed systems and system design for large-scale data processing.
- Strong AWS fundamentals, including S3, IAM, VPC, networking, and KMS, and knowledge of Databricks integration with AWS.
- Demonstrated use of AI-assisted engineering tools, or strong ability and willingness to adopt them, across coding, infrastructure-as-code, testing, documentation, and troubleshooting.
- Strong written and verbal communication skills and ability to work with global stakeholders and lead technical discussions.
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent demonstrable experience.
- Preferred qualifications include Databricks Certified Data Engineer Professional, AWS Certified Solutions Architect, compliance-driven platform experience, mentoring experience, platform migration or takeover experience, and global delivery experience.
Benefits
- Inclusive and collaborative work environment with employee resource groups, career development opportunities, cultural awareness initiatives, and social responsibility engagement.
- Equal opportunity employment environment with accommodations available for applicants and interview participants.
- The position is not eligible for visa sponsorship.
About Illumina
Illumina builds next-generation DNA sequencing systems, reagents/consumables, and bioinformatics software used by research, clinical, pharmaceutical, and agricultural genomics labs. Its business model combines sale of instruments with recurring consumables, sequencing services, and cloud analysis tools; the company was founded in 1998, is headquartered in San Diego, and trades on NASDAQ under the ticker ILMN.