Senior Data Platform Administrator
London Stock Exchange Group2 months ago
Bengaluru, IndiaSenior
Responsibilities
- Administer, maintain, monitor, and optimize Databricks and Azure cloud data platform environments, including workspaces, clusters, jobs, and instance pools.
- Optimize platform utilization, cloud costs, performance, scalability, reliability, and availability.
- Implement security controls, RBAC, audit logging, and enterprise governance standards.
- Develop and maintain Terraform infrastructure-as-code and CI/CD pipelines using DevOps tools, GitHub Actions, or GitLab.
- Automate platform provisioning, cluster lifecycle management, job orchestration, and routine operational tasks.
- Provide production support and troubleshoot Spark workloads, job failures, performance bottlenecks, platform issues, and integrations.
- Establish SRE practices including SLAs, SLOs, error budgets, incident management, root cause analysis, and continuous service improvement.
- Design and maintain monitoring dashboards, logging, alerting, backup, patching, disaster recovery, and platform upgrade capabilities.
- Integrate Databricks with Azure Data Lake, Power BI, Dataverse, and other cloud-native technologies.
- Support Lakehouse architecture, Unity Catalog, Delta Lake, governance, and data management best practices.
Requirements
- Validated experience administering big data platforms in a production environment.
- Strong understanding of Apache Spark and distributed computing.
- Experience with cloud platforms, with Azure preferred.
- Familiarity with Unity Catalog, Delta Lake, and Lakehouse architecture.
- Proficiency in Python, SQL, and shell scripting.
- Experience with CI/CD tools and infrastructure-as-code; Terraform is required.
- Strong problem-solving and interpersonal skills.
Benefits
- Healthcare, retirement planning, paid volunteering days, and wellbeing initiatives.
- Collaborative and creative culture with opportunities to contribute ideas.
- Equal-opportunity employer with reasonable accommodation for religious practices, mental health needs, and physical disabilities.
- Opportunities to participate in fundraising and volunteering through the LSEG Foundation.
Tech Stack
Categories
Data EngineeringDevOps
About London Stock Exchange Group
London Stock Exchange Group (LSEG) provides market infrastructure, financial data, and analytics to banks, asset managers, and corporations. Its businesses span capital markets (London Stock Exchange), post-trade clearing (LCH), and information services including FTSE Russell indices and the Refinitiv data platform, funded by transaction fees, subscriptions, and licensing. Headquartered in London and publicly listed on the LSE, the group serves global customers seeking trading, clearing, benchmarks, and enterprise data solutions.