Data Platform Administrator
London Stock Exchange Group12 months ago
Bengaluru, IndiaMid Level
Responsibilities
- Administer and maintain workspaces, clusters, pools, and jobs in Databricks or other big data systems.
- Monitor platform performance, usage, and costs and optimize cluster configurations.
- Configure role-based access control and audit logging and support data governance and security compliance.
- Develop CI/CD pipelines for notebooks, jobs, and libraries using GitLab, GitHub Actions, Azure DevOps, or Jenkins.
- Automate cluster lifecycle management and job scheduling.
- Support data scientists, engineers, and analysts and troubleshoot job failures, performance bottlenecks, and integration issues.
- Integrate Databricks with enterprise systems including Azure Data Lake, Power BI, and Dataverse.
- Collaborate with data engineering and related teams.
Requirements
- Proven experience administering big data platforms in a production environment.
- Strong understanding of Apache Spark and distributed computing.
- Experience with cloud platforms, with Azure preferred and AWS or GCP acceptable.
- Familiarity with Unity Catalog, Delta Lake, and Lakehouse architecture.
- Proficiency in Python, SQL, and shell scripting.
- Experience with CI/CD tools and infrastructure-as-code.
- Terraform experience is a plus.
- Strong problem-solving and communication skills.
Benefits
- Healthcare benefits, retirement planning, paid volunteering days, and wellbeing initiatives.
- Equal-opportunity employer with reasonable accommodations for religious practices, mental health needs, and physical disabilities.
- Collaborative and creative culture with sustainability initiatives and opportunities to participate in charitable fundraising and volunteering.
- Global work environment spanning LSEG's operations across more than 60 countries.
Tech Stack
Categories
Data EngineeringDevOps
About London Stock Exchange Group
London Stock Exchange Group (LSEG) provides market infrastructure, financial data, and analytics to banks, asset managers, and corporations. Its businesses span capital markets (London Stock Exchange), post-trade clearing (LCH), and information services including FTSE Russell indices and the Refinitiv data platform, funded by transaction fees, subscriptions, and licensing. Headquartered in London and publicly listed on the LSE, the group serves global customers seeking trading, clearing, benchmarks, and enterprise data solutions.