Lead Engineer
London Stock Exchange Group3 days ago
Bengaluru, India or Hyderābād, IndiaStaff+
Responsibilities
- Design, implement, test, monitor, and optimize Azure data platforms, data pipelines, ingestion, curation, transformation, and loading workflows.
- Build secure, compliant, scalable, performant, and reliable production data-processing pipelines and data stores.
- Implement solutions using Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Azure Stream Analytics, Azure Databricks, Azure Blob Storage, and Microsoft Purview.
- Provision data storage, ingest streaming and batch data, transform and consolidate structured and unstructured data, implement retention and security requirements, and integrate external data sources.
- Establish solution intent, information models, documentation requirements, common modeling and coding practices, and program-level engineering standards.
- Design and oversee DevOps and CI/CD processes, automate tasks through tools and scripting, and contribute to software design and architecture.
- Collaborate with customers, stakeholders, suppliers, product owners, business teams, internal teams, vendors, data engineers, analysts, and data scientists.
- Identify and resolve performance bottlenecks, minimize data loss, and address unexpected production issues.
- Lead, coach, and mentor developers and support subject-matter experts and technical leads in meeting delivery commitments.
Requirements
- 10+ years of IT experience and 5+ years of relevant experience with data platforms and Azure PaaS offerings, preferably in financial services.
- Strong experience with Microsoft Fabric, Snowflake, Microsoft Purview, Azure Databricks, Azure Data Factory, Azure Data Lake, Azure Monitor, Azure Data Lake Storage, Azure Functions, Log Analytics, and Azure Container Apps.
- Proficiency in SQL and Python; PySpark knowledge is a bonus.
- Knowledge of security standards and processes, including Azure Key Vault, Microsoft Entra ID, RBAC, and Azure Monitor.
- Understanding of Azure networking concepts, UML, DevOps tools, Terraform, REST APIs, and Agile/Scrum development processes.
- Understanding of AI concepts, LLMs, MCP, ontology, and knowledge graphs is a bonus.
- Ability to lead teams, mentor developers, work independently and collaboratively, and coordinate with agile teams across locations.
- Strong communication, presentation, documentation, prioritization, critical-thinking, problem-solving, and interpersonal skills.
- Azure DP-203: Data Engineering on Microsoft Azure and DP-900: Microsoft Azure Data Fundamentals certifications are preferred.
Benefits
- Healthcare, retirement planning, paid volunteering days, and wellbeing initiatives.
- Opportunities for fundraising and volunteering through the LSEG Foundation.
- Collaborative and creative culture with emphasis on innovation, quality, continuous improvement, sustainability, and inclusion.