Senior Data Engineer
London Stock Exchange Group12 hours ago
Bengaluru, IndiaSenior
Responsibilities
- Design, develop, and operate real-time event-driven integration services using Golang and Python.
- Build and enhance the Service Layer platform that orchestrates Quote-to-Cash workflows across enterprise applications.
- Design canonical data models, transformation frameworks, validation rules, and integration contracts.
- Develop Kafka-based event processing with retries, idempotency, sequencing, replay, and fault recovery.
- Build secure REST APIs through AWS API Gateway and integrate with SaaS and enterprise applications.
- Build and support ETL, migration, reconciliation, and data-quality solutions using AWS Glue, Step Functions, Snowflake, PostgreSQL, and ClickHouse.
- Implement observability, monitoring, alerting, dashboards, and operational tooling for end-to-end workflow visibility.
- Define engineering standards, secure-by-design principles, cloud practices, data governance, and non-functional requirements.
- Collaborate with distributed engineering teams and stakeholders to deliver scalable data solutions.
- Participate in architecture reviews, production support, incident management, root-cause analysis, performance optimization, and operational readiness.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related discipline.
- 7+ years of software engineering experience, including at least 3+ years focused on data engineering and distributed data platforms.
- 3+ years building cloud-native solutions on AWS.
- 3+ years of production experience with Golang, Python, AWS services, and Kafka.
- Strong experience building scalable backend services, event-driven integrations, orchestration workflows, and data processing solutions.
- Experience with AWS Lambda, API Gateway, S3, RDS/Aurora PostgreSQL, DynamoDB, SQS, SNS, EventBridge, IAM, CloudWatch, VPC, and serverless architecture patterns.
- Experience with Kafka, AWS MSK, RabbitMQ, or equivalent messaging technologies.
- Understanding of distributed systems, resiliency, fault tolerance, idempotency, retries, dead-letter queues, replay, and eventual consistency.
- Experience with PostgreSQL, ClickHouse, relational databases, and NoSQL databases including DynamoDB.
- Experience designing RESTful APIs, enterprise integrations, canonical data models, data contracts, transformation layers, and validation frameworks.
- Experience supporting highly available enterprise integration platforms and business-critical AWS applications.
- Experience with CI/CD, automated testing, code quality, secure software delivery, and tools such as GitLab CI, Jenkins, SonarQube, Trivy, and Semgrep.
- Experience with observability and operational analytics platforms such as CloudWatch, Grafana, Datadog, Prometheus, and OpenTelemetry.
- Understanding of cloud security, IAM, OAuth2, JWT authentication, encryption, Secrets Manager, vulnerability management, audit logging, and compliance controls.
- Strong problem-solving skills and experience with production support, incident management, root-cause analysis, and performance optimization.
- AWS certifications and experience in Quote-to-Cash, CRM, ERP, customer lifecycle management, or enterprise data domains are preferred.
Benefits
- Healthcare, retirement planning, paid volunteering days, and wellbeing initiatives.
- Collaborative and creative culture with opportunities to contribute ideas.
- Equal-opportunity employer with reasonable accommodations for religious practices, mental health, and physical or disability-related needs.
- Role associated with LSEG’s recognized Great Place to Work® status in India.
Tech Stack
Amazon DynamoDBApache KafkaAWSClickHouseDatadogGitLab CI/CDGoGrafanaJenkinsPostgreSQLPrometheusPythonRabbitMQSnowflakeSonarQube
Categories
BackendData Engineering
About London Stock Exchange Group
London Stock Exchange Group (LSEG) provides market infrastructure, financial data, and analytics to banks, asset managers, and corporations. Its businesses span capital markets (London Stock Exchange), post-trade clearing (LCH), and information services including FTSE Russell indices and the Refinitiv data platform, funded by transaction fees, subscriptions, and licensing. Headquartered in London and publicly listed on the LSE, the group serves global customers seeking trading, clearing, benchmarks, and enterprise data solutions.