Kafka Senior Engineer - Officer
State Street2 days ago
Bengaluru, IndiaSenior
Responsibilities
- Design, engineer, and promote Kafka messaging platforms across the enterprise.
- Lead the design and engineering of Kafka clusters on public cloud using Ansible, Terraform, and Python.
- Develop automation for request processing, installations, health checks, monitoring, alerting, reporting, and predictive analytics.
- Write and test Kafka producer and consumer code and establish Kafka application best practices.
- Configure, test, and develop Kafka Connectors for integrating Kafka with other systems.
- Optimize and tune Kafka systems and design platform monitoring and statistical reporting solutions.
- Provide final-level production support, troubleshoot complex issues, and identify root causes in Kafka and related applications.
- Lead collaboration with application, architecture, and infrastructure teams to deliver resilient and scalable messaging platforms.
- Create integration standards, onboarding processes, documentation, SOPs, and cross-training materials.
- Conduct technical reviews of Kafka integration implementations across all SDLC phases.
Requirements
- Strong programming and automation experience with the ability to write robust, fault-tolerant, well-tested code.
- Willingness to learn or use Python, Ansible, Terraform, Puppet, and Shell; experience with source code control systems.
- Experience working with Red Hat Linux.
- Deep understanding of Kafka Messaging or another messaging technology, including troubleshooting and system tuning.
- Experience supporting application architectures such as SEDA, Kappa, Lambda, or similar.
- Experience with high availability and disaster recovery solutions for middleware or other platforms.
- Computer science degree preferred but not required depending on the candidate.
- 8+ years of experience preferred but not required depending on the candidate.
- Ability to drive projects, collaborate across engineering teams, and troubleshoot complex issues at L4 level.
Benefits
- Fully office-based with no hybrid working; locations are Bangalore or Hyderabad, and candidates must be willing to relocate.
- APAC or EMEA work schedule; occasional weekend work may be required for production deployments or changes.
- Competitive and comprehensive benefits may include medical care, insurance, savings plans, flexible work support, development programs, and educational support.
- Paid volunteer days, matching gift programs, employee networks, and work-life support are available.
About State Street
State Street is a global custodian bank and asset manager serving institutional investors with investment servicing, fund accounting, trading/FX, data, and index/active strategies. Its products include State Street Global Advisors’ funds and ETFs, the Charles River Investment Management Solution, and the front-to-back State Street Alpha platform. Founded in 1792 and headquartered in Boston, the company is publicly traded on the NYSE (ticker: STT) and operates across major markets worldwide.