
Enterprise Data & Cloud Engineering Lead, State Street Investment Management, Vice President
State Street1 day ago
Bengaluru, IndiaStaff+
Responsibilities
- Lead the design and delivery of production-grade Python and Java applications, Streamlit solutions, scripts, reusable libraries, frameworks, and automation for enterprise data processing.
- Architect scalable ETL/ELT pipelines, batch and file-processing solutions, API integrations, and data services.
- Provide hands-on technical leadership through solution design, critical coding, code reviews, troubleshooting, and engineering guidance.
- Establish standards for modular design, packaging, automated testing, exception handling, logging, observability, security, maintainability, and operational resilience.
- Design integration patterns across Databricks, Snowflake, Amazon Redshift, Oracle, PostgreSQL, Sybase, APIs, and cloud-native services.
- Modernize legacy scripts, stored-procedure-heavy workflows, and database-centric processing into supportable data-engineering patterns.
- Build reusable capabilities for data validation, reconciliation, control totals, data quality, lineage, and production support.
- Drive source control, CI/CD, release practices, and automated quality checks through Git-based workflows.
- Partner with architecture, database, cloud, security, data governance, and application teams to deliver secure, governed, and supportable solutions.
- Ensure performance, resilience, recoverability, monitoring, and operational support requirements are met.
- Mentor engineers, raise engineering maturity, and promote common development patterns across global teams.
- Communicate technical decisions, risks, dependencies, and delivery options to engineering teams and senior stakeholders.
Requirements
- Expert-level Python engineering experience, including software design, reusable components, performance optimization, and production support.
- Advanced SQL, data modeling, relational database, and large-scale data-processing experience.
- Hands-on experience with pandas and/or PySpark, REST API integrations, JSON and file-processing solutions, and reliable batch or event-driven pipelines.
- Practical experience with Databricks, Snowflake, and/or Amazon Redshift, plus enterprise databases such as Oracle, PostgreSQL, and/or Sybase.
- Strong knowledge of Git, CI/CD, automated testing, Linux/Unix, observability, and production engineering.
- Ability to diagnose complex performance, data-quality, and production issues across application, database, and pipeline layers.
- Experience with cloud-native technologies, microservices, containerization, API services, and OIDC-secured user interfaces.
- Understanding of ontology, semantics, enterprise data catalogs, access governance, and regulated-environment controls.
- Exposure to TOGAF or similar architecture frameworks, architecture reviews, implementation governance, and standards development.
- Strong technical leadership, collaboration, and concise communication across architecture, engineering, and business teams.
- Bachelor's or master's degree in computer science, engineering, information technology, or a related technical field.
- 15+ years of technology engineering experience, including substantial data or software engineering delivery experience.
- 10+ years of hands-on Python and SQL development in production environments; Java experience is beneficial.
- 7+ years leading technical design and engineering delivery for data platforms, integration services, or large-scale data pipelines.
- 7+ years of experience with public cloud and/or modern data platforms such as AWS, Azure, GCP, Databricks, or Snowflake.
- Experience designing, deploying, and supporting enterprise workloads across cloud and on-premises environments.
- Experience leading or mentoring engineers across multiple workstreams or delivery locations.
- Working knowledge of Agile delivery methods, including Scrum and Kanban, and tools such as Jira and Confluence.
- Cloud, Databricks, Snowflake, or architecture certifications are beneficial but not required.
- Financial services or other regulated-industry experience is preferred.
Benefits
- Inclusive development opportunities, flexible work-life support, paid volunteer days, and employee networks are provided.
- The posting does not state a work arrangement, contract duration, or compensation details.
Tech Stack
Amazon RedshiftAWSAzureDatabricksGitGoogle Cloud PlatformJavaLinuxPandasPostgreSQLPythonSnowflakeSQL
Categories
BackendData Engineering
About State Street
State Street is a global custodian bank and asset manager serving institutional investors with investment servicing, fund accounting, trading/FX, data, and index/active strategies. Its products include State Street Global Advisors’ funds and ETFs, the Charles River Investment Management Solution, and the front-to-back State Street Alpha platform. Founded in 1792 and headquartered in Boston, the company is publicly traded on the NYSE (ticker: STT) and operates across major markets worldwide.