Data Platform - Capability Engineer - Assistant Vice President
State Street21 hours ago
Bengaluru, IndiaStaff+
Responsibilities
- Design, build, and operate modern data platform capabilities across lakehouse, batch, streaming, metadata/catalog, observability, security, and governed consumption layers.
- Develop scalable batch and streaming pipelines using Apache Spark, Snowflake, and/or Databricks.
- Implement and optimize Apache Iceberg tables and open data formats through partitioning, compaction, metadata management, and cross-engine performance tuning.
- Apply software and data engineering practices including infrastructure as code, automated testing, schema and version management, data quality controls, and end-to-end observability.
- Define data semantics, data product contracts, schemas, SLAs, documentation, access controls, and governed serving models with cross-functional stakeholders.
- Engineer governance capabilities covering lineage, permissions, entitlement enforcement, sensitive-data classification, masking/tokenization, auditability, and policy-based controls.
- Create AI-ready data assets and optimize platform performance and cost through tuning, partitioning, clustering, caching, lifecycle management, retention, purge strategies, and query optimization.
- Own operational stability through production troubleshooting, backfills, incident response, root-cause fixes, and reliability improvements.
- Provide technical leadership for a small team or pod, including planning, mentoring, delivery oversight, engineering standards, and operational excellence.
Requirements
- 14+ years of software or data engineering experience.
- BS or MS in Computer Science or Engineering, or equivalent experience.
- Strong hands-on coding ability in Python and SQL; Java or Scala is a plus.
- Proven delivery of lakehouse or data platform solutions using Databricks and/or Snowflake on AWS; GCP or Azure experience is acceptable.
- Strong Apache Spark batch and streaming development experience, including performance and cost tuning.
- Experience with Apache Iceberg and table/catalog governance concepts such as Unity Catalog or equivalent.
- Experience with CI/CD, infrastructure as code using Terraform or CloudFormation, automated testing, security fundamentals, and observability.
- Operational ownership experience including on-call support, incident response, root-cause analysis, backfills, and reliability improvements.
- Strong communication skills with global teams.
- Financial services experience is preferred, particularly asset management.
- Experience with structured and alternative/unstructured data and governance tools such as Snowflake Horizon, Unity Catalog, Collibra, or Alation is preferred.
- Experience using AI-assisted coding tools such as GitHub Copilot or Claude Code while maintaining code quality is preferred.
Benefits
- Inclusive development opportunities, flexible work-life support, paid volunteer days, and employee networks are offered.
- The role is based in the State Street Investment Management office in Bangalore, India.
Tech Stack
Categories
Data Engineering
About State Street
State Street is a global custodian bank and asset manager serving institutional investors with investment servicing, fund accounting, trading/FX, data, and index/active strategies. Its products include State Street Global Advisors’ funds and ETFs, the Charles River Investment Management Solution, and the front-to-back State Street Alpha platform. Founded in 1792 and headquartered in Boston, the company is publicly traded on the NYSE (ticker: STT) and operates across major markets worldwide.