Data Platform Engineer officer
State StreetResponsibilities
- Design and build backend services and shared libraries for streaming and batch ingestion, metadata-driven pipelines, API integrations, transformations, and master data management.
- Develop reusable platform components using open formats, catalog systems, and distributed query engines.
- Implement role-based access control, authentication, enterprise-entitlement integrations, and other platform security controls.
- Build observability capabilities including logging, metrics, traces, alerting, and operational dashboards to support SLAs.
- Collaborate with architects and engineering teams on scalable, extensible designs and adherence to open standards.
- Drive code reviews, automated testing, CI/CD, production-readiness practices, and security and compliance requirements.
- Participate in on-call and major incident management and troubleshoot production issues to maintain platform stability.
Requirements
- Strong programming skills in Python and Java; Rust knowledge is a bonus.
- Strong Spark programming skills with hands-on optimization and debugging experience.
- Hands-on experience with Snowflake and Databricks as data platforms.
- Strong understanding of SQL optimization, execution, and large-scale analytics.
- Deep understanding of distributed computing and hyperscale systems.
- Experience building production-grade services in cloud environments; AWS, GCP, and/or Azure experience is preferred.
- Familiarity with data catalogs such as Polaris, Horizon, or Unity Catalog and with metadata management.
- Familiarity with streaming pipelines and Kafka is preferred.
- Understanding of data modeling and data product design.
- Experience with CI/CD, containers, and Kubernetes.
- Experience with Apache Iceberg and a financial or data-platform background are preferred but not required.
Benefits
- Inclusive development opportunities, flexible work-life support, paid volunteer days, and employee networks.
- The posting describes an inclusive equal-opportunity workplace.
Tech Stack
Categories
About State Street
At State Street, we deliver leading investment platforms, data, expertise, and solutions that accelerate performance and better decision making. With over 200 years of global financial leadership, we equip institutional investors through a comprehensive suite of capabilities: Investment Services: Integrated front-to-back solutions across custody, accounting, and operations. Investment Management: Index and active strategies from one of the world’s largest asset managers. Markets: Multi-asset trading, FX solutions, and data-driven research to enhance portfolio value. Who We Are • 50,000+ employees worldwide • Active in 100+ markets • #1 in ETF servicing What You’ll Find Here • Executive perspectives and thought leadership • Timely market commentary and macro insights • Our views on investment operations, ETFs, private markets, and digital finance • Stories reflecting our culture, values and commitment to diversity and inclusion