Software Engineering - Data, Lakehouse and AI Data Platform Engineer-Bangalore-Associate
Goldman Sachs6 days ago
Bengaluru, IndiaMid Level
Responsibilities
- Build, enhance, refactor, and support batch and streaming data pipelines in production.
- Develop raw, refined, and curated datasets for analytics, reporting, and AI use cases.
- Apply data modeling, schema design, schema evolution, partitioning, clustering, and optimization techniques.
- Implement data quality controls, reconciliation processes, testing, monitoring, and issue resolution.
- Build reusable tooling and framework components that improve delivery consistency and platform operations.
- Collaborate with data consumers and partner teams to deliver documented, reliable data products.
- Contribute to technical design, engineering standards, code quality, and delivery leadership across workstreams.
Requirements
- At least 3 years of professional experience.
- Bachelor’s or master’s degree in a relevant discipline, or equivalent practical experience, with strong quantitative or data engineering expertise.
- Strong hands-on programming experience in Python or Java.
- Good working knowledge of SQL, including troubleshooting, optimization, and data analysis.
- Experience building or supporting production data pipelines in a collaborative engineering environment.
- Experience with distributed data processing frameworks such as Apache Spark.
- Knowledge of temporal data modeling, schema design and evolution, data compatibility, performance optimization, data quality, reconciliation, and root-cause analysis.
- Familiarity with JSON, Avro, Parquet, Kafka, Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, or Sybase IQ.
- Understanding of software engineering fundamentals including version control, testing, release discipline, and CI/CD practices.
- Ability to guide implementation standards, lead delivery for a workstream, manage dependencies, and support less experienced engineers.
Tech Stack
Categories
Data Engineering
About Goldman Sachs
Goldman Sachs is a global financial services firm that provides investment banking, securities trading, and asset and wealth management to corporations, financial institutions, governments, and individuals. Its businesses generate revenue from advisory and underwriting fees, trading and financing, and management fees on client assets. Founded in 1869 and headquartered in New York City, it operates worldwide and is listed on the NYSE under the ticker GS.