3 days ago
Hyderābād, IndiaStaff+
Responsibilities
- Advise a portfolio of stream-aligned data domain teams on domain architecture and platform adoption.
- Translate business data requirements into concrete ingestion and pipeline architectures before implementation.
- Design Databricks architectures covering medallion layers, Delta Lake tables, incremental processing, and Unity Catalog.
- Translate domain needs into platform backlog items, paved-road improvements, and architecture decision records.
- Identify reusable patterns and develop templates, accelerators, reference architectures, and onboarding runbooks.
- Review architecture designs against platform principles, quality gates, and certification criteria.
- Ensure data quality checks and observability instrumentation are included in pipeline designs.
- Contribute to ingestion standards, guardrails, and platform evolution.
- Mentor senior engineers and contribute to the broader Data Platform technical community.
Requirements
- 10+ years of software engineering experience with deep expertise in data engineering or data architecture and a record of delivering production data platforms at scale.
- Experience in financial services or with financial market data systems.
- Hands-on experience creating data models and taxonomies.
- Deep hands-on expertise with Databricks, Databricks Workflows, Delta Lake, and Unity Catalog.
- Strong proficiency in Python and SQL for pipeline design, proof-of-concept implementation, and design review.
- Experience designing medallion architectures and incremental processing strategies including CDC, streaming ingestion, micro-batch, and merge/upsert patterns.
- Experience engaging engineering teams and translating business data requirements into architectural designs.
- Experience producing ADRs, reference architectures, pipeline blueprints, and maintainable design patterns.
- Experience with streaming platforms such as Apache Kafka, AWS Kinesis, or Confluent.
- Experience with open table formats including Delta Lake, Apache Iceberg, and Apache Hudi.
- Familiarity with AWS data infrastructure including S3, Glue, EMR, and Kinesis.
- Experience onboarding relational databases, event streams, flat files, and external APIs into lakehouse architectures.
- Understanding of data contracts, versioned schemas, data mesh, and data fabric patterns.
- Experience with Apache Spark and distributed data processing at scale.
- Background in cloud data-processing cost optimization, storage tiering, partition design, and compute scaling.
- Familiarity with DataOps practices and platform engineering approaches for data infrastructure.
- Certifications in Databricks, AWS, or related technologies are desired.
- Strong collaboration, stakeholder alignment, communication, and mentoring abilities.
Tech Stack
Categories
Data Engineering
About FactSet
FactSet builds a financial data and analytics platform used by asset managers, investment banks, hedge funds, and wealth managers for research, portfolio management, trading, and risk. Its products include the FactSet workstation, data feeds and APIs, and workflow tools like OMS/EMS, sold primarily via subscription licensing. Founded in 1978 and headquartered in Norwalk, Connecticut, FactSet is a public company listed on the NYSE (ticker: FDS).
