10 days ago
Hyderābād, IndiaSenior
Responsibilities
- Develop and maintain pipelines extracting data from RDBMS, change data capture sources, and streaming endpoints.
- Process observability, banking, account, and transaction data securely and compliantly.
- Transform raw data into business-ready analytical models on a Data Lakehouse.
- Own data consistency, quality, governance, freshness, and lifecycle controls.
- Ingest and maintain a large versioned documentation corpus with incremental synchronization, change tracking, deduplication, and freshness management.
- Build and maintain MCP tools that allow AI agents to query documentation, API specifications, and release history.
- Build or maintain retrieval, vector, and hybrid search capabilities for AI products.
- Operate pipelines with automated tests, CI/CD, observability, code review, and environment promotion across Fabric and Databricks.
- Drive projects end to end and collaborate directly with stakeholders and other value streams.
Requirements
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- 5+ years of data engineering experience, preferably with Microsoft Fabric, Azure Databricks, or Spark.
- Expertise in Data Lakehouse concepts and Delta Lake.
- Working knowledge of data regulation and compliance.
- Strong technical leadership and ability to independently drive work end to end.
- Excellent written and verbal communication skills in English.
- Proactive, autonomous, and self-sufficient working style.
- Deep Python and SQL skills, including pipeline and query performance optimization.
- Experience with data contracts and self-service data platforms is a plus.
- Production BI experience, such as Power BI, is a plus.
- Machine learning fundamentals and experience collaborating with AI engineers are a plus.
- Retrieval and vector search experience is a plus.
- Experience preparing data for model training or fine-tuning, including sensitive-data anonymization, is a plus.
- Experience instrumenting retrieval quality is a plus.
Tech Stack
Categories
Data Engineering
About Backbase
Backbase builds an AI-native digital banking platform for financial institutions to unify customer and employee experiences across digital channels. It licenses its Banking OS and related services to banks for onboarding, lending, and core modernization initiatives. Founded in 2003 and headquartered in Amsterdam, it is privately held and used by more than 120 banks worldwide.