Lead Software Engineer
Mitsubishi UFJ Financial Group1 day ago
Bengaluru, IndiaStaff+
Responsibilities
- Design, develop, enhance, and maintain ETL mappings, workflows, data pipelines, and UNIX/Linux shell scripts in data warehouse and data lake environments.
- Build batch, real-time, and near-real-time integrations using IDMC or comparable integration technologies.
- Develop and optimize SQL and database solutions, data models, data warehouses, data marts, and data-quality controls.
- Build reusable Python, Java, and scripting components for data processing, orchestration, validation, automation, and operational support.
- Design and deliver enterprise RAG, semantic-search, knowledge-base, document-intelligence, and conversational “chat with data” solutions.
- Create knowledge-ingestion pipelines covering document parsing, chunking, metadata enrichment, embeddings, indexing, retrieval, citations, and source traceability.
- Apply prompt engineering, hybrid search, reranking, context management, and retrieval evaluation to improve answer quality and reduce unsupported responses.
- Implement responsible-AI, model-risk, privacy, security, access-control, human-review, auditability, monitoring, and confidential-data safeguards.
- Design and support AWS-based data and AI architectures using data, integration, security, serverless, and observability services.
- Produce functional and technical designs, data mappings, interface specifications, runbooks, and operational documentation.
- Coordinate with technical, testing, operations, governance, compliance, and business stakeholders to deliver controlled solutions.
- Support production rollouts, resolve defects and incidents, lead root-cause analysis, and implement preventive remediation.
- Mentor engineers, conduct design and code reviews, and promote engineering standards and reusable patterns.
Requirements
- Bachelor’s degree or foreign equivalent in Information Technology, Information Systems, Computer Science, Software Engineering, or a related field.
- 10–15 years of hands-on experience in data engineering, ETL, databases, SQL, and UNIX/Linux environments.
- 8+ years of data-integration experience in a lead or senior engineering role, preferably in banking or financial services.
- 6+ years of experience designing, developing, and supporting scalable data pipelines and data-processing solutions using AWS services.
- 8+ years of experience with IDMC or a comparable enterprise ETL/data-integration platform.
- 5+ years of programming or scripting experience using Python, Java, or a comparable language.
- Strong relational-database and advanced-SQL experience, including performance tuning and troubleshooting.
- Experience with Generative AI, embeddings, vector search, RAG architecture, knowledge bases, prompt engineering, and LLM integration patterns.
- Hands-on experience delivering a RAG, semantic-search, conversational-AI, or enterprise-knowledge-base solution from proof of concept through production.
- Experience with Amazon Bedrock knowledge bases or agents, Amazon SageMaker, Amazon OpenSearch, PostgreSQL/pgvector, LangChain, LlamaIndex, or comparable platforms.
- Experience with document-processing services and libraries, including OCR, layout-aware extraction, chunking, metadata management, and source citation.
- Knowledge of LLMOps/MLOps, prompt and model versioning, automated evaluation, observability, feedback loops, performance monitoring, and cost controls.
- Understanding of data governance, AI governance, model risk, privacy, security, and financial-services regulatory expectations.
- Experience with ER/Studio, JIRA, enterprise schedulers such as Autosys, and Agile/Waterfall delivery methods.
- Experience with Big Data and streaming technologies such as Spark, Kafka, Hadoop, Hive, Kinesis, or EMR.
- Experience with Terraform or another infrastructure-as-code tool and CI/CD pipelines.
- Strong communication, facilitation, analytical, and stakeholder-management skills.
- Financial-services or banking-industry experience is preferred.
Tech Stack
Amazon RedshiftApache HadoopApache HiveApache KafkaApache SparkAWSJavaLinuxMicrosoft SQL ServerPostgreSQLPythonTerraform
Categories
AI ApplicationsData Engineering
About Mitsubishi UFJ Financial Group
Mitsubishi UFJ Financial Group is a publicly traded Japanese banking group headquartered in Chiyoda, Tokyo, offering commercial and investment banking, trust banking, securities, credit cards, consumer finance, asset management, and leasing to consumers, corporations, and institutions. It generates revenue from lending interest, transaction fees, and investment services. Formed in 2005 through the merger of Mitsubishi Tokyo Financial Group and UFJ Holdings, MUFG operates globally across the Americas, EMEA, and Asia-Pacific markets.