2 days ago
Pune, IndiaSenior
Responsibilities
- Design, implement, and maintain scalable batch and streaming data pipelines using Apache Spark, Java/Scala, and PySpark.
- Develop high-level and low-level designs, data-flow diagrams, interface specifications, and data-modeling artifacts.
- Perform data sourcing, cleansing, enrichment, reconciliation, schema evolution, transformation, quality validation, and analytical insight generation.
- Write and optimize complex Spark SQL queries, joins, window functions, partitioned datasets, and transformations for large enterprise datasets.
- Build enterprise services and data-ingestion microservices using Spring and Spring Boot.
- Implement automated build, test, and deployment workflows using Git, GitHub, Jenkins/Lightspeed, and Harness.
- Use GitHub Copilot and Devin AI for prototyping, code review, test generation, refactoring, and documentation.
- Collaborate with product owners, data analysts, business teams, and quality assurance to deliver solutions.
- Identify vulnerabilities and security issues, conduct testing and debugging, and resolve application and data-processing issues.
- Advise or coach new or lower-level analysts and operate with limited direct supervision.
Requirements
- Bachelor’s degree or university degree, or equivalent experience.
- At least 5 years of hands-on software and data engineering experience is listed, with 7+ years expected; the stated experience range is 5–9 years.
- Advanced proficiency in Java and/or Scala and strong object-oriented and functional programming skills.
- Deep practical expertise in Apache Spark architecture, including RDDs, DataFrames, Datasets, execution plans, memory management, partitioning, and performance tuning.
- Strong Python and practical PySpark experience for data transformations.
- Expert SQL and Spark SQL skills, including window functions, complex joins, indexing, and query-plan analysis with EXPLAIN.
- Experience creating maintainable HLD and LLD documents, technical specifications, data-flow diagrams, and data-modeling artifacts.
- Hands-on experience with GitHub or Bitbucket, Jenkins/Lightspeed, and Harness.
- Experience using AI development tools such as GitHub Copilot or Devin AI.
- Experience with automated unit and integration testing, TDD, SonarQube quality gates, and secure coding standards.
- Strong communication, analytical reasoning, ownership, and problem-solving skills.
- Tableau or similar BI visualization experience is preferred; banking, financial services, liquidity reporting, regulatory data, or risk-management experience is also preferred.
Benefits
- Full-time position.
- Equal opportunity employer with reasonable accommodation support available.
Tech Stack
Categories
BackendData Engineering
About Citi
Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.