22 days ago
Pune, IndiaSenior
Responsibilities
- Design, develop, test, and support scalable ETL and data-processing pipelines using Python, PySpark, Microsoft BI/SSIS, and SQL.
- Develop and optimize complex SQL queries, stored procedures, functions, data transformations, and database objects for high-volume applications.
- Analyze query execution plans, indexing, statistics, locking, blocking, and database design to resolve performance issues.
- Build and support large-scale data solutions across SQL Server and distributed platforms including Hadoop, HDFS, and Hive.
- Apply relational, dimensional, data-warehouse, and 3NF modeling principles to scalable data solutions.
- Troubleshoot failed jobs, data-quality issues, performance problems, and production incidents; perform root-cause analysis and implement lasting fixes.
- Develop and support enterprise batch-processing workflows using scheduling and orchestration platforms such as AutoSys.
- Implement validation, reconciliation, exception handling, logging, monitoring, audit controls, and data-quality checks in pipelines.
- Participate in code reviews and maintain development standards for SQL, Python/PySpark, ETL, and data-processing components.
- Use Git-based source control and participate in CI/CD processes, with Docker and Kubernetes where applicable.
- Follow secure data-development, access-control, encryption, and organizational security requirements.
- Collaborate with application developers, infrastructure teams, business teams, and other technology groups.
- Evaluate technologies and use approved AI-assisted development tools to improve code quality, troubleshooting, refactoring, and productivity.
- Mentor or provide technical guidance to other developers and assess risk in business and technology decisions.
Requirements
- 8+ years of relevant experience in data engineering, application development, database development, or related technology roles.
- Strong hands-on experience with Python and PySpark for large-scale data processing and ETL development.
- Strong proficiency in SQL/T-SQL and relational database technologies, preferably Microsoft SQL Server.
- Experience developing and supporting complex SQL queries, stored procedures, database objects, and high-volume data-processing solutions.
- Strong understanding of SQL Server performance tuning, including execution plans, indexing, statistics, joins, locking/blocking, and query optimization.
- Experience with Microsoft BI/SSIS or comparable enterprise ETL technologies.
- Experience with large datasets and distributed data platforms such as Hadoop, HDFS, and Hive.
- Strong understanding of ETL architecture, data warehousing, dimensional modeling, and relational/3NF modeling.
- Experience implementing data-quality checks, reconciliation, audit controls, exception handling, and production monitoring.
- Experience with enterprise scheduling and orchestration tools such as AutoSys.
- Experience with Git, CI/CD, and modern development practices.
- Familiarity with Docker and Kubernetes is preferred.
- Familiarity with NoSQL technologies such as MongoDB is beneficial.
- Strong analytical, troubleshooting, communication, and problem-solving skills.
- Ability to work independently on complex technical assignments while collaborating effectively across teams.
- Bachelor’s degree or equivalent experience.
Benefits
- Full-time position.
- Education flexibility allows a bachelor’s/university degree or equivalent experience.
Tech Stack
Categories
Data Engineering
About Citi
Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.