18 hours ago
Pune, IndiaSenior / Staff+
Responsibilities
- Translate application storyboards and use cases into functional applications.
- Design, build, and maintain efficient, reusable, and reliable Python and Scala code.
- Develop high-performance and low-latency components for Spark clusters.
- Tune application performance, identify bottlenecks and bugs, and devise solutions.
- Interpret functional requirements into designs for big data platforms.
- Process and analyze large datasets using Hive, Impala, and HBase.
- Test software prototypes and transfer them to operational teams.
- Propose engineering best practices and standards and collaborate with global teams.
Requirements
- 8 to 12 years of experience.
- Strong experience with one or more programming languages, including Python and Spark.
- Experience with application performance tuning, troubleshooting, and big data implementation.
- Experience with HDFS, MapReduce, YARN, Apache Spark, and Hive.
- Familiarity with Avro, Parquet, CSV, and JSON data formats.
- Strong systems analysis, design, architecture, scalable application design, and software development lifecycle fundamentals.
- Experience with UNIX/Linux and shell scripting.
- Good knowledge of database principles and SQL.
- Experience with Agile/Scrum, Git, and Jira.
- Experience with NoSQL databases and build or continuous integration tools such as Maven, Jenkins, or TeamCity.
- Familiarity with cloud and container technologies.
- Experience with real-time data processing using Kafka.
Tech Stack
Categories
Data Engineering
About Citi
Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.