2 months ago
Tampa, FL, USASenior / Staff+
H1B sponsor
Base Salary
$97k - $145k/yr
Responsibilities
- Design and implement Apache Spark applications to process and transform large datasets in HDFS.
- Develop Python-based ETL pipelines for data ingestion, cleaning, aggregation, and transformation.
- Optimize Spark jobs through memory management, caching, partitioning, and other performance-tuning techniques.
- Load data from multiple sources into HDFS while ensuring accuracy and integrity.
- Integrate Spark applications with Hadoop frameworks and tools including Hive and Sqoop.
- Troubleshoot and debug Spark job failures and monitor job logs and Spark UI.
- Collaborate with data engineers, analysts, and business stakeholders to support data-driven decisions.
Requirements
- 5–8 years of relevant software development experience.
- Deep understanding of data engineering principles.
- Proficiency in Python and hands-on experience with Apache Spark and Hadoop ecosystems.
- Experience with systems analysis and programming of software applications.
- Experience managing and implementing successful projects.
- Working knowledge of consulting and project management techniques and methods.
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements.
- Bachelor’s degree or university degree, or equivalent experience.
Benefits
- Full-time position based in Tampa, Florida.
- Medical, dental, and vision coverage.
- 401(k) benefits.
- Life, accident, and disability insurance.
- Wellness programs.
- Paid vacation, sick leave, and holidays.
Tech Stack
Categories
Data Engineering
About Citi
Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.