4 months ago
Base Salary
$126k - $189k/yr
Responsibilities
- Develop scalable Hadoop-based data solutions aligned with enterprise data strategy and best practices.
- Build and manage complex batch and real-time data pipelines using Hadoop, Apache Kafka, Spark, and related technologies.
- Optimize Hadoop clusters and streaming applications for throughput, latency, scalability, and resource utilization.
- Maintain and monitor data and streaming infrastructure for availability, reliability, and data integrity.
- Implement data security and governance policies consistent with banking-sector regulatory and compliance standards.
- Develop solutions for near-real-time ingestion, advanced analytics, comprehensive reporting, and data warehousing.
- Contribute to AI/ML model implementation through data preparation, feature engineering, and production deployment.
- Participate in MLOps initiatives covering continuous integration, continuous delivery, and continuous training.
- Use AI coding tools and recommend AI-first solutions to improve development efficiency and team capabilities.
- Troubleshoot complex platform and streaming issues, mentor less experienced team members, and collaborate with engineers and scientists.
- Own end-to-end delivery of data initiatives from conceptualization through implementation, testing, and deployment.
Requirements
- 7+ years of experience developing, implementing, and optimizing complex Hadoop-based and real-time data platforms.
- Hands-on experience with AI/ML, modern AI coding tools, ML models, and tools such as Devin and Copilot.
- Strong knowledge of Hadoop ecosystem components including HDFS, YARN, MapReduce, Hive, HBase, FastAPI, and Spark.
- Extensive Apache Kafka and real-time streaming experience, including performance optimization.
- Strong hands-on knowledge of Python, PySpark, FastAPI, Unix, and SQL.
- Familiarity with AWS, Azure, and Google Cloud.
- Experience with advanced data modeling, dimensional modeling, complex ETL/ELT processes, and data warehousing.
- Understanding of AI/ML lifecycle management, MLOps, and integrating machine learning models into data solutions.
- Experience with Generative AI concepts and tools is advantageous.
- Proven end-to-end delivery experience for complex data initiatives.
- Strong banking or financial-services domain knowledge, including relevant data standards and regulations.
- Ability to work autonomously, solve complex problems, communicate technical concepts, and mentor others.
- Bachelor’s or university degree, or equivalent experience; a master’s degree is preferred.
Benefits
- Full-time role located in Irving, Texas.
- Salary range of $125,760.00 to $188,640.00 per year.
- Eligible employees may receive discretionary and formulaic incentive and retention awards.
- Benefits may include medical, dental, and vision coverage; 401(k); life, accident, and disability insurance; and wellness programs.
- Paid time off may include vacation, sick leave, and paid holidays.
Tech Stack
Apache HadoopApache HBaseApache HiveApache KafkaApache SparkAWSAzureFastAPIGoogle CloudPythonSQLYarn
Categories
Data EngineeringML Engineering
About Citi
Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.