3 months ago
Base Salary
$142k - $213k/yr
Responsibilities
- Build and maintain scalable PySpark data pipelines for large volumes of structured and unstructured data.
- Design and develop data solutions across Hadoop, Hive, HDFS, Sqoop, Spark, Impala, and Scala.
- Develop and manage real-time and batch workflows with high availability and low-latency delivery.
- Write complex SQL queries for data extraction, validation, transformation, and analysis across distributed systems.
- Design scalable data models and architecture patterns aligned with data warehouse and dimensional modeling principles.
- Automate pipeline scheduling and orchestration using shell scripting and Autosys or equivalent tools.
- Identify, assess, and resolve technical risks and data issues while maintaining data platform integrity.
- Lead application systems analysis and programming activities, define system enhancements, and ensure alignment with architecture standards.
- Advise and coach mid-level developers and analysts and allocate work as needed.
- Partner with management teams and communicate technical concepts to technical and non-technical audiences.
Requirements
- 6–10 years of relevant experience in applications development or systems analysis.
- Hands-on expertise in PySpark and Big Data processing, including distributed workflow optimization at scale.
- Production experience with the Hadoop ecosystem, including Hive, HDFS, Sqoop, Spark, Impala, and Scala.
- Proficiency in complex SQL development for analysis, transformation, and validation of large datasets.
- Strong understanding of distributed systems architecture, data modeling, data design, data warehouses, and dimensional modeling.
- Experience with shell scripting and Autosys or equivalent workflow automation tools.
- Strong analytical, problem-solving, communication, leadership, and project management skills.
- Bachelor’s or university degree, or equivalent experience; a master’s degree is preferred.
- Familiarity with Apache Kafka or equivalent streaming technologies, cloud-based Big Data environments, modern data lakes, financial services, or regulated industries is beneficial.
Benefits
- Full-time position based in Jersey City, New Jersey.
- Medical, dental, and vision coverage.
- 401(k), life, accident, and disability insurance.
- Wellness programs, vacation, sick leave, and paid holidays.
- Eligible employees may receive discretionary and formulaic incentive and retention awards.
Tech Stack
Categories
Data Engineering
About Citi
Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.