8 days ago
Irving, TX, USAMid Level
H1B sponsor
Base Salary
$85k - $118k/yr
Responsibilities
- Design, implement, and maintain end-to-end batch and real-time data pipelines using Python, PySpark, Databricks, and Snowflake.
- Migrate, manage, and optimize legacy Hadoop datasets and workloads for modern cloud data platforms.
- Optimize pipeline performance, query execution, resource allocation, and storage costs across distributed environments.
- Collaborate with business analysts, data scientists, and functional stakeholders to define requirements and analytical approaches.
- Deliver actionable insights and use structured root-cause analysis to resolve data anomalies, pipeline bottlenecks, and logic issues.
- Create automated data validation, reconciliation, and data-quality monitoring frameworks.
- Use Devin, GitHub Copilot, Cursor, and other AI developer assistants in development, code review, testing, documentation, refactoring, prototyping, and debugging.
- Follow Git-based version control, CI/CD release practices, code-quality gates, and automated test coverage.
- Ensure data pipelines and storage comply with governance, lineage, information-security, regulatory, and data-integrity standards.
- Author technical design documents, data dictionaries, and operational runbooks.
Requirements
- At least 2 years of progressive experience in data engineering, big-data analytics, or a related technical role.
- Bachelor’s or Master’s degree in computer science, data analytics, information technology, statistics, engineering, or a related quantitative field, or equivalent practical experience.
- Advanced Python proficiency, including Pandas, PySpark, and NumPy, with knowledge of object-oriented programming, data structures, and modular design.
- Strong hands-on experience with large-scale distributed data transformations using PySpark and Databricks.
- Expertise in Snowflake architecture and SnowSQL, including Snowpipe, Tasks, Streams, clustering, and query profiling.
- Strong understanding of Hadoop ecosystems, including HDFS, Hive, MapReduce, and YARN, plus experience migrating Hadoop workloads to cloud architectures.
- Expert SQL skills involving complex queries, window functions, and dimensional and relational data modeling.
- Practical experience with AI coding agents and assistants such as Devin, GitHub Copilot, and Cursor.
- Ability to solve complex analytical problems, design scalable technical solutions, and communicate findings to diverse stakeholders.
- Familiarity with workflow orchestration tools such as Apache Airflow, Prefect, or Databricks Workflows is preferred.
- Experience with Git, Jenkins, Tekton, or Harness and basic Docker knowledge are preferred.
- Exposure to financial-services, banking, risk, or compliance data platforms is preferred.
- Familiarity with DataOps, test-driven development, and automated data-quality frameworks such as Great Expectations is preferred.
Benefits
- Full-time position based in Irving, Texas.
- Annual base salary range of $84,580 to $118,020.
- Medical, dental, and vision coverage.
- 401(k), life, accident, and disability insurance.
- Wellness programs.
- Paid vacation, sick leave, and holidays.
Tech Stack
Categories
Data Engineering
About Citi
Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.