over 2 years ago
Chennai, India or Bengaluru, IndiaStaff+
Responsibilities
- Design and develop big data solutions and pipelines using Hadoop and non-Hadoop platforms.
- Migrate legacy workloads to cloud platforms and support deployments across cloud and on-premises environments.
- Build data ingestion and transformation pipelines from heterogeneous sources for data science applications.
- Convert SAS-based pipelines to PySpark and Scala and tune big data applications for performance.
- Define and implement maintainability, testability, performance, security, quality, and usability standards for data platforms.
- Drive automation, reusable components, consistent patterns, and coding standards for data engineering processes.
- Evaluate evolving technology and business requirements and recommend system enhancements.
- Lead teams of data engineers and analysts while partnering with product owners, customers, technologists, domain experts, product managers, analysts, and data scientists.
- Assess and manage risks, regulatory compliance, controls, and escalation requirements.
Requirements
- 8+ years of total IT experience.
- 5+ years of experience with Hadoop or big data technologies, including Hadoop/Cloudera ecosystem expertise.
- Hands-on experience with HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, and Solr.
- Experience designing and developing data ingestion or transformation pipelines using Java, Scala, or Python.
- Expert-level experience building pipelines with Apache Spark and programming with PySpark, Scala, or Java.
- Familiarity with core services from AWS, Azure, or GCP and experience supporting cloud deployments.
- Hands-on experience with Python, PySpark, Scala, and basic machine learning libraries.
- Exposure to Docker, Kubernetes, and DevOps-related practices such as source control, integration, and deployments.
- Proficiency in Java or Python; Apache Beam or Spark experience is a plus.
- Understanding of data structures, algorithms, distributed storage, and distributed computing.
- Experience managing teams and leading data engineers and analysts.
- Experience with Snowflake is a plus.
- Can-do attitude, complex problem-solving ability, interpersonal skills, and teamwork skills.
- Bachelor’s or university degree, or equivalent experience.
Benefits
- Full-time position based in Bangalore.
- Citi is an equal opportunity and affirmative action employer and provides reasonable accommodation for applicants with disabilities.
Tech Stack
Apache BeamApache HadoopApache HiveApache KafkaApache PigApache SparkAWSAzureDockerGoogle Cloud PlatformJavaKubernetesPythonSassScalaSnowflake
Categories
Data Engineering
About Citi
Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.