Infosys

Hadoop and PySpark Data Engineer

Infosys
Apply
3 days ago
Jackson, NJ, USAMid Level
H1B sponsor

Responsibilities

  • Document assigned portions of business requirements and facilitate application design discussions.
  • Participate in coding, feature integration, code reviews, codebase changes, and repository maintenance.
  • Implement test strategies, analyze results, and coordinate bug fixes.
  • Develop user training programs, technical documentation, and software support frameworks.
  • Resolve production issues and recommend preventive strategies to improve system reliability.
  • Maintain records of code, testing techniques, and support activities.
  • Contribute to data warehousing architecture and production big data implementations.

Requirements

  • Bachelor’s degree or foreign equivalent from an accredited institution, or qualifying progressive specialty experience in lieu of education.
  • Experience with data warehousing architectural approaches.
  • Experience with the Hadoop ecosystem, including Cloudera, and production big data implementations.
  • Experience with Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, orchestration tools, and large SQL-based systems.
  • Experience with Autosys or Airflow and sound knowledge of relational databases and SQL.
  • Ability to manage end-to-end software development lifecycle activities, testing, troubleshooting, integration, and cross-functional collaboration.
  • Preferred: knowledge of evolving Hadoop ecosystem tools and cloud and containerization technologies.

Benefits

  • Medical, dental, vision, and life insurance.
  • Long-term and short-term disability coverage.
  • Health and dependent care reimbursement accounts.
  • Accident, critical illness, hospital indemnity, and legal insurance.
  • 401(k) plan with contributions dependent on salary level.
  • Paid holidays and paid time off.
  • The position may require relocation and/or travel to the work or project location.

Tech Stack

Apache AirflowApache HadoopApache HiveApache SparkPythonSQL

Categories

Data Engineering
Infosys

About Infosys

10,000+ employees

Infosys is a public IT services and consulting company that builds and runs software systems for large enterprises across industries. It provides consulting, systems integration, cloud and AI services, engineering, and business process outsourcing, and sells platforms such as EdgeVerve's Finacle core banking suite. Founded in 1981 and headquartered in Bangalore, it serves clients in 50+ countries and is listed on the NSE, BSE, and NYSE.

Contact me