PayU

Lead Data Engineer

PayU
Apply
16 hours ago
Bengaluru, IndiaStaff+

Responsibilities

  • Design infrastructure for data consumption, particularly in machine learning applications.
  • Define database architecture for combining and linking data and ensure integrity across sources.
  • Ensure data-system performance for machine learning, web and mobile applications, RESTful services, and Java-based systems.
  • Analyze large, fast, and complex datasets using advanced data-handling techniques for difficult, non-routine problems.
  • Build, test, and maintain data pipelines and infrastructure components in the data engineering stack.
  • Collaborate with Software Engineers, ML Engineers, and SREs to gather requirements and deploy data science and machine learning solutions.
  • Design and implement tools that support sharing data, code, and practices across organizations at scale.

Requirements

  • Strong knowledge and experience with Python, Pandas, data wrangling, ETL processes, Spark, data visualization, data modeling, and advanced SQL.
  • Strong experience with scalable compute solutions such as Kafka and Snowflake.
  • Strong experience with workflow management tools such as Airflow, AWS services, and open-source tools.
  • Strong experience with data engineering practices, including data ingestion pipelines and ETL.
  • Understanding of machine learning methods, algorithms, pipelines, testing practices, and frameworks.
  • Bachelor of Technology, Bachelor of Engineering, Master of Engineering, Master of Science, or PhD in computer science, engineering, mathematics, or physics, or equivalent.
  • Experience designing and implementing tools that support data, code, and practice sharing across organizations at scale.

Benefits

  • Positive, get-things-done workplace.
  • Dynamic and constantly evolving work environment.
  • Inclusive environment focused on diverse perspectives and voices.
  • Opportunities to learn cutting-edge concepts in an agile startup environment with global scale.
  • Access to more than 5,000 training courses available anytime and anywhere through learning partners including Harvard, Coursera, and Udacity.
  • Work location in Bangalore, Mumbai, or Gurgaon.

Tech Stack

Apache AirflowApache KafkaApache SparkAWSJavaPandasPythonSnowflakeSQL

Categories

Data Engineering
PayU

About PayU

1,001-5,000 employees

Global reach, local expertise: we combine the best of both worlds to reshape the future of payments and fintech to build a world of unlimited possibilities. We successfully bridge the global and local gap by supplying ultimate global payment coverage with extensive local expertise and support. Our vision is to create a world without financial borders where everyone can prosper. Thus, we strive to shape the payment industry of tomorrow to support global financial inclusion. As the payments and fintech business of Prosus- a global consumer internet group and one of the largest technology investors in the world- we are a leading online payment service provider operating in 50+ high-growth markets, dedicated to creating cutting-edge financial services tailored to the needs of over 450,000 merchants and millions of consumers. Focused on empowering people through financial services and creating a world without financial borders, we have set out to be one of the most prominent investors in the Fintech space, with investments totaling over $1 billion to date. We deploy more than 400 payment methods and PCI-certified platforms to process approximately 10 million payments daily. As a Fintech innovator, we develop cutting-edge technologies to ensure that merchants benefit from the highest approval rates and can optimally expand their global reach.

Contact me