S&P Global

Big Data Engineer Lead

S&P Global
Apply
26 days ago

Base Salary

$149k - $202k/yr

Responsibilities

  • Partner with business stakeholders to gather requirements, define use cases, and plan solution delivery.
  • Collaborate with data scientists and software engineers to design, build, and deploy scalable machine learning and generative AI solutions.
  • Analyze large datasets and develop data-driven insights to improve business outcomes.
  • Build platforms, services, and tooling to optimize, evaluate, and fine-tune machine learning models for performance and scalability.
  • Research and apply emerging AI and machine learning technologies.
  • Develop best practices, technical standards, and reusable AI capabilities across the organization.

Requirements

  • 10+ years of relevant experience building AI, machine learning, or data-driven solutions in cloud environments such as AWS.
  • Strong Python skills and experience with TensorFlow, PyTorch, or scikit-learn.
  • Hands-on experience developing applications with Java and Spring Boot.
  • Experience with Docker, Kubernetes, and virtual machines.
  • Familiarity with Cursor, Claude Code, GitHub Copilot, or similar AI-assisted development tools.
  • Experience with Git, SQL, and structured and unstructured datasets.
  • Understanding of deep learning, natural language processing, and generative AI.
  • Experience building or working with AI agents, autonomous workflows, or agentic AI frameworks.
  • Preferred experience with LangChain, LangGraph, CrewAI, ADK, Strands, graph technologies, React, JavaScript, HTML, data engineering, data preparation, feature engineering, data lakes, AI-ready data platforms, Apache Spark, or Hadoop.

Benefits

  • Health care coverage and wellness benefits.
  • Generous flexible downtime and paid time off.
  • Continuous learning resources and career development support.
  • Retirement planning, continuing education, company-matched student loan contributions, and financial wellness programs.
  • Family-focused perks, retail discounts, and referral incentive awards.
  • The role is based in New York, New York, and the posting provides a base salary range of $149,302–$202,267 plus eligibility for an annual incentive plan.

Tech Stack

Apache HadoopApache SparkAWSDockerGitHTMLJavaJavaScriptKubernetesPythonPyTorchReactscikit-learnSpring BootSQLTensorFlow

Categories

Data EngineeringML Engineering
Contact me