
Big Data Engineer Lead
S&P Global1 day ago
Base Salary
$149k - $202k/yr
Responsibilities
- Partner with business stakeholders to gather requirements, define use cases, and plan solution delivery.
- Collaborate with data scientists and software engineers to design, build, and deploy scalable machine learning and generative AI solutions.
- Analyze large datasets and develop data-driven insights to improve business outcomes.
- Build platforms, services, and tooling to optimize, evaluate, and fine-tune machine learning models for performance and scalability.
- Research and apply emerging AI and machine learning technologies, including AI agents and autonomous workflows.
- Work with cross-functional teams to deliver reliable solutions and contribute to technical standards, best practices, and reusable AI capabilities.
Requirements
- Experience building AI, machine learning, or data-driven solutions in cloud environments such as AWS.
- Strong Python programming skills and experience with TensorFlow, PyTorch, or scikit-learn.
- Hands-on experience developing applications with Java and Spring Boot.
- Experience with Docker, Kubernetes, and virtualized environments.
- Familiarity with Cursor, Claude Code, GitHub Copilot, or similar AI-assisted development tools.
- Experience with Git, SQL, and structured and unstructured datasets.
- Understanding of deep learning, natural language processing, generative AI, AI agents, autonomous workflows, or agentic AI frameworks.
- Preferred experience with LangChain, LangGraph, CrewAI, ADK, Strands, graph technologies, graph algorithms, React, JavaScript, HTML, data engineering, data preparation, feature engineering, data lakes, AI-ready data platforms, Apache Spark, or Hadoop.
Benefits
- Health care coverage and wellness benefits.
- Generous paid time off and flexible downtime.
- Continuous learning resources and career development support.
- Retirement planning, continuing education support, company-matched student loan contributions, and financial wellness programs.
- Family-friendly benefits, retail discounts, and referral incentive awards.
- The posting lists a US base salary range of $149,302–$202,267 and an annual incentive plan; it also states that benefits vary by country.
Tech Stack
Apache HadoopApache SparkAWSDockerGitHTMLJavaJavaScriptKubernetesPythonPyTorchReactscikit-learnSpring BootSQLTensorFlow
Categories
Data EngineeringML Engineering