2 days ago
Remote, United States or Lake Forest, IL, USAStaff+
Base Salary
$134k - $224k/yr
Responsibilities
- Design and implement reusable, scalable batch and streaming data processing systems and production pipelines.
- Define platform patterns for governed, AI-ready data products, semantic models, vector and search capabilities, retrieval patterns, and agent workflows.
- Evaluate and operationalize Snowflake Cortex capabilities including Cortex Analyst, Cortex Search, Cortex Agents, Cortex Code, and Cortex Sense.
- Support Databricks teams with orchestration, reusable pipeline patterns, performance tuning, workspace standards, monitoring, troubleshooting, and production support.
- Use AI-assisted engineering and agentic tools while maintaining secure, reviewed, reliable engineering practices.
- Develop data models, mappings, and user-facing data assets while conducting exploratory data analysis.
- Improve data reliability, accuracy, observability, operational resilience, and data management lifecycle practices.
- Educate and mentor data engineering teams on data patterns, platform capabilities, AI enablement, and tools.
- Evaluate emerging multi-agent engineering technologies and partner with product and business teams on roadmaps, architecture, adoption, and support models.
Requirements
- At least 3 years of batch and streaming data engineering experience using Spark, Python, Scala, Snowflake, or Databricks.
- At least 3 years of experience implementing production pipelines with orchestration tools such as Databricks Workflows or Lakeflow Jobs, Apache Airflow, or Luigi.
- Hands-on Databricks platform experience covering notebooks and repositories, Delta Lake, Unity Catalog, Databricks Runtime, compute, workflow monitoring, optimization, and production support.
- Experience with Snowflake AI and Cortex capabilities, semantic models, and AI-enabled search, retrieval, or agent patterns.
- Familiarity with AI-assisted developer and agent tools and multi-agent system patterns including context management, tool use, orchestration, guardrails, testing, observability, and secure enterprise adoption.
- At least 5 years of experience preparing structured and unstructured data for data science, analytics, machine learning, or AI-enabled applications.
- At least 4 years of experience with Docker, Kubernetes, and containerization or orchestration technologies; shell scripting experience is preferred.
- Experience with vector, graph, relational, and NoSQL databases.
- Experience using machine learning or AI in data pipelines for data discovery, classification, enrichment, standardization, and cleaning.
- Experience implementing CI/CD with automated testing using Jenkins, GitHub Actions, GitLab CI/CD, or similar tools.
- Familiarity with AWS and services such as AWS Glue, Athena, Lambda, S3, and DynamoDB.
- Experience implementing data quality and data management lifecycle functions including transformation, rationalization, linking, matching, monitoring, and stewardship.
Benefits
- Remote work arrangement.
- Medical, dental, vision, and life insurance beginning on day one, plus six annual licensed therapist sessions.
- 18 annual PTO days for full-time employees and six company holidays.
- 6% company contribution to a 401(k) plan with no employee contribution required.
- Employee discounts, tuition reimbursement, student loan refinancing, and financial counseling and education tools.
- Maternity support, nursing benefits, up to 14 weeks of paid leave for birth parents, and up to four weeks for non-birth parents.
Tech Stack
Amazon DynamoDBApache AirflowApache SparkAWSBashDatabricksDockerGitHub ActionsGitLab CI/CDJenkinsKubernetesPythonScalaSnowflake
Categories
Data Engineering
About Grainger
W.W. Grainger is a public B2B distributor of maintenance, repair, and operations (MRO) supplies, safety gear, and facility products for businesses. It sells through a high-touch distribution network and its Endless Assortment e-commerce brands Zoro and MonotaRO, alongside services like inventory management and technical support. Founded in 1927 and headquartered in Lake Forest, Illinois, Grainger serves more than 4.5 million customers and reported $17.2 billion in 2024 revenue.