Data Engineer - AI, Agents, & Context - Revenue Cycle (Associate)
Huron Consulting Group2 hours ago
Remote, United States or Chicago, IL, USAMid Level / Senior
Base Salary
$95k - $130k/yr
Responsibilities
- Build and contribute to an AI context platform for healthcare data and AI products.
- Implement end-to-end pipelines covering ingestion, parsing and chunking, enrichment, embeddings, vector indexing, and retrieval or serving.
- Develop patterns for incremental refreshes, backfills, re-embeddings, deduplication, and lineage across unstructured sources.
- Improve retrieval quality through query strategies, hybrid search, metadata filtering, and related retrieval patterns.
- Implement semantic layers and governed data products that support BI and agent reasoning.
- Apply data and context contracts covering schemas, metadata, freshness, and citation expectations.
- Support monitoring, alerting, runbooks, incident response, reliability, performance, cost, and latency optimization.
- Apply security-by-design practices including RBAC/ABAC, PII redaction, retention controls, and audit logging.
- Coordinate with Security, Legal, and Compliance on guardrails for AI access to enterprise knowledge.
Requirements
- Bachelor’s degree in computer science, engineering, or a related field.
- 3–6 years of experience in data engineering or data platform roles with strong hands-on delivery.
- Strong SQL and Python, or Scala/Java, skills with solid production engineering practices.
- Hands-on Snowflake experience, including pipeline design, data modeling, and production operation at scale.
- Experience designing and operating cloud data pipelines at scale.
- Experience with unstructured data processing and search or retrieval concepts.
- Clear communication skills and the ability to work across technical and functional teams.
- Preferred: experience with vector search, embeddings, semantic retrieval, hybrid search, and reranking using technologies such as pgvector, Pinecone, Weaviate, OpenSearch, or Elastic.
- Preferred: experience supporting LLM applications, including RAG, agent tool interfaces, and evaluation or observability.
- Preferred: familiarity with knowledge graphs, semantic modeling, metrics layers, regulated environments, and data governance programs.
- Preferred: exposure to dbt, Iceberg, or other lakehouse or semantic-layer tooling alongside Snowflake.
Benefits
- Medical, dental, vision, and other wellness programs.
- Eligibility for Huron’s annual incentive compensation program.
- Remote position in the United States.
- Ability to travel as needed up to four times per year.