GrepJob
about 7 hours ago
Remote, United StatesSenior / Staff+

Base Salary

$90k - $150k/yr

Responsibilities

  • Design and deliver production AI and agentic systems across document intelligence and workflow automation.
  • Own architecture decisions for LLM-based systems, including retrieval, orchestration, memory, tool use, and evaluation.
  • Build and maintain evals and observability frameworks to ensure system quality, reliability, and performance.
  • Optimize systems for cost and latency at production scale.
  • Partner closely with AI Product to scope, sequence, and deliver high-impact features.
  • Collaborate with Data Engineering on pipelines, schemas, and data quality foundations.
  • Mentor engineers working on AI-adjacent systems and elevate team capabilities.
  • Evaluate vendors, models, and tools through POCs, benchmarking, and cost-performance analysis.
  • Ship quickly, iterate in production, and continuously improve system performance.

Requirements

  • 6+ years of software engineering experience, including 2+ years building and shipping production LLM/ML systems.
  • Proven experience designing and deploying agentic systems.
  • Strong Python proficiency with production-grade coding, testing, and deployment practices.
  • Hands-on experience with LLM APIs, including prompting and structured outputs.
  • Deep experience with evals and observability for LLM systems.
  • Experience building retrieval systems and working with vector databases.
  • Solid cloud infrastructure experience, preferably with AWS.
  • Strong system design mindset across LLM architecture.
  • Ability to manage cost and latency tradeoffs in production AI systems.
  • Clear communicator who can write design docs and collaborate cross-functionally.
  • Ownership mindset: ships end-to-end and operates effectively in production environments.

Benefits

  • Work from the PLACE you work best—at home, in an office, or on the move.
  • Competitive benefits including PTO as needed and comprehensive insurance coverage.
  • 401(k) match and stock option grants.
  • Stock purchase plan available.

Tech Stack

AWSdbtGoogle BigQueryPythonSnowflake

Categories

AI & MLData Engineering