2 hours ago
Raleigh, NC, USASenior
Base Salary
$118k - $220k/yr
Responsibilities
- Architect and implement scalable ML and LLM systems in production.
- Build and deploy LLM applications, including RAG pipelines and agentic systems.
- Implement hybrid search using semantic and lexical search, embeddings, and search platforms.
- Develop APIs, microservices, model-serving infrastructure, data pipelines, and streaming systems.
- Create reusable frameworks, libraries, and infrastructure for AI and ML across teams.
- Optimize systems for latency, scalability, reliability, and cost efficiency.
- Establish deployment, monitoring, observability, and CI/CD best practices.
- Collaborate with Data Scientists to productionize models and integrate them into products.
- Provide technical leadership in system design and engineering standards.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Strong experience implementing and scaling production ML and LLM systems.
- Deep experience developing LLM applications, including RAG and prompt orchestration.
- Strong experience designing and implementing production agentic systems with agent frameworks such as LangChain, LangGraph, AutoGen, or Google ADK.
- Strong experience with hybrid search, embeddings, and search platforms such as Solr or OpenSearch.
- Expertise in distributed systems and cloud-native development, including AWS services such as S3 and DynamoDB.
- Experience with streaming and messaging systems such as Kafka or SQS and caching systems such as Redis.
- Proficiency in Python and experience with Rust, Go, or Scala.
- Experience building scalable REST or GraphQL APIs and using Docker and Kubernetes.
- Strong software engineering fundamentals, including system design, testing, and CI/CD.
- Preferred experience with ChatGPT/OpenAI, Claude, Gemini, LangChain, Google ADK, Terraform, CloudFormation, Jenkins, Spark, Hadoop, Dgraph, Neo4j, or Neptune.
- Experience with high-availability, low-latency systems and legal or regulatory domains is preferred.
Benefits
- Full-time hybrid position based in Raleigh, North Carolina, with three days in the office.
- Eligible for an annual incentive bonus.
- Country-specific benefits are provided.
- Accessible hiring accommodations are available.
Tech Stack
Amazon DynamoDBApache HadoopApache KafkaApache SparkAWSDockerGoGraphQLJenkinsKubernetesNeo4jPythonRedisRustScalaTerraform