3 days ago
Raleigh, NC, USASenior
Base Salary
$105k - $175k/yr
Responsibilities
- Architect modular agentic applications spanning retrieval, prompting, model invocation, tool execution, state management, orchestration, validation, and response formatting.
- Refactor complex Python applications for correctness, maintainability, modularity, extensibility, testability, and performance.
- Own production readiness through validation, exception handling, timeouts, retries, fallbacks, configuration management, and secure credential handling.
- Establish logging, metrics, tracing, alerting, and error reporting for LLM and retrieval workflows.
- Design interfaces and data contracts across retrieval, orchestration, model, and downstream application components.
- Develop unit, integration, regression, and end-to-end tests, including failure-mode and dependency-availability testing.
- Review code, identify architectural and operational risks, and provide production-focused feedback.
- Optimize latency, memory, retrieval performance, token usage, model cost, and scalability.
- Participate in deployments, incident investigations, root-cause analysis, remediation, and reliability improvements.
Requirements
- Advanced Python proficiency with experience designing, implementing, debugging, testing, reviewing, and refactoring production applications.
- Strong knowledge of Python fundamentals, data structures, algorithms, object-oriented and functional design, type annotations, and computational complexity.
- Experience turning prototypes or experiments into modular, maintainable, observable, production-ready systems.
- Strong understanding of separation of concerns, dependency injection, interface design, configuration management, and abstraction.
- Experience with automated testing, including unit, integration, regression, and end-to-end tests using tools such as pytest.
- Experience designing resilient distributed applications with timeouts, retries, rate limits, partial-failure handling, idempotency, and graceful degradation.
- Experience with production observability, incident troubleshooting, code reviews, and lifecycle ownership.
- Strong understanding of production LLM concerns including structured output validation, context management, model and tool failures, prompt versioning, token and cost controls, security, and evaluation.
- Preferred experience with pytest, ruff, mypy, profiling tools, automated CI quality gates, Pydantic, agentic-system evaluation frameworks, model fallbacks, guardrails, human-in-the-loop workflows, auditability, and incident response.
- Experience with OpenSearch or Solr, monorepo environments, and cross-functional technical delivery.
Benefits
- Flexible working hours.
- Wellbeing initiatives, shared parental leave, study assistance, and sabbaticals.
- Country-specific benefits and accessibility support during hiring.
- U.S. national base pay range of $104,900-$174,700 plus eligibility for an annual incentive bonus.
Tech Stack
pytestPython
Categories
About RELX
RELX provides information-based analytics, research content, and decision tools for scientists, legal and risk professionals, insurers, and governments. Through segments including Elsevier (STM), LexisNexis (legal and risk), and RX (exhibitions), it sells subscriptions, data services, and software platforms used in 180+ countries. Headquartered in London, it is a public company listed in London and Amsterdam.