13 days ago
USA (city not specified)Mid Level
Base Salary
$103k - $155k/yr
Responsibilities
- Build and operate Relativity’s cloud-based software and AI systems at production scale.
- Develop production services and web applications using C#, SQL, object-oriented design, and related technologies.
- Take Applied Science prototypes or notebooks through deployment, monitoring, and production operation.
- Instrument models and prompts, and build dashboards and alerts for quality, latency, cost, and reliability.
- Diagnose drift, latency regressions, cost increases, tool-call and retrieval errors, and data-quality effects.
- Build evaluation harnesses, regression checks, and release gates for AI systems.
- Build and operate reproducible data pipelines with lineage and automated data-quality monitoring.
- Design system components, document interfaces and non-functional requirements, and make implementation trade-offs.
- Improve application and system performance, troubleshoot defects, and respond to client-specific issues.
- Apply security and compliance practices to AI features and collaborate with Applied Science, Product, security, and AI platform teams.
- Mentor L3 engineers and share AI development practices and learning with the team.
Requirements
- At least 3 years of professional software development experience using C# and Microsoft SQL Server or related object-oriented languages.
- Experience building web applications with JavaScript and ASP.NET.
- Experience building scalable solutions on Azure or another cloud platform.
- Experience working on an agile software development team and with CI/CD and DevOps principles.
- At least 1 year of experience building or operating AI/ML systems or related data pipelines, including areas such as LLM integrations, prompt design, retrieval-augmented generation, or embeddings.
- Experience deploying and monitoring models or LLM-based services in a cloud environment.
- Practical ability to interpret evaluation results, reason about model failure modes, and balance quality, latency, and cost.
- Experience building data pipelines with orchestration tools such as Prefect or Airflow, with attention to reproducibility.
- Working knowledge of Python alongside C# and experience designing and documenting system components.
- Experience collaborating effectively with scientists, engineers, and product partners.
- Preferred experience with AI evaluation harnesses, LLM orchestration or agent frameworks, agentic workflows, and tool calling.
- Preferred experience with large-scale or sensitive data, Azure DevOps, Azure AI and data services, Docker, Kubernetes, Helm, infrastructure-as-code tools, MLflow, Kubeflow, Apache Spark, Kafka, PyTorch, TensorFlow, Keras, or NLP.
- A bachelor's or advanced degree in Computer Science, Computer Engineering, Mathematics, Statistics, or Artificial Intelligence is preferred.
Benefits
- Hybrid/remote work arrangement.
- Competitive base salary, annual performance bonus, long-term incentives, and an equity program.
- Health and retirement programs, wellness resources, discretionary time off, and parental leave for primary and secondary caregivers.
- Two annual company breaks and a home office stipend.
- Volunteer opportunities and company-sponsored charitable programs.
- Engineering growth through exposure to distributed systems and AI-enabled workflows.
Tech Stack
Apache AirflowApache KafkaApache SparkAzureC#DockerHelmJavaScriptKerasKubernetesMicrosoft SQL ServerMLflowPythonPyTorchTensorFlowTerraform