Software Engineering SMTS / LMTS - AI Core (REMOTE)
Salesforce7 days ago
Base Salary
$173k - $286k/yr
Responsibilities
- Lead retrieval initiatives using RAG, hybrid search, lexical and vector search, reranking, filtering, indexing, and retrieval-quality measurement.
- Build frameworks and developer tooling for production agents, including multi-agent orchestration, shared prompt and tool primitives, tracing, registries, and evaluation infrastructure.
- Diagnose and improve answer quality by separating retrieval issues from prompting, token-budget, and model-choice issues.
- Design ingestion, segmentation, labeling, freshness, deduplication, source-precedence, and visibility models for documents, knowledge bases, and transcripts.
- Build offline evaluation, online monitoring, regression detection, observability, and rollout practices for prompts, models, and retrieval changes.
- Set performance and scaling benchmarks for retrieval, indexing, LLM provider usage, and agent orchestration.
- Own operational health, participate in on-call, and lead incident resolution for owned systems.
- Partner with product, design, and engineering leadership on roadmaps, tradeoffs, requirements, and execution plans.
- Mentor engineers, provide code reviews and technical guidance, and improve engineering standards, tooling, and processes.
Requirements
- Proven experience shipping production AI or backend systems, with recent experience focused on LLM-powered applications.
- Expertise building retrieval systems with RAG and hybrid search, including chunking, indexing, embeddings, vector and lexical search, reranking, and retrieval-quality measurement.
- Expertise building developer tooling and infrastructure for production agents, including multi-agent orchestration, agent or tool registries, tracing, and evaluation.
- Experience owning platform initiatives from design through adoption across retrieval, indexing, LLM provider integrations, and agent orchestration.
- Demonstrated technical leadership in significant projects, non-trivial architecture, tradeoff analysis, and influence beyond an immediate workstream.
- Strong backend fundamentals and proficiency in Ruby on Rails, Python, JavaScript, or Go, plus SQL and relational database experience; PostgreSQL is preferred.
- Hands-on experience with the AI application lifecycle, including experiment setup, dataset curation, offline evaluation, error analysis, deployment, and online evaluation.
- Strong project delivery, communication, ambiguity-management, mentoring, and cross-functional collaboration skills.
- Preferred experience includes pgvector or other vector indexes, large-scale query performance, third-party content ingestion, transcript processing, PII and consent constraints, evaluation suites, voice or real-time agents, enterprise SaaS, Salesforce or CRM integrations, and startup environments.
Benefits
- Remote work arrangement.
- Benefits include time-off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program.
- Salesforce provides reasonable accommodations during the application and recruiting process.
Tech Stack
Categories
About Salesforce
Salesforce builds cloud-based customer relationship management software and a broader Customer 360 platform for sales, service, marketing, commerce, and analytics, sold by subscription to businesses and public-sector organizations. Founded in 1999 and headquartered in San Francisco, it trades on the NYSE under the symbol CRM. Its portfolio includes Sales Cloud, Service Cloud, Marketing Cloud, MuleSoft integration, Tableau analytics, and Slack for collaboration, with extensive developer tools and APIs.