Sr. Software Engineer II - AI Engineering (Remote Eligible)
Smartsheet4 hours ago
Base Salary
$175k - $245k/yr
Responsibilities
- Design and build production-grade LLM-powered agents and workflows, making architecture decisions across system design, data pipelines, and deployment strategies.
- Develop prompts, context-engineering approaches, RAG pipelines, agent reasoning patterns, and evaluation frameworks for accuracy, hallucination rates, and performance.
- Implement and manage end-to-end AI systems on AWS, GCP, or Azure, including monitoring, optimization, and incident response.
- Translate business requirements into technical AI solutions in collaboration with Engineering, Product, and AI Platform teams.
- Mentor engineers on applied machine learning practices, AI development patterns, and production considerations.
- Establish standards for AI development, model governance, and responsible AI.
- Evaluate emerging AI and LLM tools, frameworks, and techniques, and contribute to legacy and greenfield full-stack applications.
Requirements
- 8+ years of software engineering experience, including at least 2 years working directly with LLMs in production.
- Hands-on experience with prompt engineering, context engineering, RAG architectures, chunking strategies, embedding models, retrieval evaluation, and failure diagnosis.
- Experience building or extending LLM evaluation frameworks using scorers and golden datasets.
- Fluency in agent system design and ability to engage on architectural tradeoffs affecting quality.
- Strong Python skills and experience in data-heavy environments such as Databricks or Delta tables.
- Ability to communicate complex quality findings to technical and non-technical stakeholders and exercise strong cross-functional judgment.
- Legal eligibility to work in the U.S. on an ongoing basis.
- BS or MS in Computer Science, a related field, or equivalent industry experience.
- Experience with MLflow or similar experiment-tracking platforms, CI-integrated evaluation pipelines, multi-agent orchestration frameworks, or Applied AI/LLMOps functions is a strong plus.
Benefits
- Employer-subsidized medical, vision, and dental coverage for full-time employees.
- 401(k) match of 50% of employee contributions up to the first 6% of eligible pay.
- Monthly work and productivity stipend.
- Flexible Time Away Program, sick time off, 12 paid holidays, and up to 24 weeks of parental leave.
- Employer-provided life insurance and short- and long-term disability coverage.
- Personal paid Volunteer Day and professional development opportunities including Udemy courses.
- Company-funded counseling membership, local retail discounts, and a personal Smartsheet account.
- Teleworking is available from any registered location in the U.S., depending on the role.
Tech Stack
Categories
About Smartsheet
Smartsheet is the Intelligent Work Management platform. By aligning people and technology so organizations can move faster and drive innovation, Smartsheet enables its millions of users to achieve more. Visit www.smartsheet.com to learn more. Backed by enterprise-grade security, Smartsheet is used by more than 85% of the companies in the Fortune 500 to implement, manage, and automate processes across a broad array of departments and use cases.