Protiviti

Software Engineer II – AI Engineer (w/ skills in Deployment)

Protiviti
Apply
2 months ago
Remote, United StatesMid Level
H1B sponsor

Base Salary

$85k - $124k/yr

Responsibilities

  • Develop and modify software application modules, including Generative AI components.
  • Build prompt workflows, retrieval layers, APIs, cloud services, and LLM integrations.
  • Develop RAG pipelines using embeddings, chunking, and vector search.
  • Implement application deployment, containerization, release processes, and CI/CD pipelines.
  • Apply prompt engineering techniques such as few-shot prompting and structured outputs.
  • Evaluate models for accuracy, relevance, and hallucination risk.
  • Implement safety guardrails, PII protection, and prompt-injection defenses.
  • Execute unit, integration, and GenAI evaluation testing.
  • Monitor production systems for latency, cost, usage, and errors.
  • Provide Level II production support, troubleshoot production issues, and support incident management with fallback and recovery strategies.
  • Support SDLC documentation and interact with users to define requirements and support production applications.

Requirements

  • At least 4 years of experience in IT or a related field.
  • At least 2 years of software engineering experience.
  • At least 1 year of experience in Generative AI deployment.
  • Experience with AI coding agent-augmented development, application deployment, cost optimization, token and caching strategies, and LLMOps/MLOps.
  • Experience with Python, Java, C#, JavaScript, or SQL.
  • Knowledge of cloud platforms, containers, CI/CD, SDLC, APIs, system architecture, databases, and data integration.
  • Understanding of LLM fundamentals, token behavior, prompt engineering, RAG pipelines, embeddings, vector search, evaluation metrics, and GenAI safety mechanisms.
  • Experience with observability, including logging, tracing, and monitoring.
  • Experience with Azure, AWS, or GCP.
  • Strong communication and requirements-gathering skills.
  • Preferred experience with model orchestration, multi-step workflows, agents, LangChain, Semantic Kernel, AutoGen, semantic search, A/B testing, conversational UX, human-AI interaction design, incident handling, retries, and graceful degradation.

Benefits

  • Medical, vision, and dental insurance.
  • FSA and HSA healthcare accounts.
  • Life and accident insurance.
  • Adoption and fertility assistance.
  • Paid parental leave of up to 6 weeks.
  • Short- and long-term disability insurance.
  • Paid time off for vacation, personal needs, and sick time, with new hires earning up to 17 days of Choice Time Off per calendar year.
  • Up to 11 paid holidays per calendar year.
  • 401(k) savings and investment plan or deferred compensation plan when eligible, with a 100% employer match on the first 3% of contributions for eligible employees.
  • Employment offers are contingent on successful completion of a background check.
Protiviti

About Protiviti

5,001-10,000 employees

Protiviti (www.protiviti.com) is a global consulting firm that delivers deep expertise, objective insights, a tailored approach and unparalleled collaboration to help leaders confidently face the future. Protiviti and its independent and locally owned member firms provide clients with consulting and managed solutions in finance, technology, operations, data, digital, legal, HR, risk and internal audit through a network of more than 90 offices in over 25 countries. Named to the Fortune 100 Best Companies to Work For® list for the 11th consecutive year, Protiviti Inc. has served more than 80 percent of Fortune 100 and nearly 80 percent of Fortune 500 companies. The firm also works with government agencies and smaller, growing companies, including those looking to go public. Protiviti Inc. is a wholly owned subsidiary of Robert Half (NYSE: RHI).

Contact me