Senior AI Engineer
Florence Healthcare - US3 months ago
Atlanta, GA, USASenior
Responsibilities
- Design and implement AI-powered features including LLM workflows, copilots, and agent-based systems with tool use and multi-step reasoning.
- Own AI feature lifecycles from prototyping and evaluation through production deployment and iteration.
- Build prompt pipelines, retrieval systems, embeddings and ranking workflows, and RAG-based solutions.
- Design scalable, cost-efficient AI architectures and select and evaluate hosted or open-source models.
- Build agentic workflows with planning, execution, reflection, tool integration, context, memory, and state management.
- Run experiments, define AI performance metrics, maintain evaluation datasets and benchmarks, and implement automated evaluation pipelines.
- Drive technical direction, influence AI adoption, collaborate with product managers and designers, and contribute reusable components and best practices.
- Implement reliability, safety, privacy, monitoring, observability, and guardrails for AI and agent actions.
- Participate in code reviews and design discussions and mentor mid-level engineers as needed.
Requirements
- 4+ years of related work experience.
- Strong understanding of LLM capabilities and limitations, prompt engineering, structured outputs, embeddings, vector search, RAG architectures, and agent-based architectures.
- Experience building and deploying production-grade systems and evaluating agent performance across multi-step tasks.
- Strong backend and system design fundamentals, with the ability to debug probabilistic outputs and optimize agent decision-making and tool selection.
- Understanding of tool use, planning strategies, memory mechanisms, APIs, pipelines, and data flows.
- Ability to translate user needs into effective AI solutions and balance quality, latency, cost, and product impact.
- Clear communication and collaboration across engineering and product teams.
Benefits
- Competitive compensation package, medical and dental insurance, and office space in the heart of the city.
- Work focused on advancing cures and therapies through health technology.
Categories
About Florence Healthcare - US
Florence Healthcare builds a site enablement platform for clinical trials used by research sites, sponsors, and CROs. Its SaaS products include eRegulatory/eISF, eSource, and remote monitoring tools that integrate with eTMF systems to streamline study workflows and compliance (e.g., 21 CFR Part 11). Founded in 2014 and headquartered in Atlanta, the privately held company serves cancer centers and academic medical centers alongside biopharma organizations.