Senior AI Application Developer
Signature Aviation1 day ago
Orlando, FL, USASenior
Responsibilities
- Build and deploy production LLM applications, agentic systems, and multi-agent solutions using orchestration frameworks such as LangGraph, Microsoft Agent Framework, and Semantic Kernel.
- Design stateful agent workflows with tool calling, routing, checkpointing, structured outputs, human-in-the-loop controls, memory, and failure recovery.
- Integrate agents securely with enterprise systems through APIs, function calling, and MCP with authentication, authorization, approval, and audit controls.
- Build RAG and retrieval capabilities using Azure AI Search, Databricks Vector Search, pgvector, Cosmos DB, or equivalent technologies.
- Build and maintain ingestion, transformation, embedding, and feature pipelines using Azure Databricks, Microsoft Fabric, or equivalent platforms.
- Create systematic evaluations covering accuracy, groundedness, hallucination, task completion, agent trajectories, safety, latency, and cost.
- Instrument model calls, retrieval, agent steps, and tool calls, and support testing for prompt injection, PII leakage, and excessive agent autonomy.
- Work as a Forward Deployed Engineer with business and engineering teams from ambiguous problem definition through production deployment and operational handoff.
- Turn deployment lessons into shared AI patterns, libraries, and accelerators while following enterprise standards for security, model access, evaluation, observability, and cost.
Requirements
- At least 5 years of software, data, or ML engineering experience with recent hands-on delivery.
- Production-grade experience building and deploying LLM applications or agent-based AI systems.
- Hands-on Microsoft Foundry experience, including Azure OpenAI models, the Foundry Models catalog, and Azure AI Content Safety.
- Experience with Azure cloud-native application patterns, including Azure Container Apps or AKS, Azure Functions, Azure DevOps or GitHub Actions, Microsoft Entra ID managed identity, and Key Vault.
- Knowledge of prompt design, RAG, function and tool calling, structured outputs, and streaming, plus experience with at least one listed agent orchestration framework.
- Demonstrated experience building or substantially rebuilding ingestion, transformation, embedding, or feature pipelines for production.
- Experience with vector or hybrid search using Azure AI Search, Cosmos DB, or pgvector; Pinecone, Weaviate, and Redis Vector are considered equivalent options.
- Systematic model or prompt quality evaluation experience using a custom harness or evaluation tools rather than anecdotal assessment.
- Strong Python, working TypeScript, and experience integrating AI systems with enterprise data and operational platforms.
- Experience working directly with end users through embedded delivery, solutions engineering, or stakeholder-facing product work.
- Sound judgment regarding secrets, access control, and personally identifiable information.
- Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
- Preferred qualifications include strong LangGraph and multi-agent orchestration experience, MCP and enterprise tool integration, Microsoft Foundry, Azure OpenAI, Azure AI Search, Azure Databricks or Microsoft Fabric, and familiarity with foundation models such as OpenAI, Claude, Gemini, or Llama.
- Additional preferred experience includes Langfuse, LangSmith, Ragas, Promptfoo, Azure AI Evaluation SDK, MLflow, coding agents, Forward Deployed Engineer or solutions engineering work, and aviation, logistics, mobility, or other large-scale operational environments.
Tech Stack
Categories
AI ApplicationsForward Deployed
About Signature Aviation
Signature Aviation operates a global network of fixed-base operations (FBOs) that provide fueling, ground handling, passenger terminals, and hangar space for business and private aviation. The company serves corporate flight departments, charter operators, and aircraft owners across 200+ locations in 27 countries, and also offers flight support and real-estate services. Founded in 1992 and headquartered in Orlando, it is privately held by an investor group led by Global Infrastructure Partners.