5 hours ago
Bengaluru, IndiaMid Level
Responsibilities
- Design, build, maintain, and optimize AI agent workflows for carrier monitoring, performance tracking, exception management, and escalation processes.
- Create customer-specific workflows tailored to carrier, lane, and account requirements.
- Write, test, iterate, and evaluate prompts for large language models using structured performance criteria.
- Track prompt versions, evaluation results, design decisions, and workflow changes.
- Diagnose hallucinations, inconsistencies, failure modes, drift, and degradation in LLM and agent outputs.
- Collaborate with engineers on workflow handoff, connector implementation, deployment, go-live, and production support.
- Monitor and improve production workflows as customer needs, data sources, and underlying models evolve.
- Translate product requirements into AI agent requirements, success criteria, constraints, and workflow specifications.
- Partner with customers before and after launch to design workflows, review performance, gather feedback, and resolve enhancement requests.
- Drive governance, automation expansion, process improvement, documentation, training, and team enablement.
Requirements
- 3–4+ years of experience in transportation operations, logistics technology, carrier management, or network operations; global or multi-region experience is preferred.
- Hands-on experience with AI tools, automation platforms, or workflow-based technologies in an operational context.
- Experience troubleshooting EDI, APIs, data pipelines, system configuration, and workflow orchestration.
- Strong analytical ability using data, monitoring dashboards, and structured observation to diagnose issues and measure outcomes.
- Experience collaborating across Product, Engineering, AI, and Operations stakeholders.
- Excellent written and verbal communication skills, including the ability to interpret product requirements and create structured AI workflow specifications.
- Ability to write clear prompts and instructions, use few-shot examples and step-by-step techniques, and break complex tasks into stages.
- Ability to work in AI tools and platforms to build, test, and iterate on workflows without writing code.
- Ability to critically evaluate LLM outputs and convert observed issues into targeted prompt improvements.
- Understanding of LLM behavior and limitations, including hallucinations, instruction misinterpretation, and inconsistent outputs.
Benefits
- The role requires working from the office five days per week.
- The position offers an individual contributor opportunity to influence global AI operations, governance, and automation strategy.
Categories
About project44
project44 builds an enterprise SaaS platform that gives shippers, retailers, and logistics providers real-time visibility, predictive insights, and workflow tools across global transportation networks. Its products span end‑to‑end shipment tracking, intelligent transportation management, yard operations, last‑mile delivery, and developer APIs that integrate with TMS/ERP systems. Founded in 2014 and headquartered in Chicago, the privately held company serves customers across manufacturing, automotive, retail, life sciences, and other complex supply chain industries.