2 days ago
Remote, Indonesia or Jakarta, IndonesiaMid Level

Responsibilities

  • Define acceptable AI behavior based on user workflows, feedback, and production behavior.
  • Build and ship AI services, ML models, LLM workflows, RAG systems, data pipelines, and model integrations as product capabilities.
  • Configure prompts, context, retrieval logic, model settings, orchestration flows, and data transformations.
  • Evaluate AI behavior using evaluation sets, golden datasets, regression evaluations, scenario and adversarial tests, and human review.
  • Manage grounding, hallucination, bias, privacy, latency, cost, drift, safety, and trust risks.
  • Release systems with guardrails, fallbacks, monitoring, and human-in-the-loop controls.
  • Continuously improve prompts, models, and pipelines using real-world usage data.
  • Collaborate with Platform Builders and Product Builders on agent tuning, user value, trust boundaries, and release readiness.

Requirements

  • 2–3+ years of experience in full-stack engineering or applied software development using AI/data use cases.
  • Experience with AI, ML, LLM, RAG, data, analytics, and intelligent product systems.
  • Proficiency in prompt, context, retrieval, model, orchestration, and data-system design.
  • Experience with data pipelines and data quality dimensions including freshness, lineage, completeness, and correctness.
  • Experience designing evaluations, golden datasets, regression evaluations, scenario tests, and human review processes.
  • Working knowledge of grounding, hallucination control, refusal behavior, guardrails, safety, and AI trust.
  • Experience monitoring drift, quality degradation, latency, cost, user feedback, and production behavior.
  • Track record of shipping AI/data-powered products, features, modules, workflows, services, or decision-support capabilities.
  • Preferred experience collaborating with Platform Builders on agentic workflows, agent tuning, evaluation, and improvement.
  • Comfort defining risk tolerances and behavior standards for non-deterministic systems.
Mekari (PT. Mid Solusi Nusantara)

About Mekari (PT. Mid Solusi Nusantara)

1,001-5,000 employees
Contact me