
AI and Data Specialist
Mekari (PT. Mid Solusi Nusantara)2 days ago
Remote, Indonesia or Jakarta, IndonesiaMid Level
Responsibilities
- Define acceptable AI behavior based on user workflows, feedback, and production behavior.
- Build and ship AI services, ML models, LLM workflows, RAG systems, data pipelines, and model integrations as product capabilities.
- Configure prompts, context, retrieval logic, model settings, orchestration flows, and data transformations.
- Evaluate AI behavior using evaluation sets, golden datasets, regression evaluations, scenario and adversarial tests, and human review.
- Manage grounding, hallucination, bias, privacy, latency, cost, drift, safety, and trust risks.
- Release systems with guardrails, fallbacks, monitoring, and human-in-the-loop controls.
- Continuously improve prompts, models, and pipelines using real-world usage data.
- Collaborate with Platform Builders and Product Builders on agent tuning, user value, trust boundaries, and release readiness.
Requirements
- 2–3+ years of experience in full-stack engineering or applied software development using AI/data use cases.
- Experience with AI, ML, LLM, RAG, data, analytics, and intelligent product systems.
- Proficiency in prompt, context, retrieval, model, orchestration, and data-system design.
- Experience with data pipelines and data quality dimensions including freshness, lineage, completeness, and correctness.
- Experience designing evaluations, golden datasets, regression evaluations, scenario tests, and human review processes.
- Working knowledge of grounding, hallucination control, refusal behavior, guardrails, safety, and AI trust.
- Experience monitoring drift, quality degradation, latency, cost, user feedback, and production behavior.
- Track record of shipping AI/data-powered products, features, modules, workflows, services, or decision-support capabilities.
- Preferred experience collaborating with Platform Builders on agentic workflows, agent tuning, evaluation, and improvement.
- Comfort defining risk tolerances and behavior standards for non-deterministic systems.