4 hours ago
Helsinki, FinlandSenior
Responsibilities
- Define product behavior, measurement frameworks, evaluation systems, datasets, and regression gates for non-deterministic AI products.
- Run continuous end-user evaluation of APIs, SDKs, data representations, and reference applications, then identify and drive fixes.
- Own MVP delivery against a technical design while balancing technical perfection with useful increments.
- Build ingestion, conflation, entity-resolution, quality-check, batch, and streaming data pipelines and supporting tooling.
- Evaluate external datasets, models, benchmarks, research, and open-source releases and decide whether to adopt or build.
- Design feedback loops and failure instrumentation that convert recurring production issues into evaluation cases.
- Design model-to-tool boundaries and build model harnesses for tool calling, delegation, and agent orchestration.
- Optimize request latency and cost through streaming, partial results, caching, model routing, and prompt structure.
- Build internal CLI, MCP, and related tools and share reusable components across teams.
- Contribute to code and design reviews, mentor engineers on evaluation practices, and participate in the on-call rotation.
Requirements
- Bachelor’s degree in a STEM discipline.
- 5+ years of software engineering experience with production ownership of services, pipelines, or SDKs.
- 2+ years shipping LLM-backed features to real users in systems with error budgets, on-call rotations, and customer-visible regressions.
- Direct experience or deep understanding of evaluation design for non-deterministic systems, including building datasets and identifying failures.
- Data engineering depth including SQL, at least one distributed processing framework, and pipelines where data correctness is critical.
- Fluency with tool calling and agent orchestration, including stale context, hallucinated arguments, silent partial success, and unbounded-loop failure modes.
- Working knowledge of more than one agent harness.
- Strong Python or TypeScript skills and ability to read code in other languages.
- Experience diagnosing latency in distributed request paths.
- Clear written communication and judgment in ambiguous, fast-moving technical environments.
- Preferred: geospatial data experience involving routing, geocoding, POI or address data, OpenStreetMap, or conflation.
- Preferred: public API or SDK design, MCP or similar tool transports, CI evaluations, automotive or in-vehicle infotainment, CarPlay, Android Auto, voice pipelines, constrained or offline compute, or early external integrations.
Benefits
- Hybrid/remote flexibility with the option to work from home or periodically from an applicable office.
- Country-specific private health, dental, and income-protection coverage.
- Family care, maternity leave, and paternity leave policies.
- Lifestyle spending account contributions for health, wellness, and personal growth.
- Mental health support for employees and dependents.
- Paid time away, company holidays, and generous absence policies.
- Dedicated paid volunteering time in addition to standard paid time off.
Tech Stack
Categories
AI ApplicationsData Engineering
About Mapbox
Mapbox builds a real-time location platform with APIs, SDKs, and data for maps, navigation, search, and traffic used by developers and enterprises across mobile, web, and automotive. It sells usage-based SaaS for custom maps, routing, and telemetry that support logistics, e-commerce, and fleet operations. Founded in 2011 and headquartered in Washington, DC, the privately held company serves millions of developers and powers navigation for people, packages, and vehicles.