AI Benchmark Engineer | Native Language Specialist - German (Switzerland) - Remote
LILT (Production)21 hours ago
Remote, SwitzerlandEntry Level
Responsibilities
- Design and engineer multilingual Terminal-Bench tasks for evaluating coding agents.
- Build realistic task environments, datasets, and files that remain in the target language.
- Create native-language prompts and identify failure points in AI systems.
- Develop reference implementations and reliable deterministic verifier scripts.
- Run benchmark configurations against Haiku, Sonnet, and Opus and calibrate task difficulty from Easy to Very Hard.
- Analyze execution logs and participate in creation, review, calibration, and audit quality-control stages.
Requirements
- At least 1 year of industry experience in software engineering or prompt engineering.
- Proven experience at leading technology companies and/or graduation from a top-tier engineering university.
- Native or near-native German fluency with deep knowledge of grammar, register, and phrasing, plus high English proficiency.
- Strong proficiency in Python, standard shell scripting, and data processing.
- Extensive Terminal/CLI-based development experience and familiarity with coding agents.
- Deep understanding of multilingual text-processing issues including encoding and decoding, Unicode normalization, locale conventions, text I/O, toolchain interoperability, and safe string operations.
Benefits
- Remote independent-contractor work with flexible scheduling and workload.
- Competitive rates and prompt payments.
- Access to diverse AI and language-technology projects and a global expert community.
- Work availability fluctuates with project demand; hours are not guaranteed and the role is not intended as a primary income source.
- Most accepted tasks require at least 2 hours per day or 10 hours per week.
- The contractor is responsible for taxes and does not receive health insurance, paid time off, or retirement contributions.
- Geographic restrictions may apply for regions subject to international embargoes or sanctions.
About LILT (Production)
LILT builds an enterprise translation and localization platform that combines AI models with human linguists to produce multilingual content for businesses and governments. The company also provides data labeling and evaluation services for AI developers, plus managed translation services integrated with common content and support tools. Founded in 2015 and headquartered in San Francisco, it is privately held and works with global organizations that need at-scale, domain-specific localization.