4 months ago
Remote, Vietnam or Ho Chi Minh City, VietnamMid Level
Responsibilities
- Develop objective and verifiable evaluation criteria and rubrics for system performance.
- Review system logs and execution paths to improve reliability and code quality.
- Refactor code and optimize system behavior toward desired outcomes.
- Test systems for vulnerabilities, data exposure, and edge-case failures.
- Provide detailed feedback on system performance and outputs.
- Evaluate AI systems supporting training of large language models in software development, debugging, and code quality.
Requirements
- At least 2 years of experience in backend engineering, AI automation, or systems integration.
- Strong proficiency in at least two programming languages, such as Python, JavaScript, Go, or Java.
- Experience working with SQL databases.
- Ability to build and maintain production-grade systems.
- Experience working in live, non-mocked environments with multi-step interactions.
- Strong analytical skills and attention to detail.
- Preferred experience with multi-stage system workflows and coordination tasks.
- Preferred familiarity with integrating APIs, databases, or external platforms.
- Preferred understanding of system vulnerabilities including privacy leaks, prompt injection, and access escalation.
- Preferred experience with AI systems or agent-based workflows.
- Preferred comfort with persistent state tracking or similar frameworks.
Benefits
- Fully remote work arrangement with a flexible schedule.
- Project-based freelance engagement with no guaranteed hours or workload.
- Tasks are assigned based on availability and project needs, and freelancers may accept or decline invitations.
- Payment is based on completed tasks only.
