4 months ago
Remote, Romania or Bucharest, RomaniaMid Level
Responsibilities
- Develop objective, verifiable evaluation criteria and rubrics for system performance.
- Review system logs and execution paths to improve reliability and code quality.
- Refactor code and optimize system behavior toward desired outcomes.
- Test systems for vulnerabilities, data exposure, privacy leaks, prompt injection, access escalation, and edge-case failures.
- Provide detailed feedback on system performance and outputs.
- Evaluate AI-generated software behavior to support training advanced language models.
Requirements
- At least 2 years of experience in backend engineering, AI automation, or systems integration.
- Strong proficiency in at least two programming languages, such as Python, JavaScript, Go, or Java.
- Experience working with SQL databases and building and maintaining production-grade systems.
- Experience working in live, non-mocked environments with multi-step interactions.
- Strong analytical skills and attention to detail.
- Preferred experience with multi-stage workflows, coordination tasks, APIs, databases, external platforms, system vulnerabilities, AI or agent-based workflows, and persistent state tracking.
Benefits
- Fully remote work with a flexible schedule.
- Project-based freelance engagement with no guaranteed hours or workload.
- Tasks are assigned based on availability and project invitations may be accepted or declined.
- Payment is based only on completed tasks.
