Security Engineer, Anti-Abuse
Arena Intelligence, Inc.5 months ago
Responsibilities
- Own the platform-abuse vision, including detection, enforcement speed, and false-positive budgets.
- Design and operate detection for bots, sybils, coordinated inauthentic voting, and rating-system manipulation.
- Build reversible and auditable enforcement primitives such as rate limits, challenges, shadowbans, account actions, and model-side refusals.
- Detect and mitigate inference abuse, cost exploitation, jailbreaks, and multi-provider misuse.
- Define abuse monitoring for new products and develop production detection, review, and enforcement systems for severe harms.
- Build investigator tooling for policy, on-call, and trust-and-safety analysts.
- Partner with Security on account takeover, credential stuffing, API-key abuse, and identity and behavioral signals.
- Collaborate with model providers, policy, legal, and leadership on signal sharing, escalations, acceptable-use policy, and public-integrity communications.
Requirements
- 6+ years of production software engineering experience, including building and operating systems under adversarial conditions.
- Shipped experience in trust and safety, anti-abuse, anti-fraud, anti-spam, integrity, or risk engineering.
- Strong SQL and data-analysis skills, including pattern-finding and investigation.
- Adversarial and investigative mindset with strong judgment regarding false positives, user harm, and reversible enforcement.
- Proficiency in at least one modern backend language: Node.js, TypeScript, Python, or Go.
- Excellent communication and ability to align with engineering, product, policy, and leadership.
- Bonus: experience with LLM adversarial inputs, agent safety, browser-automation abuse, LLM API abuse, platform manipulation, ML systems, investigator tooling, open-source trust and safety, gaming integrity, ad fraud, or financial-crime engineering.
Benefits
- Competitive compensation and equity aligned to the markets where team members are based, with base salary dependent on permanent work location.
- Comprehensive medical, dental, vision, and additional wellness support programs.
- Opportunity to work on cutting-edge AI with a small, mission-driven team.
- Transparent, trust-focused culture centered on community impact.
About Arena Intelligence, Inc.
Created by researchers from UC Berkeley, Arena (formerly LMArena) is a community-powered platform to measure and advance the frontier of AI for real-world use. Tens of millions of builders, researchers, and creative professionals come to Arena to use frontier models and give feedback on their responses, shaping a public leaderboard grounded in real-world use.