Offensive AI Engineer – Frontier AI Security & Testing, VP
State Street3 days ago
Base Salary
$120k - $203k/yr
Responsibilities
- Design, engineer, and deploy secure, isolated AWS environments for hosting and accessing frontier AI models.
- Build infrastructure-as-code, deployment patterns, and CI/CD pipelines for AI workloads.
- Implement network segmentation, identity and access controls, secrets management, egress restrictions, and enforceable trust boundaries.
- Integrate frontier model provider APIs and SDKs and build model-agnostic abstraction layers.
- Develop evaluation harnesses and benchmarking frameworks for model capability, precision, false-positive rate, reliability, cost, and failure modes.
- Build agentic workflows, tool-use integrations, and multi-agent orchestration for reconnaissance, attack-path analysis, and adversary simulation.
- Stress-test models for prompt injection, jailbreak susceptibility, data leakage, tool misuse, scope drift, and unsafe behavior.
- Develop Databricks pipelines to ingest, curate, and analyze model telemetry, evaluation results, and offensive security datasets.
- Apply statistical analysis, scoring, trend analysis, and regression detection across model versions.
- Build data products and dashboards for model performance, cost, and risk reporting.
- Create secure integrations with AI platforms, enterprise systems, security tools, and data sources.
- Implement guardrails, human-in-the-loop checkpoints, rate and scope limits, kill switches, and least-privilege tool access.
- Engineer logging, monitoring, and observability for agent inputs, outputs, tool calls, and decision paths.
- Produce technical documentation and evidence for audit, regulatory review, responsible AI, and model-risk requirements.
Requirements
- Bachelor's degree in computer science, engineering, data science, information systems, artificial intelligence, or equivalent practical experience.
- At least 5 years of hands-on experience in software, cloud, data, or security engineering.
- At least 2 years of hands-on experience building and deploying GenAI, LLM, or agentic AI solutions on cloud platforms, preferably AWS.
- Deep hands-on experience with AWS AI infrastructure, including Amazon Bedrock, SageMaker, Lambda, API Gateway, EKS/ECS, IAM, KMS, and VPC networking.
- Direct experience with frontier LLMs through vendor APIs, prompt and context engineering, tool use, function calling, agentic workflows, and model evaluation.
- Strong Python skills and experience with GenAI or agentic frameworks such as LangChain, LangGraph, Strands, CrewAI, Pydantic, or MCP.
- Hands-on Databricks experience with PySpark, SQL, Delta Lake, and workflows, plus grounding in data science and statistical analysis.
- Experience designing and consuming APIs and event-driven integrations.
- Working understanding of AI security risks and controls, including OWASP Top 10 for LLM Applications, MITRE ATLAS, and NIST AI RMF.
- Familiarity with offensive security concepts and adversary frameworks such as MITRE ATT&CK is strongly preferred.
- Experience with infrastructure-as-code, preferably Terraform, and CI/CD tooling.
- AWS or Databricks certifications are a plus.
- Offensive security certifications such as OSCP, OSEP, or GPEN, or penetration-testing experience, are a plus.
- Experience in financial services or another highly regulated industry is preferred.
- Strong critical-thinking, problem-solving, communication, research, and learning abilities.
Benefits
- Retirement savings plan with 401(k) company match.
- Insurance coverage including basic life, medical, dental, vision, long-term disability, and optional additional coverages.
- Paid time off including vacation, sick leave, short-term disability, and family-care responsibilities.
- Employee Assistance Program access.
- Eligibility for annual performance-based incentive awards and certain tax-advantaged savings plans.
- Inclusive development opportunities, flexible work-life support, paid volunteer days, and employee networks.
About State Street
State Street is a global custodian bank and asset manager serving institutional investors with investment servicing, fund accounting, trading/FX, data, and index/active strategies. Its products include State Street Global Advisors’ funds and ETFs, the Charles River Investment Management Solution, and the front-to-back State Street Alpha platform. Founded in 1792 and headquartered in Boston, the company is publicly traded on the NYSE (ticker: STT) and operates across major markets worldwide.