Cisco

AI Automation Engineer (Quality) NC Hybrid

Cisco
Apply
3 days ago
Durham, NC, USAEntry Level / Mid Level
H1B sponsor

Base Salary

$129k - $185k/yr

Responsibilities

  • Build and maintain automated regression and end-to-end test suites using Playwright, TypeScript/JavaScript, Python/Pytest, Robot Framework, and Selenium.
  • Design REST and GraphQL API tests covering functional correctness, contract validation, error handling, and performance.
  • Execute load, stress, and soak testing with k6 or JMeter, tracking response times, throughput, errors, TTFT, and inter-token latency.
  • Use Cursor, GitHub Copilot, and Claude Code to generate and maintain tests while validating their stability, correctness, and security compliance.
  • Test AI/LLM features and agent workflows for response quality, behavioral consistency, and reasoning/action-layer performance.
  • Integrate tests into CI/CD pipelines using GitHub Actions, Jenkins, or equivalent tools and create Grafana and Allure quality reports.
  • Define automation standards, mentor peers, and communicate quality metrics, risks, and defect trends to cross-functional stakeholders.

Requirements

  • Bachelor’s degree with 4+ years, Master’s degree with 3+ years, or PhD with 1+ year of related experience in Computer Science, AI/ML, or a related technical field.
  • Experience developing test automation and regression frameworks with a strong understanding of functional quality assurance.
  • Experience with Playwright for TypeScript/JavaScript E2E/UI automation and/or Python with Pytest or Robot Framework; familiarity with Selenium.
  • Experience with REST API testing and familiarity with API contract testing; GraphQL testing is a plus.
  • Knowledge of software development lifecycles, CI/CD pipelines, and automated testing practices.
  • Experience with AI-assisted coding tools such as GitHub Copilot, Cursor, or Claude Code and with Agile/Git workflows.
  • Preferred experience testing AI/ML-powered applications, LLM features, chatbots, or AI-agent workflows.
  • Preferred hands-on experience with k6, JMeter, TTFT, inter-token latency, and token throughput metrics.
  • Preferred experience with AI Ops/MLOps, custom LLM fine-tuning, Splunk, Grafana, Prometheus, Docker, Kubernetes, and Google Cloud Platform.
  • Preferred experience leading technical projects, mentoring junior engineers, and building or productizing agentic applications with evaluation and business acceptance.

Benefits

  • Starting salary range is $128,600.00 to $184,900.00, excluding incentive compensation, equity, and benefits.
  • Benefits may include medical, dental and vision insurance, a 401(k) with Cisco matching, paid parental leave, disability coverage, life insurance, stock-unit grants, paid holidays, vacation, sick time, wellness days, volunteer time, and annual bonuses subject to eligibility and company policies.
  • The position is hybrid and based in North Carolina.

Tech Stack

Apache JMeterDockerGitHub ActionsGoogle Cloud PlatformGrafanaGraphQLJavaScriptJenkinsKubernetesPrometheuspytestPythonRobot FrameworkSeleniumSplunkTypeScript

Categories

Cisco

About Cisco

10,000+ employees

Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.

Contact me