20 hours ago
Remote, United StatesSenior
Responsibilities
- Design, build, deploy, and maintain scalable platform capabilities for enterprise AI, LLM, RAG, agentic, and machine learning applications.
- Create reusable architectures, infrastructure patterns, deployment templates, integrations, and engineering standards for the AI Foundry.
- Build secure Anthropic API and Claude integrations supporting prompt and context management, structured outputs, tool use, logging, error handling, and rate limiting.
- Establish CI/CD, LLMOps, MLOps, evaluation, regression testing, deployment automation, monitoring, incident response, and lifecycle-management capabilities.
- Design and manage cloud infrastructure, infrastructure-as-code, containerized deployments, identity and access controls, secrets management, and security practices.
- Build data-ingestion, transformation, indexing, retrieval, vector-search, RAG, and enterprise data-integration pipelines.
- Implement responsible-AI safeguards, observability, tracing, auditability, governance, privacy, access controls, and human-in-the-loop workflows.
- Develop integrations among AI platforms, ServiceNow, enterprise APIs, identity providers, workflow tools, and line-of-business systems.
- Provide technical guidance, documentation, reference architectures, playbooks, customer workshops, and reusable productized platform components.
Requirements
- At least 5 years of experience in platform engineering, cloud engineering, DevOps, software engineering, data engineering, systems integration, or related technical roles.
- Hands-on experience deploying cloud-native applications on AWS, Microsoft Azure, and/or Google Cloud Platform.
- Strong experience with CI/CD, Git-based workflows, automated testing, infrastructure as code, and production release processes.
- Experience with Docker, Kubernetes, serverless services, or comparable cloud-native technologies.
- Proficiency in Python, JavaScript/TypeScript, Java, Go, Bash, or similar programming and scripting languages.
- Experience designing and consuming REST APIs and implementing authentication and authorization patterns.
- Hands-on experience with LLM-powered applications, generative AI services, AI/ML platforms, RAG systems, or AI workflow automation.
- Knowledge of prompt and context engineering, token management, embeddings, vector search, RAG, structured outputs, tool use, evaluations, and model monitoring.
- Experience with observability, including logging, metrics, tracing, alerting, and incident management.
- Strong knowledge of cloud security, identity and access management, secrets management, network security, and secure software development.
- Experience with relational and NoSQL databases, data warehouses, object storage, search platforms, or vector databases.
- Preferred experience with Claude, the Anthropic API, Anthropic Console, Claude Code, Model Context Protocol, LLM frameworks, LLM evaluation, AI tracing, guardrails, and AI observability.
- Preferred experience with MLOps platforms, data engineering, ETL/ELT, streaming, orchestration, data governance, vector databases, enterprise search, Kubernetes operations, and cloud-cost optimization.
- Preferred experience with ServiceNow architecture, development, integrations, workflow automation, consulting, professional services, enterprise architecture, or client-facing technical delivery.
- Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical discipline, or equivalent relevant professional experience.
Benefits
- Location is listed as location, hybrid, or remote, with travel based on client and business needs.
- Relevant certifications in cloud platforms, Kubernetes, DevOps, security, data engineering, ServiceNow, AI/ML, or Anthropic technologies are a plus.
- NewRocket states that it is committed to a diverse and inclusive workplace and is an equal opportunity and affirmative action employer.
- Workplace accommodations are available through hr.us@newrocket.com.
Tech Stack
Argo CDAWSAzureBashDatabricksDockerElasticsearchGitGitHub ActionsGitLab CI/CDGoGoogle Cloud PlatformHelmJavaJavaScriptJenkinsKubernetesMLflowMongoDBPostgreSQLPythonSnowflakeTerraformTypeScript
Categories
About NewRocket
NewRocket provides ServiceNow consulting, managed services, and AI-enabled workflow solutions for enterprises. The privately held firm, founded in 2016 and headquartered in Vista, California, is an Anthropic Claude Partner and designs, builds, and scales ServiceNow and LLM-based automations, governance, and integrations. It earns revenue through professional services, implementation projects, and ongoing managed support across IT service management and customer operations.