Staff Engineer / AI Builder
Robots and Pencils5 hours ago
Remote, CanadaStaff+
Responsibilities
- Design and build agentic workflows using reasoning loops, tool and function calling, and single- or multi-agent orchestration.
- Build and maintain RAG pipelines covering chunking, embeddings, vector search, re-ranking, and knowledge refresh handling.
- Integrate AWS Bedrock and Agent Core, including MCP-based tool design and agent memory or session management.
- Create production system prompts, evaluation datasets, LLM-as-judge workflows, RAGAS-style metrics, and tracing or observability.
- Design reliability patterns for LLM systems, including retries, backoff, jitter, circuit breakers, fallback models, and degradation handling.
- Build Python and Node.js backend services, AWS serverless architectures, DynamoDB schemas, and event-driven workflows.
- Contribute to frontend integration, deployment, monitoring, troubleshooting, debugging, and production hardening.
- Provide technical leadership, establish engineering standards, mentor engineers, and own features and releases end-to-end.
Requirements
- 6+ years of professional software engineering experience, including meaningful experience shipping GenAI or LLM-powered systems in production.
- Hands-on expertise with agentic AI, reasoning loops, tool or function calling, and single- and multi-agent orchestration.
- Practical RAG expertise with chunking strategies, embeddings, vector databases, cosine similarity search, and re-ranking.
- Experience building LLM evaluation and observability systems using golden datasets, LLM-as-judge, RAGAS or comparable metrics, and tracing tools.
- Strong production prompt-engineering skills involving structured role framing, output constraints, and few-shot design.
- Hands-on experience with AWS Bedrock, Agent Core, Lambda, DynamoDB single-table design, S3, SQS, EventBridge, and Step Functions.
- Strong Python and Node.js skills with experience building full-stack applications and APIs.
- Understanding of production reliability patterns for LLM-backed systems, including retries, backoff, circuit breakers, and fallback models.
- Experience with Docker and cloud-native deployment, plus the ability to own ambiguous and integration-heavy technical problems.
- Helpful qualifications include direct Amazon Bedrock Agent Core experience, regulated-domain experience, familiarity with Sequencer or similar state-machine orchestration, and production experience with LLM observability tooling.
Benefits
- Annual base salary range of CAD $176,612–$243,680.
About Robots and Pencils
Robots & Pencils is an applied AI engineering firm that designs, builds, and runs production AI systems and agentic co-workers for enterprise operations, with a focus on AWS. The privately held company, founded in 2009 and headquartered in Chagrin Falls, Ohio, provides consulting and implementation services spanning data readiness, cloud modernization, and AI enablement. It is an AWS Advanced Tier Services Partner with delivery teams across the U.S., Canada, Eastern Europe, and Latin America.