Staff AI Platform Engineer
Bread Financial1 month ago
Bengaluru, IndiaStaff+
Responsibilities
- Design and build orchestration layers for LLM workflows and multi-step agent pipelines with tool use, retrieval, grounding, function calling, SLAs, retries, rate limiting, and tracing.
- Implement vector data infrastructure, indexing strategies, embeddings management, retrieval-augmented generation patterns, and data lifecycle controls.
- Develop provider-agnostic LLM interfaces and SDKs with standardized prompts, guardrails, evaluation harnesses, and A/B testing support.
- Integrate logging, tracing, metrics, prompt and response analytics, evaluation pipelines, and service-level objective dashboards.
- Enforce data classification, redaction, personally identifiable information controls, prompt injection defenses, content filtering, secrets management, and policy-as-code for model and endpoint access.
- Implement infrastructure as code, CI/CD for model and prompt artifacts, environment promotion, and cost monitoring and optimization.
- Partner with data engineering, security, and product teams to productionize capabilities and drive adoption through documentation, templates, and enablement.
- Participate in on-call rotations, root-cause analysis, and continuous improvement of performance, reliability, and developer experience.
Requirements
- Bachelor’s degree in computer science, engineering, or a related field, or equivalent relevant work experience.
- At least 8 years of overall software engineering experience.
- At least 3 years of experience building AI platform components.
- At least 4 years of experience implementing LLM-based services, including prompt templates, tool and function calling, retrieval-augmented generation, and rate and latency management.
- Preferred qualifications include a master’s degree or equivalent relevant work experience, AWS Cloud Practitioner Certification, 8+ years of software engineering experience, and 4+ years building AI platform components and LLM-based services.
- Experience with Python, TypeScript, AWS services, OpenSearch, Terraform, observability tools, and related platform technologies.
Benefits
- Hybrid work arrangement requiring 6–8 days per month in the office.
- Bread Financial offers wellness benefits, career development opportunities, community involvement opportunities, and non-traditional career progression.
- Employment offers are contingent upon successful completion of credit and background checks.
Tech Stack
Categories