1 day ago
Responsibilities
- Own the end-to-end design, development, and operation of AI Gateway, model routing, evaluation platform, and harness vending systems.
- Develop usage telemetry, cost allocation, and chargeback mechanisms for transparent AI spending visibility.
- Lead feature architecture, implementation planning, workstream parallelization, and cross-team dependency alignment.
- Facilitate design reviews, evaluate architectural trade-offs, and establish coding and architecture standards.
- Automate build, testing, and deployment workflows; resolve production incidents and implement post-incident improvements.
- Maintain a 6-to-12-month technical vision and make build-versus-adopt decisions across the tooling ecosystem.
- Partner with internal engineering teams to understand workflows, drive adoption, and improve platform capabilities.
- Mentor engineers through code and design feedback.
Requirements
- Bachelor’s degree plus 3–4 years of experience or master’s degree plus 2–3 years of experience in software engineering, computer science, or a related field.
- Advanced programming expertise in at least one of Java, Kotlin, Python, Go, or Scala.
- Proven expertise in distributed systems, including security, concurrency, fault tolerance, horizontal scaling, and idempotence trade-offs.
- Track record of technical leadership in feature delivery, cross-functional alignment, and production-platform architecture.
- Hands-on experience building AI-assisted developer tooling and LLM-based systems, including coding assistants, autonomous agents, prompt engineering, or tool-execution frameworks.
- Hands-on experience with AWS or GCP, containerization, modern CI/CD pipelines, and operational on-call ownership.
- Product-oriented mindset focused on internal developers, platform adoption, and user sentiment.
- Strong written and verbal communication skills, including technical design documentation and stakeholder presentations.
- Experience building or operating LLM evaluation pipelines, model proxies, or semantic request-routing layers is preferred.
- Experience with internal developer platforms, developer tooling, CLI workflows, cost telemetry, usage-based metering, FinOps instrumentation, or regulated fintech environments is preferred.
Categories
About SoFi
SoFi provides consumer banking, lending, and investing products, including student-loan refinancing, personal loans, mortgages, checking and savings, a credit card, and brokerage. It earns interest and fee revenue across SoFi Bank, N.A., and related subsidiaries, serving U.S. consumers via a mobile app. Founded in 2011 and headquartered in San Francisco, SoFi Technologies is publicly traded on Nasdaq under the ticker SOFI.