Principal Software Engineer (AI) ( US)

about 22 hours ago

New York, NY, USA or Remote, United States

Staff+

H1B Sponsor

Responsibilities

Lead the reference architecture for AI and agentic systems within key product domains.
Design and deliver production-ready AI systems ensuring reliability and scalability.
Establish platform-level AI and data components, including model brokers and orchestration services.
Lead the design of end-to-end AI data pipelines for various data processing tasks.
Partner with data and analytics teams to align AI solutions with measurable outcomes.
Help product teams transition from problem framing to AI-enabled solutions.
Contribute to innovation by evaluating emerging AI tools and frameworks.
Ensure all AI solutions are production-grade with strong observability and incident response practices.
Mentor and coach engineers to elevate AI and data engineering capabilities.
Drive adoption of shared AI and data best practices across teams.

Proven experience leading and delivering production AI systems across multiple engineering teams.
Strong background in AI engineering with a data-first mindset.
Hands-on experience with modern AI/agent frameworks such as LangChain or equivalent.
Deep understanding of RAG and agentic architectures.
Experience designing evaluation methodologies tied to product metrics.
Experience implementing security by design and responsible AI practices in regulated environments.
Preferred: Experience deploying AI systems in healthcare or regulated industries.
Preferred: Familiarity with model serving infrastructure and multi-model routing.
Preferred: Experience partnering with Product Management to deliver AI-enabled capabilities.
Preferred: Master's degree in Artificial Intelligence, Computer Science, or related field.