5 months ago
Remote, United StatesSenior
Responsibilities
- Design, implement, and optimize LLM-powered systems such as RAG pipelines, chat agents, summarizers, and knowledge graph integrations.
- Build and manage data indexing and retrieval pipelines using LlamaIndex, LangChain, or similar frameworks.
- Implement and maintain vector database solutions.
- Integrate open-source and proprietary LLMs into the CoreStory Platform.
- Develop AI-driven features such as generative insights, automated summarization, and narrative analytics.
- Collaborate with DevOps and backend teams to deploy scalable AI services in the cloud infrastructure.
- Benchmark model performance, latency, and cost and identify optimization opportunities.
- Track advances in AI and propose applications aligned with CoreStory’s mission.
- Contribute to internal documentation, experimentation frameworks, and evaluation methodologies.
Requirements
- At least 7 years of overall engineering experience, including at least 3 years in AI engineering, machine learning, or applied NLP.
- Hands-on experience with LlamaIndex, LangChain, or similar orchestration frameworks.
- Experience designing and implementing vector database solutions.
- Strong understanding of LLM APIs, including OpenAI, Anthropic, Mistral, or Hugging Face.
- Proficiency in Python and experience with FastAPI, Pandas, or NumPy.
- Understanding of RAG patterns, embeddings, and tokenization.
- Familiarity with prompt engineering, tool calling, and chat agent architectures.
- Strong problem-solving and analytical abilities with attention to performance and scalability.
- Preferred experience deploying AI services with Docker, Azure, or AWS.
- Preferred exposure to LangGraph, semantic search, hybrid RAG systems, knowledge graphs, document intelligence, or multimodal AI.
- Previous SaaS or early-stage startup experience is preferred.
Benefits
- Flexible, remote-first work environment
- Competitive compensation and equity
- Opportunities to define and build the AI roadmap
- Collaborative, learning-oriented culture
- Access to cutting-edge AI models, research, and infrastructure
Categories
About CoreStory
CoreStory delivers enterprise-grade code intelligence for modernization, onboarding, and governance. Unlike generic AI tools that focus on code generation, CoreStory builds structured understanding—capturing business rules, system relationships, and developer intent. Our platform enhances tools like GitHub Copilot by 51% through deep analysis and reasoning. Used by Fortune 500s, CoreStory turns legacy code into an asset, enabling faster, safer modernization and continuous innovation.