Software Engineer, LLM & Automation
Basis Research Instituteover 1 year ago
Remote, United States or New York, NY, USAMid Level
H1B sponsor
Responsibilities
- Architect and maintain automation pipelines combining internal tools with GPT, Claude, and other LLMs.
- Integrate data from third-party APIs, including ATS platforms, Slack, and Google, into unified automated workflows.
- Use structured generation such as JSON schemas and function calling to produce robust LLM outputs.
- Collaborate with Operations and R&D to identify and implement high-impact automation opportunities.
- Write modular, reliable, production-grade code with strong error handling.
- Deploy, scale, optimize, and secure solutions in cloud-based environments.
- Document solutions for technical and non-technical audiences to support maintenance and updates.
Requirements
- At least three years of production-level programming experience in Julia and/or Python, or equivalent experience.
- Experience integrating LLMs through structured prompts, scaffolding frameworks, or advanced text-generation approaches.
- Ability to manage concurrency, scaling, performance optimization, API rate limits, OAuth, and error retries.
- Experience or familiarity with secure handling of PII, encryption, and secrets management.
- Preferred experience with Julia performance tuning, HPC, or scientific computing workflows.
- Preferred experience building Python microservices with FastAPI, Flask, or other frameworks and using advanced concurrency techniques.
- Preferred familiarity with LangChain, open-source LLM clients, or custom chain-of-thought integrations.
- Preferred experience with Docker, Kubernetes, cloud deployments on AWS, GCP, or Azure, distributed processing, task queues, event-driven systems, and PostgreSQL or similar databases.
- Strong collaboration, communication, adaptability, and problem-solving skills.
Benefits
- Flexible arrangement: contractor, part-time, or full-time employment options.
- Opportunity to work at a nonprofit applied AI research organization.
- Equal employment opportunity and privacy protections are described in the posting.
Tech Stack
Categories
About Basis Research Institute
Basis Research Institute is a nonprofit applied AI research organization that studies and builds intelligence, from mathematical principles of reasoning and learning to software systems that embody them. It operates as a grant- and donation-funded institute, publishing research and developing tools to advance large-scale problem solving. Founded in 2022 and headquartered in New York, it maintains offices and labs in New York and Cambridge, MA.