Research Engineer, Applied AI Engineering
OuterSignal2 months ago
New York, NY, USAMid Level
Responsibilities
- Build and improve production AI/data pipelines spanning LLMs, APIs, databases, and workflow systems.
- Design evaluations and Jupyter notebooks to measure model behavior, data quality, extraction accuracy, and customer impact.
- Add observability to AI workflows for cost, latency, reliability, and quality.
- Experiment with models, retrieval strategies, structured-output techniques, prompt and program architectures, and model routing.
- Integrate with research and AI APIs and create robust abstractions around them.
- Help establish infrastructure for inference serving, fine-tuning, dataset generation, and model evaluation.
Requirements
- Strong software engineering ability across distributed systems, data pipelines, databases, and multiple programming languages.
- Deep familiarity with modern AI tools and the ability to apply first-principles thinking to ambiguous problems.
- Strong judgment, maintainability focus, and an emphasis on measurement through evaluations, tests, traces, and data.
- Experience with PyTorch, Hugging Face, vLLM, Ray, MLflow, RAG, fine-tuning, reinforcement learning, inference serving, or model evaluation systems is preferred but listed as a bonus.
Benefits
- Meaningful equity in a venture-backed company.
- Opportunity to shape the Applied AI Engineering organization from its beginning.
- Work on production AI systems that directly affect customers, data quality, and revenue.
- Broad ownership connecting research ideas to production systems and customer-facing products.
Tech Stack
Categories
About OuterSignal
OuterSignal provides brands with instant VIP-customer detection and real-time, fully enriched customer profile data on every single order. It quickly, securely, and compliantly integrates with any eCommerce platform, allowing brands to monitor and segment customers based on age, gender, location, profession, income, social following, and more. Whether it’s flagging celebrities, athletes, investors, podcasters, buyers at large retail chains, or simply identifying micro-influencers within a target cohort (i.e. college-aged influencers), OuterSignal finds, flags and activates the customers that matter most while providing unprecedented visibility into the actual customers behind a brand.