Senior Software Engineer (AI Applications)
AlphaSenseabout 1 month ago
Responsibilities
- Deploy LLM based production grade solutions.
- Fine-tune and adapt state-of-the-art LLMs for specialized data extraction tasks.
- Solve engineering challenges related to LLM solutions, such as high latency and non-deterministic output.
- Implement and scale data processing pipelines for high volumes of complex documents.
- Integrate and manage LLM observability to trace, debug, and monitor extractions.
- Own systems end-to-end, including design, coding, monitoring, testing, CI/CD, and on-call support.
Requirements
- 6+ years of experience as a software engineer, primarily with Python.
- Advanced degree in Computer Science, Computer Engineering, or a relevant field focused on AI or machine learning, or equivalent industry experience.
- 2+ years of hands-on experience building and deploying applications using Large Language Models (LLMs).
- Experience in extracting structured JSON from text using LLMs and a deep understanding of prompt engineering.
- Proficiency in classic NLP libraries for tasks like NER, text classification, and pre-processing.
- Experience with LLM tracing, debugging, and evaluation platforms such as Langfuse.
- Excellent communication, organizational, problem-solving, debugging, and analytical skills.