Associate Software Engineer
Duck Creek Technologies14 hours ago
Bengaluru, IndiaEntry Level
Responsibilities
- Build and extend LLM evaluation harnesses using golden datasets, precision/recall/F1, calibration, and LLM-as-judge scoring.
- Design knowledge graphs through entity-relationship modelling, graph traversal, queries, embeddings-based similarity, and retrieval.
- Build GenAI and LLM pipelines in Python using prompting, RAG, and structured output.
- Write clean, tested code; collaborate with senior engineers; and document work.
- Support the team’s mission of making AI/LLM systems correct, trusted, queryable, and reasoned over.
Requirements
- B.Tech/M.Tech with an AI/ML specialization, or a CS/IT background with strong, demonstrable AI coursework or projects.
- 0–2 years of experience.
- Strong Python fundamentals and a solid grasp of data structures and algorithms.
- Working understanding of LLM fundamentals, including prompting, embeddings, RAG, and basic evaluation concepts.
- A maintained personal GitHub profile with at least one substantive original AI/LLM project; cloned tutorials do not qualify.
- A working GitHub link must be included with the resume for consideration.
- Preferred exposure to generative-AI evaluation frameworks or metrics such as Ragas, DeepEval, or a self-built LLM-judge approach.
- Preferred exposure to knowledge graphs or graph data structures, including NetworkX, Neo4j, RDF/OWL, or a custom graph model.
- Preferred familiarity with LangChain, LangGraph or similar agent frameworks, vector databases, a cloud platform, and REST API basics using FastAPI or Flask.
Benefits
- Flexible-first work arrangement with autonomy over day-to-day work.
- The role is aligned to a designated location, requires residence within reasonable proximity, and may begin remotely subject to business needs and company guidelines.
- The position may transition to a hybrid arrangement requiring work from a designated office according to organizational needs.
- Inclusive culture focused on respect, collaboration, diversity, equity, and continuous learning.
Tech Stack
Categories
About Duck Creek Technologies
Duck Creek Technologies builds cloud-based core systems for property and casualty insurers, including policy administration, billing, claims, rating, data, and agent/consumer portals, sold as SaaS or modular products. It generates revenue from software subscriptions and services that modernize and integrate insurers’ operations. Founded in 2000 and headquartered in Boston, it is privately held and backed by Vista Equity Partners.