Sr. Associate Software Engineer
Duck Creek Technologies13 hours ago
Bengaluru, IndiaSenior
Responsibilities
- Build and extend LLM evaluation harnesses with golden datasets, precision/recall/F1, calibration, and LLM-as-judge scoring.
- Design and work with knowledge graphs, including entity-relationship modeling, graph traversal, queries, embeddings-based similarity, and retrieval.
- Build GenAI/LLM pipelines in Python using prompting, RAG, and structured output.
- Write clean, tested code; collaborate with senior engineers; and document technical work.
- Act in accordance with Duck Creek Technologies’ mission, vision, and core values.
Requirements
- B.Tech/M.Tech with an AI/ML specialization, or CS/IT education with strong, demonstrable AI coursework or projects.
- 0 to 2 years of experience.
- Strong Python fundamentals and a solid grasp of data structures and algorithms.
- Working knowledge of LLM fundamentals, including prompting, embeddings, RAG, and basic evaluation concepts.
- A maintained personal GitHub profile with at least one substantive, original AI/LLM project; cloned tutorials are not accepted.
- Applicants must provide a resume and a working GitHub profile link showing original project work.
- Preferred: exposure to generative-AI evaluation frameworks or metrics such as Ragas, DeepEval, or a self-built LLM-judge approach.
- Preferred: exposure to knowledge graphs or graph data structures such as NetworkX, Neo4j, RDF/OWL, or a custom graph model.
- Preferred: familiarity with LangChain/LangGraph or similar agent frameworks, vector databases, any cloud platform, and REST API basics using FastAPI or Flask.
Benefits
- Flexible-first work model with autonomy in day-to-day work.
- The role is aligned to a designated location and requires residence within reasonable proximity.
- Work may initially be remote, with potential transition to a hybrid arrangement requiring office attendance according to leader and business needs.
- Inclusive culture focused on respect, collaboration, learning, diversity, equity, and belonging.
Tech Stack
Categories
About Duck Creek Technologies
Duck Creek Technologies builds cloud-based core systems for property and casualty insurers, including policy administration, billing, claims, rating, data, and agent/consumer portals, sold as SaaS or modular products. It generates revenue from software subscriptions and services that modernize and integrate insurers’ operations. Founded in 2000 and headquartered in Boston, it is privately held and backed by Vista Equity Partners.