Associate Software Engineer
Duck Creek Technologies2 days ago
Bengaluru, IndiaEntry Level
Responsibilities
- Build and extend LLM evaluation harnesses using golden datasets, precision/recall/F1, calibration, and LLM-as-judge scoring.
- Design and work with knowledge graphs, including entity-relationship modelling, graph traversal, queries, embeddings-based similarity, and retrieval.
- Build GenAI/LLM pipelines in Python using prompting, RAG, and structured output.
- Write clean, tested code, collaborate with senior engineers, and document technical work.
- Act in accordance with Duck Creek Technologies’ mission, vision, and core values.
Requirements
- B.Tech/M.Tech with an AI/ML specialization, or a CS/IT degree with strong, demonstrable AI coursework or projects.
- 0 to 2 years of experience.
- Strong Python fundamentals and a solid grasp of data structures and algorithms.
- Working understanding of LLM fundamentals, including prompting, embeddings, RAG, and basic evaluation concepts.
- Maintained personal GitHub profile with at least one substantive original AI/LLM project; cloned tutorials do not qualify.
- Provide a resume and working GitHub profile link; applications without a working GitHub link showing original project work will not be considered.
- Preferred: exposure to generative-AI evaluation frameworks or metrics such as Ragas, DeepEval, or a self-built LLM-judge approach.
- Preferred: exposure to knowledge graphs or graph data structures such as NetworkX, Neo4j, RDF/OWL, or a custom graph model.
- Preferred: experience with an agent framework such as LangChain or LangGraph, vector databases, a cloud platform, and REST API basics using FastAPI or Flask.
Benefits
- Flexible-first work model with autonomy over day-to-day work.
- Work may begin remotely, subject to business needs and company guidelines.
- Role is aligned to a designated location and requires residence within reasonable proximity.
- The role may transition to a hybrid arrangement with office attendance determined by the leader and organizational needs.
- Inclusive culture, equal-opportunity employment, and collaboration across diverse perspectives.
Tech Stack
Categories
About Duck Creek Technologies
Duck Creek Technologies builds cloud-based core systems for property and casualty insurers, including policy administration, billing, claims, rating, data, and agent/consumer portals, sold as SaaS or modular products. It generates revenue from software subscriptions and services that modernize and integrate insurers’ operations. Founded in 2000 and headquartered in Boston, it is privately held and backed by Vista Equity Partners.