ByteDance

Senior Software Engineer - AI Agent Memory Infrastructure

ByteDance
Apply
1 day ago
San Jose, CA, USASenior
H1B sponsor

Responsibilities

  • Design, build, and evolve unified memory infrastructure supporting long-term, conversational, and task-oriented AI agent memory.
  • Architect and optimize large-scale, low-latency memory pipelines for ingestion, storage, indexing, retrieval, updating, compression, and forgetting.
  • Develop memory representation, retrieval and ranking, conflict resolution, summarization, fusion, and lifecycle-management capabilities.
  • Design processing workflows for multimodal text, image, audio, and behavioral data.
  • Collaborate with model, application, and platform teams to productionize memory capabilities.
  • Optimize system quality, latency, cost, reliability, scalability, and safety, and contribute to the technical roadmap.

Requirements

  • Bachelor’s degree or higher in Computer Science, Artificial Intelligence, Data Science, or a related field.
  • Strong experience in distributed systems, databases, information retrieval systems, or AI infrastructure, with proven system design and production engineering capabilities.
  • Proficiency in at least one of Go, Python, or C++.
  • Strong understanding of LLM application technologies including embeddings, retrieval-augmented generation, context engineering, retrieval systems, and long-term state management.
  • Familiarity with memory extraction and representation, vector or graph indexing, retrieval and ranking, memory updating, compression and forgetting, or multimodal memory fusion.
  • Preferred experience with agent memory systems, user profiling, recommendation or search feature platforms, knowledge bases, multimodal data processing, online inference systems, personalized agents, or long-term user state modeling.
  • Preferred contributions to or deep understanding of open-source memory frameworks such as mem0, memOS, or memU, along with impactful publications, open-source work, or technical achievements.
ByteDance

About ByteDance

10,000+ employees

ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. We are committed to building a safe, healthy and positive online environment for all our users. We have over 110,000 employees based in more than 30 countries globally. Join us.

Contact me