ByteDance

Tech Lead, Software Engineer - AI Agent Memory Infrastructure

ByteDance
Apply
2 hours ago
San Jose, CA, USAStaff+
H1B sponsor

Responsibilities

  • Design, build, and evolve unified memory infrastructure for long-term, conversational, and task-oriented AI-agent memory.
  • Architect and optimize large-scale, low-latency memory pipelines covering ingestion, storage, indexing, retrieval, updating, compression, and forgetting.
  • Develop memory representations, retrieval and ranking systems, conflict-resolution workflows, summarization and fusion capabilities, and memory lifecycle management.
  • Design multimodal memory models and processing workflows for text, images, audio, and behavioral signals.
  • Collaborate with model, application, and platform teams to productionize memory capabilities and optimize quality, latency, cost, reliability, and safety.
  • Track advancements in AI-agent memory and contribute to the long-term technical roadmap.

Requirements

  • Bachelor’s degree or higher in Computer Science, Artificial Intelligence, Data Science, or a related field.
  • Strong experience in distributed systems, databases, information retrieval systems, or AI infrastructure, with proven system design and production engineering capabilities.
  • Proficiency in at least one of Go, Python, or C++.
  • Strong understanding of LLM application technologies including embeddings, retrieval-augmented generation, context engineering, retrieval systems, and long-term state management.
  • Familiarity with memory extraction and representation, vector or graph indexing, retrieval and ranking, memory updating, compression and forgetting, or multimodal memory fusion.
  • Preferred experience with agent memory systems, user profiling, recommendation or search feature platforms, knowledge bases, multimodal processing, online inference, personalized agents, or long-term user-state modeling.
  • Preferred contributions to or deep understanding of open-source memory frameworks such as mem0, memOS, or memU.
  • Preferred track record in databases, information retrieval, machine learning, or AI systems through publications, open-source work, or notable technical achievements.
  • Preferred experience optimizing system and algorithm trade-offs involving performance, latency, cost, and scalability in complex production systems.
ByteDance

About ByteDance

10,000+ employees

ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. We are committed to building a safe, healthy and positive online environment for all our users. We have over 110,000 employees based in more than 30 countries globally. Join us.

Contact me