Responsibilities
- Bridge generative AI research and real-world industrial applications by delivering performant, grounded, and integrated agent solutions.
- Design and rapidly prototype AI agents, workflows, system integrations, and industry-specific LoRA fine-tuned models.
- Write production-quality code integrating AI model APIs with agent frameworks and supporting tools such as RAG, vector databases, memory, and caching.
- Optimize prompt chains, latency, throughput, and cost for AI features serving potentially millions of users.
- Develop evaluation frameworks and guardrails using LLM-as-a-judge and human-in-the-loop methods to assess safety, accuracy, hallucination risk, and model performance.
- Collaborate with product and algorithm research teams to communicate field signals and influence the product roadmap.
Requirements
- Bachelor's degree in engineering, computer science, or a related field.
- At least 3 years of related work experience in the AI-native industry, preferably as a solutions architect, product solutions professional, or forward deployed engineer.
- Deep understanding of public-cloud AI solutions and industry applications of LLMs.
- Knowledge of agentic AI design paradigms including ReAct, Plan and Execute, Multi-Agent, and Skills.
- Practical AI infrastructure knowledge, including GPU selection and model inference acceleration frameworks such as vLLM and sglang.
- Proficiency in Python and experience with FastAPI, PyTorch or JAX, and orchestration frameworks such as LangChain or LlamaIndex.
- Understanding of SQL/NoSQL data systems and large-scale data processing with Spark or Flink.
- Experience with Docker, Kubernetes, and deploying models on cloud providers.
- Fluency in spoken and written English and Mandarin.
- Experience with large DNB and internet application clients, particularly products with more than 1 million monthly active users, is preferred.
- Ability to work independently in a fast-paced, ambiguous environment and collaborate effectively with teams.
Tech Stack
Categories
About ByteDance
ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. We are committed to building a safe, healthy and positive online environment for all our users. We have over 110,000 employees based in more than 30 countries globally. Join us.