← All publications
arXiv, 2026LLM / VLA

DALI: A Workload-Aware Offloading Framework for Efficient MoE Inference on Local PCs

Zeyu Zhu, Gang Li, Peisong Wang, Zitao Mo, Minnan Pei, Zhuoran Song, Xiaoyao Liang, Jian Cheng

Overview

Workload-aware offloading for efficient mixture-of-experts inference on local PCs.

通过工作负载感知卸载,优化本地 PC 上的混合专家模型(MoE)推理。

  • Mixture of Experts
  • LLM inference
  • Offloading

Preprint, 2026. See the linked paper for the full method, experiments, and latest version.

Research by Minnan Pei (裴旻楠) and collaborators · Email