Publications & Contributions

Areas

LLM Inference/Efficiency
Generative AI for Science
Optimization

Preprints

• ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
  H. Sun, L.W. Chang, W. Bao, S. Zheng, N. Zheng, X. Liu, H. Dong, Y. Chi, B. Chen
  Preprint, 2024

Conferences

• Leveraging Multimodal Diffusion Models to Accelerate Imaging with Side Information
  T. Efimov, H. Dong, M. Shah, J. Simmons, S. Donegan, Y. Chi
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2025

  • Oral presentation/poster at the Computational Imaging Conference at Electronic Imaging, 2025.

• Prompt-prompted Adaptive Structured Pruning for Efficient LLM Generation
  H. Dong, B. Chen, Y. Chi
  Conference on Language Modeling (COLM), 2024

  • Oral presentation at ICML Workshop on Efficient Systems for Foundation Models, 2024.

• Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference
  H. Dong, X. Yang, Z. Zhang, Z. Wang, Y. Chi, B. Chen
  International Conference on Machine Learning (ICML), 2024

• Deep Unfolded Tensor Robust PCA with Self-supervised Learning
  H. Dong, M. Shah, S. Donegan, Y. Chi
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023

  • Also presented at the Third Workshop on Seeking Low‑Dimensionality in Deep Neural Networks, 2023.

• Learning Optimal Traffic Routing Behaviors using Markovian Framework in Microscopic Simulation
  T. Cabannes, J. Li, F. Wu, H. Dong, A. Bayen
  TRB 99th Annual Meeting, 2020

Journals

• A Lightweight Transformer for Faster and Robust EBSD Data Collection
  H. Dong, S. Donegan, M. Shah, Y. Chi
  Scientific Reports, 2024

  • Oral presentation at the Machine Learning for Scientific Imaging Conference at Electronic Imaging, 2024.

  • Poster presentation at the Joint Workshop at the Intersection of Materials Science and Machine Learning, 2023.

• Fast and Provable Tensor Robust Principal Component Analysis via Scaled Gradient Descent
  H. Dong, T. Tong, C. Ma, Y. Chi
  Information and Inference: A Journal of the IMA, 2023

  • Contributed talk at SIAM Conference on Mathematics of Data Science, 2022.

Workshops

• Towards Low-bit Communication for Tensor Parallel LLM Inference
  H. Dong, T. Johnson, M. Cho, E. Soroush
  NeurIPS Workshop on Efficient Natural Language and Speech Processing IV, 2024

• Towards Structured Sparsity in Transformers for Efficient Inference
  H. Dong, B. Chen, Y. Chi
  ICML Workshop on Efficient Systems for Foundation Models, 2023