Issues

• The issue of understanding the meanings of several terms in the paper.

  FasterDecoding/SnapKV#33 · Filter by author loyceCG0523 opened on Oct 10, 2025

• Confusion in Selecting Indices

  FasterDecoding/SnapKV#31 · Filter by author Lueci4er opened on Apr 25, 2025
  3

• About Needle in a Haystack test

  FasterDecoding/SnapKV#30 · Filter by author YUECHE77 opened on Apr 7, 2025
  1

• What's the exact meaning of 8.2x enhancement in memory efficiency, prompting latency, and generation latency? Can you provide the evaluation code?

  FasterDecoding/SnapKV#29 · Filter by author xinhaoH opened on Mar 21, 2025
  2

• Bug on Qwen2-VL

  FasterDecoding/SnapKV#28 · Filter by author LiJunscs opened on Jan 10, 2025

• The first generation token output sees the whole cache key and value

  FasterDecoding/SnapKV#27 · Filter by author PengWenChen opened on Jan 6, 2025
  3

• Question: is key_state_compressed used for inference?

  FasterDecoding/SnapKV#24 · Filter by author jq-wei opened on Nov 20, 2024
  1

• What happens to the total KV length > max-compacity length during response generation?

  FasterDecoding/SnapKV#23 · Filter by author PengWenChen opened on Oct 23, 2024
  3

• Group Query Attention

  FasterDecoding/SnapKV#22 · Filter by author SimJeg opened on Oct 3, 2024
  4

• Question on H2O experiment reproduction

  FasterDecoding/SnapKV#21 · Filter by author CUHKSZzxy opened on Aug 8, 2024

• Could you provide the code for visualization the Hit Rate?

  FasterDecoding/SnapKV#19 · Filter by author Dominic789654 opened on Jul 1, 2024

• Can snapkv compress kv in case different user questions are posed towards the same context?

  FasterDecoding/SnapKV#18 · Filter by author namespace-Pt opened on Jun 27, 2024
  1

• Question on GQA implementation

  FasterDecoding/SnapKV#16 · Filter by author cyLi-Tiger opened on Jun 17, 2024
  1

• Can't not run longbench!

  FasterDecoding/SnapKV#12 · Filter by author HarryWu99 opened on May 24, 2024
  3

• why only decode do compress?

  FasterDecoding/SnapKV#11 · Filter by author CSEEduanyu opened on May 22, 2024
  1

• maybe a bug in update_kv function

  FasterDecoding/SnapKV#3 · Filter by author HarryWu99 opened on Apr 27, 2024
  1

• The effect of Clustering via Pooling may be greater？

  FasterDecoding/SnapKV#2 · Filter by author HarryWu99 opened on Apr 27, 2024
  1

• Questions on paper and code [prompting for mistral, positional index, minor errors & questions in paper]

  FasterDecoding/SnapKV#1 · Filter by author MarsJacobs opened on Apr 26, 2024
  8