【kv cache merge】 I want to know if the result of calculating their respective k v cache and concatenating them together is correct

🤗Transformers
1

I have two prefixes, sequence1, sequence2, which are often used. I want to know if the result of calculating their respective k v cache and concatenating them together is correct

2

@John6666 cc

3

Yeah…
I’m not familiar with KV cache…

4

haa，thank you, you are so active in the community

5

Basically, most of HF’s active users are on Discord.
I’m volunteering to fill in the blanks because there’s no connection between there and there.
I can’t help what I don’t know…

6

Hi, I’m also curious about this question. Have you reached any conclusions?