Llama 3.1 8b Instruct - Memory Usage More than Reported

blakemart15
Tue, 18 Feb 2025 21:47:25 +0000

@jacobvinje I closed down the instance. I can find the exact version later this week. But I know torch was 2.6.x and transformers was 4.48.x at them minimum