2.71bit DeepSeek-V3-0324

by danielhanchenon 3/26/25, 1:37 AMwith 1 comments
by danielhanchenon 3/26/25, 1:37 AM

I shrank DeepSeek V3 to 230GB or so from 720GB and it works still! Model uploads are at https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF