Whisper quantized or distil-large-v3 #97
Description
Hello, how do I change the application settings correctly so that I can load the Whisper quantized in INT8 or distil-large-v3? The fact is that often devices have a VRAM size of only 4 GB.
{{ message }}