My attempts at a double-dequant kernel for QLoRA weights (see: Unsloth Puzzles). Results compared against bitsandbytes CUDA dequantization. See my blog post for more.
| Performance | Speedup |
|---|---|
 |
 |
| Name | Name | Last commit date | ||
|---|---|---|---|---|
My attempts at a double-dequant kernel for QLoRA weights (see: Unsloth Puzzles). Results compared against bitsandbytes CUDA dequantization. See my blog post for more.
| Performance | Speedup |
|---|---|
|
|