[GenAI] Use BitsAndBytes for 4bit quantization.#7406

LittleLittleCloud wants to merge 8 commits into

dotnet:maindotnet/machinelearning:mainfrom

LittleLittleCloud:u/0228LittleLittleCloud/machinelearning:u/0228Copy head branch name to clipboard