Microsoft just released BitNet!

GitHub - microsoft/BitNet: Official inference framework for 1-bit LLMs