quantized

Here are 4 public repositories matching this topic...

Nodes to run Hunyuan Image 3 locally with BF16 and NF4 quantized options in Comfyui

image ai generation quantization quantized generative-ai comfyui hunyuan nf4 comfyui-custom-node hunyuan-image

Fused 4bit AdamW in Cuda

cuda cuda-kernels 4bit quantized optimizers

A modular CLI chatbot with Discord webhook integration optimized for edge devices using GGUF quantized models.

cli chatbot edge-devices quantized discord-webhook gguf-models

A fast API booty-licious back-end for running GGUF models with Llama.cpp

python api cuda nvidia llama quantized textui blackwell gguf 5090 5080

Add a description, image, and links to the quantized topic page so that developers can more easily learn about it.

To associate your repository with the quantized topic, visit your repo's landing page and select "manage topics."