AMD ROCm PyTorch in Docker Test AMD ROCm TensorFlow in Docker Test CUDA PyTorch BitsAndBytes FlashAttention2 Mixtral-8x7B Test Compilation BitsAndBytes for ROCm 6.2 Compilation FlashAttention for CUDA 12.8 Compilation PyTorch BitsAndBytes for CUDA 11.4 Deterministic Test with CUDA PyTorch Mixtral-Small-22b Falcon 7b CUDA PyTorch Test GLM Image CUDA PyTorch BNB4 Test GLM4 9B CUDA PyTorch Test Internlm3 8B CUDA PyTorch Test Mistral 7b CUDA PyTorch Test Mistral 7b CUDA low memory GPU PyTorch Test Mistral 7b General VS Instruct Test Mistral 7b ROCm PyTorch Test NVIDIA CUDA PyTorch in Docker Test NVIDIA CUDA TensorFlow in Docker Test Olmo3 7B CUDA PyTorch Test Open (Fake) Llama 7b CUDA PyTorch Test Pixtral 12b CUDA low memory GPU PyTorch Test PyTorch Transformers repetition loop Fix Qwen 8B CUDA PyTorch Test Qwen Image CUDA PyTorch BNB4 Test ROCm PyTorch BitsAndBytes Mistral Test SUNO Bark ROCm PyTorch Test Stable Diffusion 1.5 LoRA Training Test Stable Diffusion 1.5 vs 2.0 vs XL Test Stable Diffusion v1.5 CUDA low memory GPU PyTorch Test Stable Diffusion v1.5 ROCm BitsAndBytes PyTorch Test Stable Diffusion v1.5 ROCm PyTorch Test TensorFlow vs PyTorch GPT2 Vulkan llama.cpp in Docker Test WAN 2.1 1.3b diffusers CUDA PyTorch BNB4 Test WAN 2.1 1.3b diffusers CUDA PyTorch Test Yi 9b CUDA PyTorch Test llama.cpp - run LLM everywhere sd.cpp - run Stable Diffuision everywhere

AMD Instinct Mi50 GPU Apple M1 16Gb Unified RAM Mac Pro 7.1 LLM Laboratory NVIDIA CMP 170HX GPU NVIDIA RTX 3090 GPU NVIDIA Tesla K80 GPU NVIDIA Tesla M10 GPU NVIDIA Tesla P100 GPU NVIDIA Tesla V100 GPU SXM2

AMD ROCm Docker Base Images AMD ROCm Docker Images for PyTorch / TensorFlow Begin your journey in LLM BitsAndBytes CUDA Compatibility BitsAndBytes ROCm Compatibility CUDA & PyTorch Compatibility by Compute Capability FlashAttention compatibility NVIDIA CUDA Compatibility NVIDIA CUDA Docker Base Images NVIDIA CUDA Docker Images for PyTorch / TensorFlow NVIDIA Container Toolkit for Docker PyTorch dtype compatibility TensorFlow-friendly causal LMs in Transformers 4.x Uploading Custom GGUF Models to Hugging Face

LLM semantic search PyTorch pp512 and tg128 LLM Benchmark

Due to a serious vulnerability upgrade torch to v2.6 PyTorch convert binary weights from bin to safetensors Failed PyTorch CUDA FP8 Test SUNO Bark voice clone ROCm PyTorch Test

AMD ROCm PyTorch in Docker Test AMD ROCm TensorFlow in Docker Test CUDA PyTorch BitsAndBytes FlashAttention2 Mixtral-8x7B Test Compilation BitsAndBytes for ROCm 6.2 Compilation FlashAttention for CUDA 12.8 Compilation PyTorch BitsAndBytes for CUDA 11.4 Deterministic Test with CUDA PyTorch Mixtral-Small-22b Falcon 7b CUDA PyTorch Test GLM Image CUDA PyTorch BNB4 Test GLM4 9B CUDA PyTorch Test Internlm3 8B CUDA PyTorch Test Mistral 7b CUDA PyTorch Test Mistral 7b CUDA low memory GPU PyTorch Test Mistral 7b General VS Instruct Test Mistral 7b ROCm PyTorch Test NVIDIA CUDA PyTorch in Docker Test NVIDIA CUDA TensorFlow in Docker Test Olmo3 7B CUDA PyTorch Test Open (Fake) Llama 7b CUDA PyTorch Test Pixtral 12b CUDA low memory GPU PyTorch Test PyTorch Transformers repetition loop Fix Qwen 8B CUDA PyTorch Test Qwen Image CUDA PyTorch BNB4 Test ROCm PyTorch BitsAndBytes Mistral Test SUNO Bark ROCm PyTorch Test Stable Diffusion 1.5 LoRA Training Test Stable Diffusion 1.5 vs 2.0 vs XL Test Stable Diffusion v1.5 CUDA low memory GPU PyTorch Test Stable Diffusion v1.5 ROCm BitsAndBytes PyTorch Test Stable Diffusion v1.5 ROCm PyTorch Test TensorFlow vs PyTorch GPT2 Vulkan llama.cpp in Docker Test WAN 2.1 1.3b diffusers CUDA PyTorch BNB4 Test WAN 2.1 1.3b diffusers CUDA PyTorch Test Yi 9b CUDA PyTorch Test llama.cpp - run LLM everywhere sd.cpp - run Stable Diffuision everywhere

AMD Instinct Mi50 GPU Apple M1 16Gb Unified RAM Mac Pro 7.1 LLM Laboratory NVIDIA CMP 170HX GPU NVIDIA RTX 3090 GPU NVIDIA Tesla K80 GPU NVIDIA Tesla M10 GPU NVIDIA Tesla P100 GPU NVIDIA Tesla V100 GPU SXM2

AMD ROCm Docker Base Images AMD ROCm Docker Images for PyTorch / TensorFlow Begin your journey in LLM BitsAndBytes CUDA Compatibility BitsAndBytes ROCm Compatibility CUDA & PyTorch Compatibility by Compute Capability FlashAttention compatibility NVIDIA CUDA Compatibility NVIDIA CUDA Docker Base Images NVIDIA CUDA Docker Images for PyTorch / TensorFlow NVIDIA Container Toolkit for Docker PyTorch dtype compatibility TensorFlow-friendly causal LMs in Transformers 4.x Uploading Custom GGUF Models to Hugging Face

LLM semantic search PyTorch pp512 and tg128 LLM Benchmark

Due to a serious vulnerability upgrade torch to v2.6 PyTorch convert binary weights from bin to safetensors Failed PyTorch CUDA FP8 Test SUNO Bark voice clone ROCm PyTorch Test

About me

About me

DevOps Evangelist
Interested in latest tech: LLM, AWS, Azure, Kubernetes, Apple stack
Supporter of opensource knowledge sharing
Enthusiastic in architecture improvements

LLM Laboratory · GitHub Pages · Dmitrii Kostakov