[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"extension:v3:en:gguf":3},{"resolvedFromAlias":4,"canonicalExt":5,"ext":5,"name":6,"category":7,"categoryName":8,"updatedAt":9,"popularity":10,"summary":11,"howToOs":12,"quickAnswer":18,"answerIntro":19,"whatIs":20,"description":21,"furtherReading":22,"openInstructions":38,"commonIssues":54,"securityNotes":73,"faq":77,"aliases":90,"mimeTypes":91,"relatedExtensions":92,"breadcrumbs":111,"categoryAnchor":121,"categoryFuturePath":122,"metaDescription":123,"availableHowToOs":124,"openOnDeviceLinks":125,"cannotOpenReasons":141,"cannotOpenFixes":142,"convertOptions":143,"securityAffiliateMessaging":144,"securityAffiliates":145},false,"gguf","GGUF (GGML Universal Format) model file","ml","Machine learning","2026-06-12T08:20:57.439Z",35,".gguf is a binary file format used to store machine-learning models (tensors plus metadata), commonly for running LLMs with GGUF-capable local tools and runtimes (llama.cpp is a well-known example). It is designed for fast saving/loading and is often used to distribute quantized models for inference.",[13,14,15,16,17],"windows","mac","linux","ios","android","To open .GGUF files on Windows, install or download a GGUF-capable local LLM tool (for example llama.cpp, or another desktop runtime that supports GGUF models).","To open a .gguf file, you typically load it into a GGUF-capable local LLM runtime—for example llama.cpp, LM Studio, Ollama with a compatible model, or another desktop tool that explicitly supports GGUF. Most general-purpose apps (text editors, media players, office suites) cannot open GGUF because it is a binary model format, not a document.","GGUF is a binary format for storing model tensors together with metadata in a single file, intended for inference with GGML and executors built on GGML. Documentation for llama.cpp describes GGUF as the format used to store and distribute quantized language models, optimized for quick loading/saving.","GGUF is associated with the GGML/llama.cpp ecosystem and is primarily used to package and distribute language models for local inference. In practical terms, a GGUF file is usually “the model” you point an inference tool at when you want to run a compatible LLM on your machine.\n\nA key idea in GGUF is bundling both the tensor data (model weights) and metadata into one binary file, which is meant to improve portability and startup time when loading models for inference. This makes it convenient for distributing quantized variants of large models, which are frequently shared as standalone .gguf files.\n\nBecause GGUF is a machine-learning model container rather than an interchange format for training pipelines, typical user workflows revolve around choosing a GGUF-capable local inference tool (llama.cpp is a common open-source option; many desktop apps also load GGUF), choosing a GGUF model file, and then running inference (chat/completions) against it. The Hugging Face documentation also describes GGUF as a model file format used for inference with GGML and highlights its use for quick loading/saving in distribution contexts.",[23,26,29,32,35],{"title":24,"url":25},"GGUF specification/overview (ggml-org/ggml docs: gguf.md)","https://github.com/ggml-org/ggml/blob/master/docs/gguf.md",{"title":27,"url":28},"GGUF (Transformers documentation on Hugging Face)","https://huggingface.co/docs/transformers/gguf",{"title":30,"url":31},"GGUF on the Hugging Face Hub","https://huggingface.co/docs/hub/en/gguf",{"title":33,"url":34},"llama.cpp overview (Wikipedia)","https://en.wikipedia.org/wiki/Llama.cpp",{"title":36,"url":37},"IANA Media Types registry (to verify registered MIME types)","https://www.iana.org/assignments/media-types/index.html",{"windows":39,"macos":43,"linux":46,"ios":50,"android":52},[40,41,42],"Install or download a GGUF-capable local LLM tool (for example llama.cpp, or another desktop runtime that supports GGUF models).","Run the tool and provide the path to your .gguf model file (for llama.cpp, this is typically done by passing the model file as a command-line argument).","If the tool reports an unsupported model or format, verify that the tool version supports GGUF and that the model is actually a GGUF file.",[40,44,45],"Start the tool and load the .gguf model file (commonly by specifying the file path in a command or configuration).","If loading fails, try a newer build of the tool that explicitly supports GGUF.",[47,48,49],"Install or build a GGUF-capable local LLM tool (for example llama.cpp, or another runtime that supports GGUF models).","Run the program and pass your .gguf file as the model input (commonly via a CLI flag or a positional argument, depending on the tool).","If you get a format/metadata error, ensure the model file is valid GGUF and that your runtime supports the particular model variant.",[51],"GGUF files are not typically opened directly on iOS; transfer the .gguf to a desktop system and load it with a GGUF-capable local LLM runtime (llama.cpp is one common option).",[53],"GGUF files are not typically opened directly on Android; transfer the .gguf to a desktop system and load it with a GGUF-capable local LLM runtime (llama.cpp is one common option).",[55,61,67],{"title":56,"description":57,"steps":58},"Nothing can “open” the file (it is not a document)","GGUF is a binary model container, so double-clicking it in a file manager usually does nothing useful or prompts you to choose an app.",[59,60],"Use a GGUF-capable local LLM tool (for example llama.cpp or another compatible runtime) rather than a document viewer or editor.","Load the model from within the tool (often via a command-line argument pointing to the .gguf path).",{"title":62,"description":63,"steps":64},"Tool says the model/format is unsupported","Not every GGML-based program supports every model file format or every GGUF variation; older builds may not recognize GGUF.",[65,66],"Update to a recent version/build of your GGUF-capable tool that explicitly supports GGUF (for example, a current llama.cpp build).","Confirm the file extension matches the actual content and that the file is a genuine GGUF model (not another format renamed).",{"title":68,"description":69,"steps":70},"Model loads but inference is extremely slow or fails due to resources","GGUF files can represent large models; even quantized models may require significant RAM/VRAM and compute, depending on model size and your hardware.",[71,72],"Try a smaller GGUF model variant (fewer parameters) or a more heavily quantized GGUF intended for your hardware.","Close other applications to free memory and ensure the runtime is configured for your system (for example, CPU-only vs. available acceleration, as supported by your chosen tool).",[74,75,76],"A .gguf file is a binary blob intended to be parsed by ML runtimes; it is not supposed to contain active scripts, but it can still trigger vulnerabilities in the software that parses it if the file is malformed or maliciously crafted.","Prefer loading GGUF models only in well-maintained, up-to-date GGUF-capable software (for example current llama.cpp builds or other actively maintained local LLM tools) because the main risk is in the parser and surrounding runtime.","Treat GGUF files as untrusted inputs when obtained from unknown sources; they may be very large and can cause resource exhaustion (RAM/disk) when downloaded or loaded.",[78,81,84,87],{"question":79,"answer":80},"Is GGUF the same thing as a “quantized model”?","GGUF is a file format used to store models (tensors and metadata). In the llama.cpp ecosystem it is commonly used to distribute quantized language models, but GGUF itself is the container format, not a specific quantization method.",{"question":82,"answer":83},"Can I open a .gguf file in a text editor?","Not meaningfully. GGUF is a binary format; a text editor will show unreadable bytes. Use a GGUF-capable local LLM tool instead.",{"question":85,"answer":86},"What should I use GGUF files for?","They are primarily for running inference with GGUF-capable local LLM tools and runtimes (llama.cpp is a widespread open-source example) and for distributing models in a way that loads quickly and includes metadata.",{"question":88,"answer":89},"Does GGUF have an official MIME type?","No official IANA-registered media type for GGUF is indicated by the IANA Media Types registry; if you see an application/x-* style type in the wild, treat it as unofficial.",[],[],[93,99,105],{"ext":94,"name":95,"category":7,"categoryName":8,"popularity":96,"summary":97,"howToOs":98},"safetensors","SafeTensors tensor checkpoint format",55,".safetensors stores machine-learning tensor weights in a simple binary container with a small JSON header and raw tensor bytes. It is commonly used for sharing and loading model checkpoints (especially in the Hugging Face ecosystem) with an emphasis on safer, validation-friendly loading.",[13,14,15,16,17],{"ext":100,"name":101,"category":7,"categoryName":8,"popularity":102,"summary":103,"howToOs":104},"onnx","ONNX (Open Neural Network Exchange) model",45,".onnx is a serialized machine-learning model file in the Open Neural Network Exchange (ONNX) format, used to move models between tools and run inference in different environments. It’s commonly loaded by ONNX Runtime and other ONNX-capable ML software rather than “opened” like a document.",[13,14,15,16,17],{"ext":106,"name":107,"category":7,"categoryName":8,"popularity":108,"summary":109,"howToOs":110},"ml20","Machine Learning Model Format 2020",15,".ml20 files are used for storing machine learning models, typically created by specific machine learning frameworks.",[13,14,15,16,17],[112,115,118],{"label":113,"to":114},"Home","/",{"label":116,"to":117},"File Extension Index","/file-extension",{"label":119,"to":120},".GGUF","/file-extension/gguf","category-ml","/category/ml","Learn what .GGUF files are, how to open them on every platform, common fixes, and security best practices.",[13,14,15,16,17],[126,129,132,135,138],{"os":13,"label":127,"to":128},"Open .GGUF on Windows","/how-to/open-gguf-on-windows",{"os":14,"label":130,"to":131},"Open .GGUF on Mac","/how-to/open-gguf-on-mac",{"os":15,"label":133,"to":134},"Open .GGUF on Linux","/how-to/open-gguf-on-linux",{"os":16,"label":136,"to":137},"Open .GGUF on iOS","/how-to/open-gguf-on-ios",{"os":17,"label":139,"to":140},"Open .GGUF on Android","/how-to/open-gguf-on-android",[56,62,68],[59,60],[],"untrusted_source",[146,150],{"name":147,"description":148,"affiliateUrl":149},"Avast","Avast offers free and premium antivirus software that protects against viruses, malware, ransomware, and phishing. Scan files before opening them to ensure safety.","https://www.avast.com/lp-aff-consumer-store?expid=inf601",{"name":151,"description":152,"affiliateUrl":153},"Norton","Norton 360 delivers comprehensive antivirus protection, VPN, and identity theft monitoring. Scan files for threats before opening to keep your device secure.","http://buy.norton.com/aff_home?utm_campaign=en-ww_nor_n36_aff_nas_nau_nah_cj_nad_low:_sec_nat_mktc_norton_360"]