ramalama-inspect - Man Page

inspect the specified AI Model

Synopsis

ramalama inspect [options] model

Description

Inspect the specified AI Model about additional information like the repository, its metadata and tensor information.

Options

--all

Print all available information about the AI Model. By default, only a basic subset is printed.

--help, -h

Print usage message

--json

Print the AI Model information in json format.

Examples

Inspect the smollm:135m model for basic information

$ ramalama inspect smollm:135m
smollm:135m
   Path: /var/lib/ramalama/models/ollama/smollm:135m
   Registry: ollama
   Format: GGUF
   Version: 3
   Endianness: little
   Metadata: 39 entries
   Tensors: 272 entries

Inspect the smollm:135m model for all information in json format

$ ramalama inspect smollm:135m --all --json
{
    "Name": "smollm:135m",
    "Path": "/home/mengel/.local/share/ramalama/models/ollama/smollm:135m",
    "Registry": "ollama",
    "Format": "GGUF",
    "Version": 3,
    "LittleEndian": true,
    "Metadata": {
        "general.architecture": "llama",
        "general.base_model.0.name": "SmolLM 135M",
        "general.base_model.0.organization": "HuggingFaceTB",
        "general.base_model.0.repo_url": "https://huggingface.co/HuggingFaceTB/SmolLM-135M",
        ...
    },
    "Tensors": [
        {
            "dimensions": [
                576,
                49152
            ],
            "n_dimensions": 2,
            "name": "token_embd.weight",
            "offset": 0,
            "type": 8
        },
        ...
    ]
}

History

Feb 2025, Originally compiled by Michael Engel mengel@redhat.com ⟨mailto:mengel@redhat.com⟩

Referenced By

ramalama(1).