ramalama-inspect - Man Page

inspect the specified AI Model

Description

Inspect the specified AI Model about additional information like the repository, its metadata and tensor information.

Options

--all

Print all available information about the AI Model. By default, only a basic subset is printed.

Print the value of a specific metadata field of the AI Model. This option supports autocomplete with the available metadata fields of the given model. The special value all will print all available metadata fields and values.

--help, -h

Print usage message

--json

Print the AI Model information in json format.

Examples

Inspect the smollm:135m model for basic information

$ ramalama inspect smollm:135m
smollm:135m
   Path: /var/lib/ramalama/models/ollama/smollm:135m
   Registry: ollama
   Format: GGUF
   Version: 3
   Endianness: little
   Metadata: 39 entries
   Tensors: 272 entries

Inspect the smollm:135m model for all information in json format

$ ramalama inspect smollm:135m --all --json
{
    "Name": "smollm:135m",
    "Path": "/home/mengel/.local/share/ramalama/models/ollama/smollm:135m",
    "Registry": "ollama",
    "Format": "GGUF",
    "Version": 3,
    "LittleEndian": true,
    "Metadata": {
        "general.architecture": "llama",
        "general.base_model.0.name": "SmolLM 135M",
        "general.base_model.0.organization": "HuggingFaceTB",
        "general.base_model.0.repo_url": "https://huggingface.co/HuggingFaceTB/SmolLM-135M",
        ...
    },
    "Tensors": [
        {
            "dimensions": [
                576,
                49152
            ],
            "n_dimensions": 2,
            "name": "token_embd.weight",
            "offset": 0,
            "type": 8
        },
        ...
    ]
}

Use the autocomplete function of --get to view a list of fields:

$ ramalama inspect smollm:135m --get general.
general.architecture               general.languages
general.base_model.0.name          general.license
general.base_model.0.organization  general.name
general.base_model.0.repo_url      general.organization
general.base_model.count           general.quantization_version
general.basename                   general.size_label
general.datasets                   general.tags
general.file_type                  general.type
general.finetune

Print the value of a specific field of the smollm:135m model:

$ ramalama inspect smollm:135m --get tokenizer.chat_template
{% for message in messages %}{{'<|im_start|>' + message['role'] + '
' + message['content'] + '<|im_end|>' + '
'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant
' }}{% endif %}

Print all key-value pairs of the metadata of the smollm:135m model:

$ ramalama inspect smollm:135m --get all
general.architecture: llama
general.base_model.0.name: SmolLM 135M
general.base_model.0.organization: HuggingFaceTB
general.base_model.0.repo_url: https://huggingface.co/HuggingFaceTB/SmolLM-135M
general.base_model.count: 1
...

History

Feb 2025, Originally compiled by Michael Engel mengel@redhat.com ⟨mailto:mengel@redhat.com⟩

Referenced By

ramalama(1).