Skip to content

examples(spin-llm): updates needed? #135

@vdice

Description

@vdice

As of #132, it is unclear if the spin-llm example requires updates. An attempt was made to test the updated example but the following was encountered:

With the following ai-model structure:

         .spin/ai-models/
         └── sentence-transformers
             └── all-minilm-l6-v2
                 ├── model.safetensors
                 └── tokenizer.json

When handling a request, the app produces this error:

Traceback (most recent call last):
  File "/1/spin_sdk/http/__init__.py", line 86, in handle
  File "/0/app.py", line 6, in handle_request
  File "/1/spin_sdk/llm.py", line 55, in infer
  File "/1/spin_sdk/llm.py", line 45, in infer_with_options
  File "/1/spin_sdk/wit/imports/fermyon_spin_llm_2_0_0.py", line 93, in infer
componentize_py_types.Err: Error_ModelNotSupported()

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions