Description

Python wrapper for running locally-hosted LLM with llama.cpp

Input

Name
Description
Pattern

0 ()

1 ()

2 ()

Output

Name
Description
Pattern

0 ()

0 ()

Tools

llama-cpp-python Documentation

Python wrapper for llama.cpp LLM inference tool

License: MIT
Authors