Llama.cpp compatible versions of an original 7B model.
- Download one of the versions, for example
ggml-model-q4_1.bin. - Download interact_llamacpp.py
How to run:
sudo apt-get install git-lfs
pip install llama-cpp-python fire
python3 interact_llamacpp.py ggml-model-q4_1.bin
System requirements:
- 10GB RAM
- Downloads last month
- 0