CatAI supports running Alpaca models locally on your computer using a chat GUI.

Installation and use

Make sure Node.js is installed:

npm install -g catai

catai install Vicuna-7B
catai serve

characteristic

• Automatic detection of programming language
• Click on the user icon to display the original message
• live text stream
• Quick model download