Deephermes is really cool because a single model can act either as a normal agent, or a deep thinking AI simply by using system prompts.
What if you don't even need a system prompt, and the model automatically acts based on its OWN judgement?
In above example:
- The first question is a simple question, so the model acts as a basic agent
- The second question is also simple, so it acts as a simple agent
- The third question is a bit complex and requires resasoning, so it starts with
[THINKING]
and then ends with[ANSWER]
, confirming that it's using the deep thinking mode.
- Deeper Hermes is made up of 2 separate queries.
- The first one is to ask which mode to use (normal agent vs. deep thinking AI)
- The answer from 2 decides the system prompt that gets fed into the actual question.
- First install LM Studio
- Install and Run Deeper Hermes on https://pinokio.computer with 1 click.
First install LM Studio
Then load nousresearch_deephermes-3-llama-3-8b-preview into LMStudio:
lms load nousresearch_deephermes-3-llama-3-8b-preview -y
Once the LMStudio server is running and has loaded the model, activate virtual environment
source env/bin/activate (mac/linux)
.\env\Scripts\activate (windows)
Next, install dependencies:
pip install -r requirements.txt
Then run with:
python app.py