Josh and Mark put together some training specifically for the Bifrost team in December, showing how you can quickly run the Mistral LLM on your laptop using llama.cpp, followed by some deeper background information on how it all works.

See A Quick Introduction to LLMs, and a Guidebook to its Rabbit Holes.

Tip: You will need at least 6GB of RAM and 100GB of disk space free to complete this.