This repo contains notebooks that explore LLMs and tooling, including Llama 3 by Meta, Gemma 2 by Google, the optimization packages llama.cpp & mlx-lm, and the LangChain framework for building applications with LLMs.

To run:

1. Clone this repo locally
2. Install poetry on your machine if necessary
3. Navigate to the repo's root and run poetry install. This will create the virtual environment llm-experiments with the dependencies required by the notebooks.
4. Run the notebooks in your IDE, selecting the virtual environment llm-experiments

Image from The Sequence