ML Blog - Articles

Fine-tune Llama 3 with ORPO

A cheaper and faster unified fine-tuning technique

Large Language Models

Open In Colab

Create Mixtures of Experts with MergeKit

Combine multiple experts into a single frankenMoE

Large Language Models

Open In Colab

Merge Large Language Models with mergekit

Create your own models easily, no GPU required!

Large Language Models

Open In Colab

Fine-tune Mistral-7b with Direct Preference Optimization

Boosting the performance of your supervised fine-tuned models

Large Language Models

Open In Colab

ExLlamaV2: The Fastest Library to Run LLMs

Quantize and run EXL2 models

Large Language Models

Open In Colab

Quantize Llama models with GGUF and llama.cpp

GGML vs. GPTQ vs. NF4

Large Language Models

Open In Colab

A Beginner’s Guide to LLM Fine-Tuning

How to fine-tune Llama and other LLMs with one tool

Large Language Models

4-bit LLM Quantization with GPTQ

Quantize your own open-source LLMs to run them on consumer hardware

Large Language Models

Open In Colab

Fine-Tune Your Own Llama 2 Model in a Colab Notebook

A practical introduction to LLM fine-tuning

Large Language Models

Open In Colab

Introduction to Weight Quantization

Large language model optimization using 8-bit quantization

Large Language Models

Open In Colab

Improve ChatGPT with Knowledge Graphs

Leveraging knowledge graphs for LLMs using LangChain

Large Language Models

Open In Colab

Decoding Strategies in Large Language Models

A Guide to Text Generation From Beam Search to Nucleus Sampling

Large Language Models

Open In Colab

Optimize Your Marketing Budget with Nonlinear Programming

Introduction to CVXPY to maximize marketing ROI

linear programming

Open In Colab

Create a Bot to Find Diamonds in Minecraft

Reinforcement Learning and Behavior Cloning in Python with MineRL

reinforcement learning

Open In Colab

Introduction to Constraint Programming in Python

The Programming Paradigm to Find One Solution Among 8,080,104 Candidates

linear programming

Open In Colab

GIN: How to Design the Most Powerful Graph Neural Network

Graph Neural Network Course: Chapter 4

graph neural networks

Open In Colab

GraphSAGE: Scaling up Graph Neural Networks

Graph Neural Network Course: Chapter 3

graph neural networks

Open In Colab

What is a Tensor in Machine Learning?

The difference between tensors, arrays, and matrices

data science

Open In Colab

Efficiently iterating over rows in a Pandas DataFrame

Never use iterrows and itertuples again!

data science

Open In Colab

Graph Attention Networks: Self-Attention for GNNs

Graph Neural Network Course: Chapter 2

graph neural networks

Open In Colab

Integer vs. Linear Programming in Python

Mixed Integer Programming for optimization with Google OR-Tools

linear programming

Open In Colab

Introduction to Linear Programming in Python

A guide to mathematical optimization with Google OR-Tools

linear programming

Open In Colab

Graph Convolutional Networks: Introduction to GNNs

Graph Neural Network Course: Chapter 1

graph neural networks

Open In Colab

Q-learning for beginners

Train an AI to solve the Frozen Lake environment

reinforcement learning