Skip to content
TechIndexSubmit
Back to directory

colab-oss-lab

Beginner-friendly lab for running open-source LLMs on Google Colab (Google AI Pro): L4 GPU checks, 4-bit quantization, and experiment logs

Similar tools

  • Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

    Models
  • Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

    Models
  • Step-by-step tutorial on loading and using Llama 3.1 8B Instruct in Google Colab with Unsloth. Free, no GPU required. Covers prompting, temperature, max_new_tokens, and a practical spell-correction example.

    Models
  • LoRA / QLoRA fine-tuning of open-source models (DistilBERT, scales to Llama/Mistral) for transaction categorization — Colab notebook + training script

    Models
  • A native macOS lab for teaching tiny language models to think — build the architecture, train the weights, and watch a small LLM emerge from scratch, locally on Apple Silicon with custom data, tokenizers, checkpoints, and MLX acceleration.

    Models
  • Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

    Models