# llm-from-scratch

**Repository Path**: XuKaGit/llm-from-scratch

## Basic Information

- **Project Name**: llm-from-scratch
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: MulanPSL-2.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 1
- **Created**: 2025-08-15
- **Last Updated**: 2026-04-17

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Learning LLM from Scratch

**Reference:** 
- [happy-llm](https://github.com/datawhalechina/happy-llm)
- [llm-course](https://github.com/mlabonne/llm-course?tab=readme-ov-file)
- [Hands-On Large Language Models CN(ZH)](https://github.com/bbruceyuan/Hands-On-Large-Language-Models-CN)
- [Hands-On Large Language Models](https://github.com/HandsOnLLM/Hands-On-Large-Language-Models)
- [AI Engineering book and other resources](https://github.com/chiphuyen/aie-book)
- [大模型基础](https://github.com/datawhalechina/so-large-lm?tab=readme-ov-file)
- [IERG5050 2025spring@CUHK](https://mobitec.ie.cuhk.edu.hk/ierg5050Spring2025/)



## 1. foundation-models

- [overview notes](./foundation-models/README.md)
- [self-attention & transformer](./foundation-models/Transformer/README.md)

## 2. prompt engineering

## 3. peft: parameter-efficient fine-tuning

## 4. RAG

## 5. inference

## 5. transformer in vision