rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
59.8
Score
98,126
Stars
15,051
Forks
0.0
Trend
Details
- Language
- Jupyter Notebook
- License
- NOASSERTION
- Category
- AI/ML
- Open Issues
- 3
- Contributors
- 0
- Archived
- No
Security
- OpenSSF Score
- N/A
- Dependency Risk
- Unknown
- Activity Health
- Unknown
Topics
aiartificial-intelligenceattention-mechanismdeep-learningfinetuningfrom-scratchgenerative-aigptinstruction-tuninglanguage-modellarge-language-modelsllmmachine-learningnatural-language-processingpretrainingpythonpytorchtokenizertransformers