Build a large language model (from scratch) /
Raschka, Sebastian,
Build a large language model (from scratch) / Sebastian Raschka. - [First edition]. - New York: Manning Publications Co. 2025 - xx, 343 pages : illustrations ; 24 cm - From scratch . - From scratch (Manning Publications) .
Includes index.
Understanding large language models -- Working with text data -- Coding attention mechanisms -- Implementing a GPT model from scratch to generate text -- Pretraining on unlabeled data -- Fine-tuning for classification -- Fine-tuning to follow instructions -- Introduction to PyTorch -- References and further reading -- Exercise solutions -- Adding bells and whistles to the training loop -- Parameter-efficient fine-tuning with LoRA.
Build a Large Language Model (From Scratch) is a practical and eminently-satisfying hands-on journey into the foundations of generative AI. Without relying on any existing LLM libraries, you'll code a base model, evolve it into a text classifier, and ultimately create a chatbot that can follow your conversational instructions. And you'll really understand it because you built it yourself!
9781633437166
Artificial intelligence.
Natural language processing (Computer science)
Intelligence artificielle.
Traitement automatique des langues naturelles.
artificial intelligence.
006.3 / R223b
Build a large language model (from scratch) / Sebastian Raschka. - [First edition]. - New York: Manning Publications Co. 2025 - xx, 343 pages : illustrations ; 24 cm - From scratch . - From scratch (Manning Publications) .
Includes index.
Understanding large language models -- Working with text data -- Coding attention mechanisms -- Implementing a GPT model from scratch to generate text -- Pretraining on unlabeled data -- Fine-tuning for classification -- Fine-tuning to follow instructions -- Introduction to PyTorch -- References and further reading -- Exercise solutions -- Adding bells and whistles to the training loop -- Parameter-efficient fine-tuning with LoRA.
Build a Large Language Model (From Scratch) is a practical and eminently-satisfying hands-on journey into the foundations of generative AI. Without relying on any existing LLM libraries, you'll code a base model, evolve it into a text classifier, and ultimately create a chatbot that can follow your conversational instructions. And you'll really understand it because you built it yourself!
9781633437166
Artificial intelligence.
Natural language processing (Computer science)
Intelligence artificielle.
Traitement automatique des langues naturelles.
artificial intelligence.
006.3 / R223b