Includes index.

Understanding large language models -- Working with text data -- Coding attention mechanisms -- Implementing a GPT model from scratch to generate text -- Pretraining on unlabeled data -- Fine-tuning for classification -- Fine-tuning to follow instructions -- Introduction to PyTorch -- References and further reading -- Exercise solutions -- Adding bells and whistles to the training loop -- Parameter-efficient fine-tuning with LoRA.

Build a Large Language Model (From Scratch) is a practical and eminently-satisfying hands-on journey into the foundations of generative AI. Without relying on any existing LLM libraries, you'll code a base model, evolve it into a text classifier, and ultimately create a chatbot that can follow your conversational instructions. And you'll really understand it because you built it yourself!

School of engineering, Technology &Sciences Physical Science Reference Stacks

law