Sign in to confirm you’re not a bot
This helps protect our community. Learn more

State of GPT | BRK216HFS

Microsoft Developer
613K subscribers
717K views 2 years ago #MSBuild
Learn about the training pipeline of GPT assistants like ChatGPT, from tokenization to pretraining, supervised finetuning, and Reinforcement Learning from Human Feedback (RLHF). Dive deeper into practical techniques and mental models for the effective use of these models, including prompting strategies, finetuning, the rapidly growing ecosystem of tools, and their future extensions. Speakers:
  • Andrej Karpathy
Session Information: This video is one of many sessions delivered for the Microsoft Build 2023 event. View the full session schedule and learn more about Microsoft Build at https://build.microsoft.com BRK216HFS | English (US) | AI #MSBuild ...more
...more
State of GPT | BRK216HFS
16KLikes
717,070Views
2023May 25
Learn about the training pipeline of GPT assistants like ChatGPT, from tokenization to pretraining, supervised finetuning, and Reinforcement Learning from Human Feedback (RLHF). Dive deeper into practical techniques and mental models for the effective use of these models, including prompting strategies, finetuning, the rapidly growing ecosystem of tools, and their future extensions. Speakers:
  • Andrej Karpathy
Session Information: This video is one of many sessions delivered for the Microsoft Build 2023 event. View the full session schedule and learn more about Microsoft Build at https://build.microsoft.com BRK216HFS | English (US) | AI #MSBuild

Shorts remixing this video

Follow along using the transcript.

Microsoft Developer

613K subscribers