upcarta
  • Sign In
  • Sign Up
  • Explore
  • Search

A Cookbook of Self-Supervised Learning

  • Paper
  • Apr 24, 2023
  • #ArtificialIntelligence #Deeplearning
Randall Balestriero
@randall_balestr
(Author)
Yann LeCun
@ylecun
(Author)
arxiv.org
Read on arxiv.org
1 Recommender
1 Mention
Self-supervised learning, dubbed the dark matter of intelligence, is a promising path to advance machine learning. Yet, much like cooking, training SSL methods is a delicate art wit... Show More

Self-supervised learning, dubbed the dark matter of intelligence, is a promising path to advance machine learning. Yet, much like cooking, training SSL methods is a delicate art with a high barrier to entry. While many components are familiar, successfully training a SSL method involves a dizzying set of choices from the pretext tasks to training hyper-parameters. Our goal is to lower the barrier to entry into SSL research by laying the foundations and latest SSL recipes in the style of a cookbook. We hope to empower the curious researcher to navigate the terrain of methods, understand the role of the various knobs, and gain the know-how required to explore how delicious SSL can be.

Show Less
Recommend
Post
Save
Complete
Collect
Mentions
See All
Jim Fan @DrJimFan · May 12, 2023
  • Post
  • From Twitter
Read the excellent cookbook for self-supervised learning, from the godfather of deep learning himself @ylecun. The recipes in this freely available paper will truly help your business. Not the "top 10 ChatGPT tricks you shouldn't miss". 4/
  • upcarta ©2025
  • Home
  • About
  • Terms
  • Privacy
  • Cookies
  • @upcarta