Events on Wednesday, October 21st, 2020
- Physics ∩ ML Seminar
- Neural Scaling Laws and GPT-3
- Time: 11:00 am - 12:15 pm
- Place: Online Seminar: Please sign up for our mailing list at www.physicsmeetsml.org for zoom link
- Speaker: Jared Kaplan, Johns Hopkins University
- Abstract: A variety of recent works suggest that scaling laws are ubiquitous in machine learning. In particular, neural network performance obeys scaling laws with respect to the number of parameters, dataset size, and the training compute budget. I will explain these scaling laws, and argue that they are both precise and highly universal. Then I will explain how this way of thinking about machine learning led to the GPT-3 language model, and what it suggests for the future.
- Host: Gary Shiu
- Department Meeting
- Time: 12:15 pm - 1:30 pm
- Place: Virtual see "abstract" for connection info
- Speaker: Sridhara Dasu, Department Chair, UW-Madison
- Meeting Coordinates: Meeting number: 120 392 9242 Password: Q5EjaTz3Pk3 (75352893 from phones) Join by video system Dial 1203929242@uwmadison.webex.com You can also dial 173.243.2.68 and enter your meeting number. Join by phone +1-415-655-0001 US Toll +1-312-535-8110 United States Toll (Chicago) Access code: 120 392 9242
- Host: Sridhara Dasu, Department Chair