AI Weekly Update Preview — April 12th, 2021

Major Themes of the Latest Papers

Self-Supervised Learning

“We notice that a sudden change of gradients (a ‘spike’ in Fig. 4) causes a ‘dip’ in the training curve.”

Vision-Language Learning

“GPV-I can be trained end-to-end on any task that demands a box or text output without any architecture modifications such as adding a new task-head.”
“GPV-I consisting of a visual encoder, language encoder, vision-language co-attention module, and output heads for the supported output modalities — boxes, relevance scores, and text.”

Generative Modeling


Natural Language Processing

Proposed criteria for future NLP benchmarks
Example of a prompt (red text) applied to a sample of the BoolQ dataset

Deep Learning with Code Data


Model-Based RL





Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store