2003
Search results
F Sha, I Pasupat, J Ainslie, L Qiu, M de Jong, P Shaw, SK Sanghai, ... 2022 Weighted Global Normalization for Multiple Choice Reading Comprehension over Long Documents
Jan 25, 2023 · Michiel de Jong, Yury Zemlyanskiy, Nicholas FitzGerald, Joshua Ainslie, Sumit Sanghai, Fei Sha, William Cohen. Retrieval-augmented language models such as Fusion-in-Decoder are powerful, setting the state of the art on a variety of knowledge-intensive tasks.
- arXiv:2301.10448 [cs.CL]
- ICML 2023
May 22, 2023 · GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints. Joshua Ainslie, James Lee-Thorp, Michiel de Jong, Yury Zemlyanskiy, Federico Lebrón, Sumit Sanghai. Multi-query attention (MQA), which only uses a single key-value head, drastically speeds up decoder inference.
Jun 17, 2023 · Michiel de Jong, Yury Zemlyanskiy, Nicholas FitzGerald, Sumit Sanghai, William W. Cohen, Joshua Ainslie. Memory-augmentation is a powerful approach for efficiently incorporating external information into language models, but leads to reduced performance relative to retrieving text.
Michiel de Jong. As Open Science and Open Education Specialist, he is developing the infrastructure required for researchers at the Delft University of Technology to share their scientific output and educational resources openly.
no code implementations • 3 Jun 2021 • Michiel de Jong, Satyapriya Krishna, Anuva Agarwal Training a reinforcement learning agent to carry out natural language instructions is limited by the available supervision, i. e. knowing when the instruction has been carried out.
Read Michiel de Jong's latest research, browse their coauthor's research, and play around with their algorithms.
