Search Results - Ainslie, Joshua

Refine Results
  1. 1
    Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT

    Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT by Lee-Thorp, James, Ainslie, Joshua

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  2. 2
    mLongT5: A Multilingual and Efficient Text-To-Text Transformer for Longer Sequences

    mLongT5: A Multilingual and Efficient Text-To-Text Transformer for Longer Sequences by Uthus, David, Ontañón, Santiago, Ainslie, Joshua, Guo, Mandy

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  3. 3
    Iterative Decoding for Compositional Generalization in Transformers

    Iterative Decoding for Compositional Generalization in Transformers by Ruiz, Luana, Ainslie, Joshua, Ontañón, Santiago

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  4. 4
    FNet: Mixing Tokens with Fourier Transforms

    FNet: Mixing Tokens with Fourier Transforms by Lee-Thorp, James, Ainslie, Joshua, Eckstein, Ilya, Ontanon, Santiago

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  5. 5
    LogicInference: A New Dataset for Teaching Logical Inference to seq2seq Models

    LogicInference: A New Dataset for Teaching Logical Inference to seq2seq Models by Ontanon, Santiago, Ainslie, Joshua, Cvicek, Vaclav, Fisher, Zachary

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  6. 6
    GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

    GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints by Ainslie, Joshua, Lee-Thorp, James, de Jong, Michiel, Zemlyanskiy, Yury, Lebrón, Federico, Sanghai, Sumit

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  7. 7
    Making Transformers Solve Compositional Tasks

    Making Transformers Solve Compositional Tasks by Ontañón, Santiago, Ainslie, Joshua, Cvicek, Vaclav, Fisher, Zachary

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  8. 8
    MEMORY-VQ: Compression for Tractable Internet-Scale Memory

    MEMORY-VQ: Compression for Tractable Internet-Scale Memory by Zemlyanskiy, Yury, de Jong, Michiel, Luke Vilnis, Ontañón, Santiago, Cohen, William W, Sanghai, Sumit, Ainslie, Joshua

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  9. 9
    GLIMMER: generalized late-interaction memory reranker

    GLIMMER: generalized late-interaction memory reranker by de Jong, Michiel, Zemlyanskiy, Yury, FitzGerald, Nicholas, Sanghai, Sumit, Cohen, William W, Ainslie, Joshua

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  10. 10
    RealFormer: Transformer Likes Residual Attention

    RealFormer: Transformer Likes Residual Attention by He, Ruining, Ravula, Anirudh, Kanagal, Bhargav, Ainslie, Joshua

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  11. 11
    Pre-computed memory or on-the-fly encoding? A hybrid approach to retrieval augmentation makes the most of your compute

    Pre-computed memory or on-the-fly encoding? A hybrid approach to retrieval augmentation makes the most of your compute by de Jong, Michiel, Zemlyanskiy, Yury, FitzGerald, Nicholas, Ainslie, Joshua, Sanghai, Sumit, Sha, Fei, Cohen, William

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  12. 12
    FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference

    FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference by de Jong, Michiel, Zemlyanskiy, Yury, Ainslie, Joshua, FitzGerald, Nicholas, Sanghai, Sumit, Sha, Fei, Cohen, William

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  13. 13
    Functional Interpolation for Relative Positions Improves Long Context Transformers

    Functional Interpolation for Relative Positions Improves Long Context Transformers by Li, Shanda, You, Chong, Guru Guruganesh, Ainslie, Joshua, Ontanon, Santiago, Manzil Zaheer, Sanghai, Sumit, Yang, Yiming, Kumar, Sanjiv, Bhojanapalli, Srinadh

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  14. 14
    Improving Compositional Generalization in Classification Tasks via Structure Annotations

    Improving Compositional Generalization in Classification Tasks via Structure Annotations by Kim, Juyong, Ravikumar, Pradeep, Ainslie, Joshua, Ontañón, Santiago

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  15. 15
    A Suite of Generative Tasks for Multi-Level Multimodal Webpage Understanding

    A Suite of Generative Tasks for Multi-Level Multimodal Webpage Understanding by Burns, Andrea, Srinivasan, Krishna, Ainslie, Joshua, Brown, Geoff, Plummer, Bryan A, Saenko, Kate, Ni, Jianmo, Guo, Mandy

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  16. 16
    WikiWeb2M: A Page-Level Multimodal Wikipedia Dataset

    WikiWeb2M: A Page-Level Multimodal Wikipedia Dataset by Burns, Andrea, Srinivasan, Krishna, Ainslie, Joshua, Brown, Geoff, Plummer, Bryan A, Saenko, Kate, Ni, Jianmo, Guo, Mandy

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  17. 17
    LongT5: Efficient Text-To-Text Transformer for Long Sequences

    LongT5: Efficient Text-To-Text Transformer for Long Sequences by Guo, Mandy, Ainslie, Joshua, Uthus, David, Ontanon, Santiago, Ni, Jianmo, Yun-Hsuan Sung, Yang, Yinfei

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  18. 18
    Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

    Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints by Komatsuzaki, Aran, Puigcerver, Joan, Lee-Thorp, James, Carlos Riquelme Ruiz, Mustafa, Basil, Ainslie, Joshua, Tay, Yi, Dehghani, Mostafa, Houlsby, Neil

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  19. 19
    Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference

    Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference by Tao, Lei, Bai, Junwen, Brahma, Siddhartha, Ainslie, Joshua, Lee, Kenton, Zhou, Yanqi, Du, Nan, Zhao, Vincent Y, Wu, Yuexin, Li, Bo, Zhang, Yu, Ming-Wei, Chang

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:
  20. 20
    Linear Transformer Topological Masking with Graph Random Features

    Linear Transformer Topological Masking with Graph Random Features by Reid, Isaac, Dubey, Kumar Avinava, Jain, Deepali, Whitney, Will, Ahmed, Amr, Ainslie, Joshua, Bewley, Alex, Jacob, Mithun, Mehta, Aranyak, Rendleman, David, Schenck, Connor, Turner, Richard E, Wagner, René, Weller, Adrian, Choromanski, Krzysztof

    Published in arXiv.org
    Get full text
    Article
    Save to List
    Saved in:

Search Tools: