Search Results for author: Junyu Lai

Found 2 papers, 1 papers with code

MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models

no code implementations19 May 2024 Jingwei Xu, Junyu Lai, Yunpeng Huang

Furthermore, both base models equipped with MeteoRA achieve superior performance in sequentially solving composite tasks with ten problems in only a single inference process, highlighting the ability of timely intention switching in MeteoRA embedded LLMs.

Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey

1 code implementation21 Nov 2023 Yunpeng Huang, Jingwei Xu, Junyu Lai, Zixu Jiang, Taolue Chen, Zenan Li, Yuan YAO, Xiaoxing Ma, Lijuan Yang, Hao Chen, Shupeng Li, Penghao Zhao

Transformer-based Large Language Models (LLMs) have been applied in diverse areas such as knowledge bases, human interfaces, and dynamic agents, and marking a stride towards achieving Artificial General Intelligence (AGI).

Navigate

Cannot find the paper you are looking for? You can Submit a new open access paper.