일 | 월 | 화 | 수 | 목 | 금 | 토 |
---|---|---|---|---|---|---|
1 | 2 | |||||
3 | 4 | 5 | 6 | 7 | 8 | 9 |
10 | 11 | 12 | 13 | 14 | 15 | 16 |
17 | 18 | 19 | 20 | 21 | 22 | 23 |
24 | 25 | 26 | 27 | 28 | 29 | 30 |
31 |
- lifelong
- 어텐션
- nips
- 논문리뷰
- ai
- paper review
- 논문정리
- 자연어처리
- Lifelong Learning
- 네이버 부스트캠프 ai
- 부스트캠프
- MRC
- 머신러닝
- 트랜스포머 모델 설명
- 기계학습
- 부캠
- 기계독해
- lifelong language learning
- 인공지능
- 딥러닝
- 트랜스포머
- KorQuAD
- NLP
- AI Tech
- 네이버 부스트캠프
- transformer
- Today
- Total
SiRyu AI
Title: Parameter-Efficient Transfer Learning for NLP Authors: Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin de Laroussilhe, Andrea Gesmundo, Mona Attariyan, Sylvain GellyYun-Nung Chen Conference: PMLR 2019 Link: https://arxiv.org/pdf/1902.00751.pdf Keywords: Transformer, BERT, Adapter, AdapterHub, Multitask learning, Continual learning, Transfer learning
Title: BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension Authors: Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, Luke ZettlemoyerYun-Nung Chen Conference: ACL 2020 Link: https://arxiv.org/pdf/1910.13461.pdf Keywords: Transformer, Pretext task, BERT, BART, Denosing autoencoder
Title: Learning to Solve NLP Tasks in an Incremental Number of Languages Authors: Giuseppe Castellucci, Simone Filice, Danilo Croce, Roberto BasiliYun-Nung Chen Conference: ACL 2021 Link: https://aclanthology.org/2021.acl-short.106.pdf Keywords: Lifelong Learning, Lifelong Language Learning, Knowledge Distillation, Multilingual