squiduu

squiduu

The Most Detailed AI

Posts by Month

Nov 2022

01[논문 리뷰] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

Oct 2022

03[논문 리뷰] BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

02[논문 리뷰] ALBERT: A Lite BERT For Self-Supervised Learning of Language Representations

01[논문 리뷰] Diversifying Dialog Generation via Adaptive Label Smoothing (AdaLabel)

Sep 2022

09[논문 리뷰] Taking Notes on the Fly Helps Language Pre-Training (TNF)

08[논문 리뷰] Shortformer: Better Language Modeling Using Shorter Inputs

07[논문 리뷰] Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference (PET)

06[논문 리뷰] GPT Understands, Too (P-Tuning)

01[논문 리뷰] Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks