Browse State-of-the-Art
Datasets
Methods
More
Newsletter
RC2022
About
Trends
Portals
Libraries
Sign In
Subscribe to the PwC Newsletter
×
Stay informed on the latest trending ML papers with code, research developments, libraries, methods, and datasets.
Read previous issues
Join the community
×
You need to
log in
to edit.
You can
create a new account
if you don't have one.
Methods
> Natural Language Processing
Natural Language Processing
294 methods • 112434 papers with code
Language Models
Transformer
9623 papers with code
Diffusion
6503 papers with code
Focus
6153 papers with code
BERT
5118 papers with code
GPT-4
1542 papers with code
See all 138 methods
Transformers
Transformer
9623 papers with code
Focus
6153 papers with code
BERT
5118 papers with code
GPT-3
1382 papers with code
RoBERTa
757 papers with code
See all 93 methods
Autoencoding Transformers
BERT
5118 papers with code
RoBERTa
757 papers with code
T5
562 papers with code
ALBERT
155 papers with code
DistilBERT
128 papers with code
See all 28 methods
Word Embeddings
GloVe
318 papers with code
ELMo
228 papers with code
fastText
212 papers with code
UNITER
23 papers with code
USE
20 papers with code
See all 21 methods
Autoregressive Transformers
Transformer
9623 papers with code
GPT-3
1382 papers with code
GPT
692 papers with code
GPT-2
554 papers with code
XLNet
156 papers with code
See all 17 methods
Attention Patterns
Fixed Factorized Attention
1381 papers with code
Strided Attention
1379 papers with code
Sliding Window Attention
85 papers with code
Global and Sliding Window Attention
79 papers with code
Dilated Sliding Window Attention
78 papers with code
See all 8 methods
Sentence Embeddings
MTS
64 papers with code
SBERT
44 papers with code
SimCSE
42 papers with code
Mirror-BERT
6 papers with code
TSDAE
3 papers with code
See all 8 methods
Static Word Embeddings
GloVe
318 papers with code
fastText
212 papers with code
Skip-gram Word2Vec
14 papers with code
CBoW Word2Vec
6 papers with code
Mirror-BERT
6 papers with code
See all 7 methods
Contextualized Word Embeddings
ELMo
228 papers with code
USE
20 papers with code
CoVe
9 papers with code
Cross-View Training
8 papers with code
Contextualized Topic Models
7 papers with code
See all 7 methods
Text Classification Models
MixText
2 papers with code
DualCL
2 papers with code
Lbl2Vec
2 papers with code
ALDEN
1 papers with code
Lbl2TransformerVec
1 papers with code
See all 6 methods
Subword Segmentation
BPE
12443 papers with code
WordPiece
5277 papers with code
Gradient-Based Subword Tokenization
5 papers with code
Unigram Segmentation
1 papers with code
See all 4 methods
Document Embeddings
Contextualized Topic Models
7 papers with code
lda2vec
1 papers with code
EDLPS
See all 4 methods
Synthesized Attention Mechanisms
Dense Synthesized Attention
1 papers with code
Random Synthesized Attention
1 papers with code
Factorized Random Synthesized Attention
1 papers with code
Factorized Dense Synthesized Attention
1 papers with code
See all 4 methods
Language Model Pre-Training
MPNet
12 papers with code
ERNIE-GEN
1 papers with code
ReasonBERT
1 papers with code
K3M
1 papers with code
See all 4 methods
Code Generation Transformers
CodeBERT
50 papers with code
CodeT5
19 papers with code
PICARD
11 papers with code
CuBERT
2 papers with code
See all 4 methods
Table Question Answering Models
TAPAS
9 papers with code
MATE
6 papers with code
See all 4 methods
Machine Translation Models
Seq2Seq
654 papers with code
PCT
30 papers with code
See all 3 methods
Question Answering Models
Macaw
4 papers with code
TransferQA
1 papers with code
EMQAP
1 papers with code
See all 3 methods
Relation Extraction Models
Partition Filter Network
2 papers with code
HEGCN
1 papers with code
CubeRE
1 papers with code
See all 3 methods
Tokenizers
WordPiece
5277 papers with code
SentencePiece
748 papers with code
See all 2 methods
Topic Embeddings
Contextualized Topic Models
7 papers with code
lda2vec
1 papers with code
See all 2 methods
Entity Recognition Models
Partition Filter Network
2 papers with code
See all 2 methods
Textual Meaning
SIRM
1 papers with code
See all 2 methods
Document Summary Evaluation
BLANC
6 papers with code
See all 2 methods
Conversational Models
SRS
25 papers with code
Meena
3 papers with code
See all 2 methods
Dialog Adaptation
DAPO
1 papers with code
See all 2 methods
Text Augmentation
MixText
2 papers with code
Augmented SBERT
1 papers with code
See all 2 methods
Language Model Components
Neural Cache
4 papers with code
See all 2 methods
Sequence Decoding Methods
Discriminative Adversarial Search
2 papers with code
Vulnerability-constrained Decoding
1 papers with code
See all 2 methods
Input Embedding Factorization
Adaptive Input Representations
63 papers with code
See all 1 methods
Reading Comprehension Models
Deep LSTM Reader
1 papers with code
See all 1 methods
Passage Re-Ranking Models
TILDEv2
3 papers with code
See all 1 methods
Exaggeration Detection Models
MT-PET
1 papers with code
See all 1 methods
Reading Order Detection Models
LayoutReader
1 papers with code
See all 1 methods
Span Representations
Packed Levitated Markers
2 papers with code
See all 1 methods
Taxonomy Expansion Models
TaxoExpan
1 papers with code
See all 1 methods
Open-Domain Chatbots
Meena
3 papers with code
See all 1 methods
Textual Inference Models
RAHP
1 papers with code
See all 1 methods
Dialog System Evaluation
ENIGMA
7 papers with code
See all 1 methods
Inference Extrapolation
ALiBi
12 papers with code
See all 1 methods
Copy Mechanisms
TopK Copy
1 papers with code
See all 1 methods
Entity Retrieval Models
MuVER
1 papers with code
See all 1 methods
Text Data Augmentation
AEDA
1 papers with code
See all 1 methods
Paraphrase Generation Models
BTmPG
1 papers with code
See all 1 methods
Sequence Editing Models
Seq2Edits
1 papers with code
See all 1 methods
Dialogue State Trackers
FastSGT
1 papers with code
See all 1 methods
Document Understanding Models
LayoutLMv2
2 papers with code
See all 1 methods
Dependency Parsers
DDParser
1 papers with code
See all 1 methods