Search Results for author: Yi Fung

Found 6 papers, 5 papers with code

Massively Multi-Cultural Knowledge Acquisition & LM Benchmarking

1 code implementation14 Feb 2024 Yi Fung, Ruining Zhao, Jae Doo, Chenkai Sun, Heng Ji

Pretrained large language models have revolutionized many applications but still face challenges related to cultural bias and a lack of cultural commonsense knowledge crucial for guiding cross-culture communication and interactions.

Benchmarking Language Modelling +1

Word Embeddings Are Steers for Language Models

1 code implementation22 May 2023 Chi Han, Jialiang Xu, Manling Li, Yi Fung, Chenkai Sun, Nan Jiang, Tarek Abdelzaher, Heng Ji

In this work, we theoretically and empirically revisit output word embeddings and find that their linear transformations are equivalent to steering language model generation styles.

Language Modelling Word Embeddings

ADEPT: A DEbiasing PrompT Framework

1 code implementation10 Nov 2022 Ke Yang, Charles Yu, Yi Fung, Manling Li, Heng Ji

Despite this, relatively few efforts have been made to debias PLMs by prompt tuning with continuous prompts compared to its discrete counterpart.

Attribute Language Modelling +1

Cannot find the paper you are looking for? You can Submit a new open access paper.