Search Results for author: Wendan Yan

Found 2 papers, 0 papers with code

CLIPLoss and Norm-Based Data Selection Methods for Multimodal Contrastive Learning

no code implementations29 May 2024 Yiping Wang, Yifang Chen, Wendan Yan, Alex Fang, Wenjing Zhou, Kevin Jamieson, Simon Shaolei Du

By combining our methods with the current best methods DFN~\cite{fang2023data} and HYPE~\cite{kim2024hype}, we can boost average performance on downstream tasks by 0. 9\%, achieving a new state-of-the-art.

Contrastive Learning Language Modelling

Variance Alignment Score: A Simple But Tough-to-Beat Data Selection Method for Multimodal Contrastive Learning

no code implementations3 Feb 2024 Yiping Wang, Yifang Chen, Wendan Yan, Kevin Jamieson, Simon Shaolei Du

In recent years, data selection has emerged as a core issue for large-scale visual-language model pretraining, especially on noisy web-curated datasets.

Contrastive Learning Experimental Design +1

Cannot find the paper you are looking for? You can Submit a new open access paper.