Search Results for author: Naveen Raman

Found 6 papers, 2 papers with code

Eliciting Bias in Question Answering Models through Ambiguity

1 code implementation EMNLP (MRQA) 2021 Andrew Mao, Naveen Raman, Matthew Shu, Eric Li, Franklin Yang, Jordan Boyd-Graber

We develop two sets of questions for closed and open domain questions respectively, which use ambiguous questions to probe QA models for bias.

Question Answering

Understanding Inter-Concept Relationships in Concept-Based Models

no code implementations28 May 2024 Naveen Raman, Mateo Espinosa Zarlenga, Mateja Jamnik

Concept-based explainability methods provide insight into deep learning systems by constructing explanations using human-understandable concepts.

Do Concept Bottleneck Models Obey Locality?

no code implementations2 Jan 2024 Naveen Raman, Mateo Espinosa Zarlenga, Juyeon Heo, Mateja Jamnik

These models require accurate concept predictors, yet the faithfulness of existing concept predictors to their underlying concepts is unclear.

Human Uncertainty in Concept-Based AI Systems

no code implementations22 Mar 2023 Katherine M. Collins, Matthew Barker, Mateo Espinosa Zarlenga, Naveen Raman, Umang Bhatt, Mateja Jamnik, Ilia Sucholutsky, Adrian Weller, Krishnamurthy Dvijotham

We study how existing concept-based models deal with uncertain interventions from humans using two novel datasets: UMNIST, a visual dataset with controlled simulated uncertainty based on the MNIST dataset, and CUB-S, a relabeling of the popular CUB concept dataset with rich, densely-annotated soft labels from humans.

Decision Making

Improving Learning-to-Defer Algorithms Through Fine-Tuning

no code implementations18 Dec 2021 Naveen Raman, Michael Yee

We work to improve learning-to-defer algorithms when paired with specific individuals by incorporating two fine-tuning algorithms and testing their efficacy using both synthetic and image datasets.

Data-Driven Methods for Balancing Fairness and Efficiency in Ride-Pooling

1 code implementation7 Oct 2021 Naveen Raman, Sanket Shah, John Dickerson

Rideshare and ride-pooling platforms use artificial intelligence-based matching algorithms to pair riders and drivers.

Fairness

Cannot find the paper you are looking for? You can Submit a new open access paper.