Senior Research Scientist
Adobe Research
kushalkafle [at] gmail [dot] com
I am a Senior Research Scientist at Adobe Research, where I lead the development of Adobe's vision-language foundation models across the full lifecycle: data, training infrastructure, new algorithms, and product transfer. Our embedding models power features in Firefly, Lightroom, Premiere Pro, Adobe Express, and Adobe Stock (see Tech Transfers), and in the last few years we have also been building multimodal LLMs / vision-language models (VLMs).
My research interests include representation learning, benchmarks and evaluations that probe what these models actually understand, and building models that are robust, fair, and right for the right reasons.
I received my Ph.D. from the Chester F. Carlson Center for Imaging Science at Rochester Institute of Technology, advised by Christopher Kanan, where I worked on visual question answering and language-grounded visual understanding.
I lead Adobe's vision-language foundation model efforts: image-text embedding models and, in the last few years, multimodal LLMs / VLMs. The embedding models are already used throughout Adobe products; the VLM work is moving from exploration toward product. Some of the shipped features:
Natural-language and image search for templates in Adobe Express (+46% click-through) and for assets in Adobe Stock, plus "More like this" template similarity in Express. Search has since grown to multilingual, behavior-tuned, and steerable, and now runs on a new generation of our foundation model.
Natural-language search of photo libraries with full phrases like "photos of dog taken at the beach", no keywords needed, plus assisted culling and Auto Stack via a compact on-device model.
Firefly Image 1, 2, and 3 used our text and image encoders for their reference features, including Style Reference uploads, generating similar images, and using images as references. Our models also power Firefly's NSFW safety filter, used for both image and video generation, and the classifiers that filter its training data.
Features from our image-text encoders were key to improving prompt coherence and bias handling for the image-to-video launch.
Visual search in Premiere Pro's Media Intelligence and Search panel, built with the video team on our image-text foundation model.
The same models are used elsewhere across Adobe, including:
List last updated November 4, 2026. For the latest, see Google Scholar.
@InProceedings{fioresi2026controlling,
author = "Fioresi, Joseph and Heilbron, Fabian Caba and Nathani, Pankaj and Shah, Mubarak and Kafle, Kushal",
editor = "Favaro, Paolo and Kukelova, Zuzana and Maki, Atsuto and Rohrbach, Anna and Schindler, Konrad and Tombari, Federico",
title = "Controlling Embedding Spaces with Text-Conditioned Transformations",
booktitle = "Computer Vision -- ECCV 2026",
year = "2026",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "565--584",
isbn = "978-3-032-37041-9"
}
@InProceedings{Hernandez_2025_ICCV,
author = {Hernandez, Jefferson and Shi, Jing and Jenni, Simon and Ordonez, Vicente and Kafle, Kushal},
title = {Improving Large Vision and Language Models by Learning from a Panel of Peers},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2025},
pages = {1402-1412}
}
@InProceedings{Slyman_2024_CVPR,
author = {Slyman, Eric and Lee, Stefan and Cohen, Scott and Kafle, Kushal},
title = {{FairDeDup}: Detecting and Mitigating Vision-Language Fairness Disparities in Semantic Dataset Deduplication},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2024},
pages = {13905-13916}
}
@InProceedings{Sameni_2024_CVPR,
author = {Sameni, Sepehr and Kafle, Kushal and Tan, Hao and Jenni, Simon},
title = {Building Vision-Language Models on Solid Foundations with Masked Distillation},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2024},
pages = {14216-14226}
}
@InProceedings{Tanjim_2024_WACV,
author = {Tanjim, Md Mehrab and Singh, Krishna Kumar and Kafle, Kushal and Sinha, Ritwik and Cottrell, Garrison W.},
title = {Discovering and Mitigating Biases in {CLIP}-Based Image Editing},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {January},
year = {2024},
pages = {2984-2993}
}
@InProceedings{shrestha2022occamnets,
author = "Shrestha, Robik and Kafle, Kushal and Kanan, Christopher",
editor = "Avidan, Shai and Brostow, Gabriel and Ciss{\'e}, Moustapha and Farinella, Giovanni Maria and Hassner, Tal",
title = "{OccamNets}: Mitigating Dataset Bias by Favoring Simpler Hypotheses",
booktitle = "Computer Vision -- ECCV 2022",
year = "2022",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "702--721",
isbn = "978-3-031-20044-1"
}
@InProceedings{hayes2020remind,
author = "Hayes, Tyler L. and Kafle, Kushal and Shrestha, Robik and Acharya, Manoj and Kanan, Christopher",
editor = "Vedaldi, Andrea and Bischof, Horst and Brox, Thomas and Frahm, Jan-Michael",
title = "{REMIND} Your Neural Network to Prevent Catastrophic Forgetting",
booktitle = "Computer Vision -- ECCV 2020",
year = "2020",
publisher = "Springer International Publishing",
address = "Cham",
pages = "466--483",
isbn = "978-3-030-58598-3"
}
@InProceedings{Kafle_2018_CVPR,
author = {Kafle, Kushal and Price, Brian and Cohen, Scott and Kanan, Christopher},
title = {{DVQA}: Understanding Data Visualizations via Question Answering},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2018}
}
@InProceedings{Hernandez_2025_ICCV,
author = {Hernandez, Jefferson and Shi, Jing and Jenni, Simon and Ordonez, Vicente and Kafle, Kushal},
title = {Improving Large Vision and Language Models by Learning from a Panel of Peers},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2025},
pages = {1402-1412}
}@misc{wu2026retouchiqmllmagentsinstructionbased,
title = {{RetouchIQ}: {MLLM} Agents for Instruction-Based Image Retouching with Generalist Reward},
author = {Qiucheng Wu and Jing Shi and Simon Jenni and Kushal Kafle and Tianyu Wang and Shiyu Chang and Handong Zhao},
year = {2026},
eprint = {2602.17558},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2602.17558}
}@misc{dong2026cotreferringimprovingreferring,
title = {{CoT} Referring: Improving Referring Expression Tasks with Grounded Reasoning},
author = {Qihua Dong and Luis Figueroa and Handong Zhao and Kushal Kafle and Jason Kuen and Zhihong Ding and Scott Cohen and Yun Fu},
year = {2026},
eprint = {2510.06243},
archivePrefix = {arXiv},
primaryClass = {cs.CL},
url = {https://arxiv.org/abs/2510.06243}
}@misc{just2025finalanswerimprovingvisual,
title = {More Than the Final Answer: Improving Visual Extraction and Logical Consistency in Vision-Language Models},
author = {Hoang Anh Just and Yifei Fan and Handong Zhao and Jiuxiang Gu and Ruiyi Zhang and Simon Jenni and Kushal Kafle and Ruoxi Jia and Jing Shi},
year = {2025},
eprint = {2512.12487},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2512.12487}
}@misc{zang2025ms4uidatasetmultimodalsummarization,
title = {{MS4UI}: A Dataset for Multi-modal Summarization of User Interface Instructional Videos},
author = {Yuan Zang and Hao Tan and Seunghyun Yoon and Franck Dernoncourt and Jiuxiang Gu and Kushal Kafle and Chen Sun and Trung Bui},
year = {2025},
eprint = {2506.12623},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2506.12623}
}@InProceedings{Hernandez_2025_ICCV,
author = {Hernandez, Jefferson and Shi, Jing and Jenni, Simon and Ordonez, Vicente and Kafle, Kushal},
title = {Improving Large Vision and Language Models by Learning from a Panel of Peers},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2025},
pages = {1402-1412}
}@InProceedings{Slyman_2025_ICCV,
author = {Slyman, Eric and Tanjim, Mehrab and Kafle, Kushal and Lee, Stefan},
title = {Calibrating {MLLM}-as-a-Judge via Multimodal {Bayesian} Prompt Ensembles},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2025},
pages = {17224-17234}
}@inproceedings{khosla-etal-2025-magnet,
title = "{MAGNET}: Augmenting Generative Decoders with Representation Learning and Infilling Capabilities",
author = "Khosla, Savya and Tiwari, Aditi and Kafle, Kushal and Jenni, Simon and Zhao, Handong and Collomosse, John and Shi, Jing",
editor = "Che, Wanxiang and Nabende, Joyce and Shutova, Ekaterina and Pilehvar, Mohammad Taher",
booktitle = "Proceedings of the 63rd Annual Meeting of the {A}ssociation for {C}omputational {L}inguistics (Volume 1: Long Papers)",
month = jul,
year = "2025",
address = "Vienna, Austria",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2025.acl-long.1325/",
doi = "10.18653/v1/2025.acl-long.1325",
pages = "27328--27346",
ISBN = "979-8-89176-251-0"
}@InProceedings{Lu_2025_CVPR,
author = {Lu, Jian and Srivastava, Shikhar and Chen, Junyu and Shrestha, Robik and Acharya, Manoj and Kafle, Kushal and Kanan, Christopher},
title = {Revisiting Multi-Modal {LLM} Evaluation},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2025},
pages = {555-564}
}@InProceedings{Hua_2024_ECCV,
author = "Hua, Hang and Shi, Jing and Kafle, Kushal and Jenni, Simon and Zhang, Daoan and Collomosse, John and Cohen, Scott and Luo, Jiebo",
editor = "Leonardis, Ale{\v{s}} and Ricci, Elisa and Roth, Stefan and Russakovsky, Olga and Sattler, Torsten and Varol, G{\"u}l",
title = "{FineMatch}: Aspect-Based Fine-Grained Image and Text Mismatch Detection and Correction",
booktitle = "Computer Vision -- ECCV 2024",
year = "2025",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "474--491",
isbn = "978-3-031-72673-6"
} @InProceedings{fioresi2026controlling,
author = "Fioresi, Joseph and Heilbron, Fabian Caba and Nathani, Pankaj and Shah, Mubarak and Kafle, Kushal",
editor = "Favaro, Paolo and Kukelova, Zuzana and Maki, Atsuto and Rohrbach, Anna and Schindler, Konrad and Tombari, Federico",
title = "Controlling Embedding Spaces with Text-Conditioned Transformations",
booktitle = "Computer Vision -- ECCV 2026",
year = "2026",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "565--584",
isbn = "978-3-032-37041-9"
} @InProceedings{Slyman_2024_CVPR,
author = {Slyman, Eric and Lee, Stefan and Cohen, Scott and Kafle, Kushal},
title = {{FairDeDup}: Detecting and Mitigating Vision-Language Fairness Disparities in Semantic Dataset Deduplication},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2024},
pages = {13905-13916}
} @InProceedings{Sameni_2024_CVPR,
author = {Sameni, Sepehr and Kafle, Kushal and Tan, Hao and Jenni, Simon},
title = {Building Vision-Language Models on Solid Foundations with Masked Distillation},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2024},
pages = {14216-14226}
}@misc{lu2026seeingwordscontrollingvisual,
title = {Seeing Through Words: Controlling Visual Retrieval Quality with Language Models},
author = {Jianglin Lu and Simon Jenni and Kushal Kafle and Jing Shi and Handong Zhao and Yun Fu},
year = {2026},
eprint = {2602.21175},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2602.21175}
}@InProceedings{fioresi2026controlling,
author = "Fioresi, Joseph and Heilbron, Fabian Caba and Nathani, Pankaj and Shah, Mubarak and Kafle, Kushal",
editor = "Favaro, Paolo and Kukelova, Zuzana and Maki, Atsuto and Rohrbach, Anna and Schindler, Konrad and Tombari, Federico",
title = "Controlling Embedding Spaces with Text-Conditioned Transformations",
booktitle = "Computer Vision -- ECCV 2026",
year = "2026",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "565--584",
isbn = "978-3-032-37041-9"
}@InProceedings{sethuraman2026vitalx,
author = "Sethuraman, T. V. and Khosla, Savya and Susladkar, Onkar Kishor and Tiwari, Aditi and Oh, Seoung Wug and Kafle, Kushal and Lee, Joon-Young and Hoiem, Derek and Jenni, Simon",
editor = "Favaro, Paolo and Kukelova, Zuzana and Maki, Atsuto and Rohrbach, Anna and Schindler, Konrad and Tombari, Federico",
title = "{ViTAL-X}: Video-Text Alignment with Cross-Modal Temporal Edits",
booktitle = "Computer Vision -- ECCV 2026",
year = "2026",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "123--142",
isbn = "978-3-032-37174-4"
}@inproceedings{khosla-etal-2025-magnet,
title = "{MAGNET}: Augmenting Generative Decoders with Representation Learning and Infilling Capabilities",
author = "Khosla, Savya and Tiwari, Aditi and Kafle, Kushal and Jenni, Simon and Zhao, Handong and Collomosse, John and Shi, Jing",
editor = "Che, Wanxiang and Nabende, Joyce and Shutova, Ekaterina and Pilehvar, Mohammad Taher",
booktitle = "Proceedings of the 63rd Annual Meeting of the {A}ssociation for {C}omputational {L}inguistics (Volume 1: Long Papers)",
month = jul,
year = "2025",
address = "Vienna, Austria",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2025.acl-long.1325/",
doi = "10.18653/v1/2025.acl-long.1325",
pages = "27328--27346",
ISBN = "979-8-89176-251-0"
}@InProceedings{Hua_2024_ECCV,
author = "Hua, Hang and Shi, Jing and Kafle, Kushal and Jenni, Simon and Zhang, Daoan and Collomosse, John and Cohen, Scott and Luo, Jiebo",
editor = "Leonardis, Ale{\v{s}} and Ricci, Elisa and Roth, Stefan and Russakovsky, Olga and Sattler, Torsten and Varol, G{\"u}l",
title = "{FineMatch}: Aspect-Based Fine-Grained Image and Text Mismatch Detection and Correction",
booktitle = "Computer Vision -- ECCV 2024",
year = "2025",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "474--491",
isbn = "978-3-031-72673-6"
}@InProceedings{Slyman_2024_CVPR,
author = {Slyman, Eric and Lee, Stefan and Cohen, Scott and Kafle, Kushal},
title = {{FairDeDup}: Detecting and Mitigating Vision-Language Fairness Disparities in Semantic Dataset Deduplication},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2024},
pages = {13905-13916}
}@InProceedings{Sameni_2024_CVPR,
author = {Sameni, Sepehr and Kafle, Kushal and Tan, Hao and Jenni, Simon},
title = {Building Vision-Language Models on Solid Foundations with Masked Distillation},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2024},
pages = {14216-14226}
}@InProceedings{Yang_2024_WACV,
author = {Yang, Ziyan and Kafle, Kushal and Lin, Zhe and Cohen, Scott and Ding, Zhihong and Ordonez, Vicente},
title = {{SCoRD}: Subject-Conditional Relation Detection With Text-Augmented Data},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {January},
year = {2024},
pages = {5731-5741}
}@InProceedings{Yang_2023_CVPR,
author = {Yang, Ziyan and Kafle, Kushal and Dernoncourt, Franck and Ordonez, Vicente},
title = {Improving Visual Grounding by Encouraging Consistent Gradient-Based Explanations},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2023},
pages = {19165-19174}
}@InProceedings{pham2022improving,
author = "Pham, Khoi and Kafle, Kushal and Lin, Zhe and Ding, Zhihong and Cohen, Scott and Tran, Quan and Shrivastava, Abhinav",
editor = "Avidan, Shai and Brostow, Gabriel and Ciss{\'e}, Moustapha and Farinella, Giovanni Maria and Hassner, Tal",
title = "Improving Closed and Open-Vocabulary Attribute Prediction Using Transformers",
booktitle = "Computer Vision -- ECCV 2022",
year = "2022",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "201--219",
isbn = "978-3-031-19806-9"
}@InProceedings{Pham_2021_CVPR,
author = {Pham, Khoi and Kafle, Kushal and Lin, Zhe and Ding, Zhihong and Cohen, Scott and Tran, Quan and Shrivastava, Abhinav},
title = {Learning To Predict Visual Attributes in the Wild},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2021},
pages = {13018-13028}
} @InProceedings{Tanjim_2024_WACV,
author = {Tanjim, Md Mehrab and Singh, Krishna Kumar and Kafle, Kushal and Sinha, Ritwik and Cottrell, Garrison W.},
title = {Discovering and Mitigating Biases in {CLIP}-Based Image Editing},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {January},
year = {2024},
pages = {2984-2993}
}@misc{magid2026copyingdefenseprotectingimages,
title = {Copying As Defense: Protecting Images from Editing By Eliciting Model Copying},
author = {Salma {Abdel Magid} and Sanghyuk Chun and Eric Slyman and Kushal Kafle and Olga Russakovsky},
year = {2026},
eprint = {2610.35566},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2610.35566}
}@misc{wu2026retouchiqmllmagentsinstructionbased,
title = {{RetouchIQ}: {MLLM} Agents for Instruction-Based Image Retouching with Generalist Reward},
author = {Qiucheng Wu and Jing Shi and Simon Jenni and Kushal Kafle and Tianyu Wang and Shiyu Chang and Handong Zhao},
year = {2026},
eprint = {2602.17558},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2602.17558}
}@inproceedings{akdemir2026plot,
title={Plot’n polish: Zero-shot story visualization and disentangled editing with text-to-image diffusion models},
author={Akdemir, Kiymet and Shi, Jing and Kafle, Kushal and Price, Brian L and Yanardag, Pinar},
booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},
volume={40},
number={3},
pages={1694--1702},
year={2026}
}@misc{magid2024theyredoctorssynthesizingdiverse,
title = {They're All Doctors: Synthesizing Diverse Counterfactuals to Mitigate Associative Bias},
author = {Salma {Abdel Magid} and Jui-Hsien Wang and Kushal Kafle and Hanspeter Pfister},
year = {2024},
eprint = {2406.11331},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2406.11331}
}@InProceedings{Tanjim_2024_WACV,
author = {Tanjim, Md Mehrab and Singh, Krishna Kumar and Kafle, Kushal and Sinha, Ritwik and Cottrell, Garrison W.},
title = {Discovering and Mitigating Biases in {CLIP}-Based Image Editing},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {January},
year = {2024},
pages = {2984-2993}
}@inproceedings{tanjim2022debiasing,
title={Debiasing Image-to-Image Translation Models},
author={Tanjim, Md Mehrab and Singh, Krishna Kumar and Kafle, Kushal and Sinha, Ritwik and Cottrell, Garrison W},
booktitle={BMVC},
pages={182},
year={2022}
}@InProceedings{Ravi_2021_ICCV,
author = {Ravi, Hareesh and Kafle, Kushal and Cohen, Scott and Brandt, Jonathan and Kapadia, Mubbasir},
title = {{AESOP}: Abstract Encoding of Stories, Objects, and Pictures},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2021},
pages = {2052-2063}
} @InProceedings{Slyman_2024_CVPR,
author = {Slyman, Eric and Lee, Stefan and Cohen, Scott and Kafle, Kushal},
title = {{FairDeDup}: Detecting and Mitigating Vision-Language Fairness Disparities in Semantic Dataset Deduplication},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2024},
pages = {13905-13916}
} @InProceedings{Tanjim_2024_WACV,
author = {Tanjim, Md Mehrab and Singh, Krishna Kumar and Kafle, Kushal and Sinha, Ritwik and Cottrell, Garrison W.},
title = {Discovering and Mitigating Biases in {CLIP}-Based Image Editing},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {January},
year = {2024},
pages = {2984-2993}
} @InProceedings{shrestha2022occamnets,
author = "Shrestha, Robik and Kafle, Kushal and Kanan, Christopher",
editor = "Avidan, Shai and Brostow, Gabriel and Ciss{\'e}, Moustapha and Farinella, Giovanni Maria and Hassner, Tal",
title = "{OccamNets}: Mitigating Dataset Bias by Favoring Simpler Hypotheses",
booktitle = "Computer Vision -- ECCV 2022",
year = "2022",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "702--721",
isbn = "978-3-031-20044-1"
}@misc{magid2026copyingdefenseprotectingimages,
title = {Copying As Defense: Protecting Images from Editing By Eliciting Model Copying},
author = {Salma {Abdel Magid} and Sanghyuk Chun and Eric Slyman and Kushal Kafle and Olga Russakovsky},
year = {2026},
eprint = {2610.35566},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2610.35566}
}@misc{magid2024theyredoctorssynthesizingdiverse,
title = {They're All Doctors: Synthesizing Diverse Counterfactuals to Mitigate Associative Bias},
author = {Salma {Abdel Magid} and Jui-Hsien Wang and Kushal Kafle and Hanspeter Pfister},
year = {2024},
eprint = {2406.11331},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2406.11331}
}@InProceedings{Slyman_2024_CVPR,
author = {Slyman, Eric and Lee, Stefan and Cohen, Scott and Kafle, Kushal},
title = {{FairDeDup}: Detecting and Mitigating Vision-Language Fairness Disparities in Semantic Dataset Deduplication},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2024},
pages = {13905-13916}
}@InProceedings{Tanjim_2024_WACV,
author = {Tanjim, Md Mehrab and Singh, Krishna Kumar and Kafle, Kushal and Sinha, Ritwik and Cottrell, Garrison W.},
title = {Discovering and Mitigating Biases in {CLIP}-Based Image Editing},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {January},
year = {2024},
pages = {2984-2993}
}@inproceedings{tanjim2022debiasing,
title={Debiasing Image-to-Image Translation Models},
author={Tanjim, Md Mehrab and Singh, Krishna Kumar and Kafle, Kushal and Sinha, Ritwik and Cottrell, Garrison W},
booktitle={BMVC},
pages={182},
year={2022}
}@InProceedings{shrestha2022occamnets,
author = "Shrestha, Robik and Kafle, Kushal and Kanan, Christopher",
editor = "Avidan, Shai and Brostow, Gabriel and Ciss{\'e}, Moustapha and Farinella, Giovanni Maria and Hassner, Tal",
title = "{OccamNets}: Mitigating Dataset Bias by Favoring Simpler Hypotheses",
booktitle = "Computer Vision -- ECCV 2022",
year = "2022",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "702--721",
isbn = "978-3-031-20044-1"
}@InProceedings{Shrestha_2022_WACV,
author = {Shrestha, Robik and Kafle, Kushal and Kanan, Christopher},
title = {An Investigation of Critical Issues in Bias Mitigation Techniques},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {January},
year = {2022},
pages = {1943-1954}
}@inproceedings{teney2020value,
author = {Teney, Damien and Abbasnejad, Ehsan and Kafle, Kushal and Shrestha, Robik and Kanan, Christopher and van den Hengel, Anton},
booktitle = {Advances in Neural Information Processing Systems},
editor = {H. Larochelle and M. Ranzato and R. Hadsell and M.F. Balcan and H. Lin},
pages = {407--417},
publisher = {Curran Associates, Inc.},
title = {On the Value of Out-of-Distribution Testing: An Example of {Goodhart}\textquotesingle s Law},
url = {https://proceedings.neurips.cc/paper_files/paper/2020/file/045117b0e0a11a242b9765e79cbf113f-Paper.pdf},
volume = {33},
year = {2020}
}@inproceedings{shrestha-etal-2020-negative,
title = "A negative case analysis of visual grounding methods for {VQA}",
author = "Shrestha, Robik and Kafle, Kushal and Kanan, Christopher",
editor = "Jurafsky, Dan and Chai, Joyce and Schluter, Natalie and Tetreault, Joel",
booktitle = "Proceedings of the 58th Annual Meeting of the {A}ssociation for {C}omputational {L}inguistics",
month = jul,
year = "2020",
address = "Online",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2020.acl-main.727/",
doi = "10.18653/v1/2020.acl-main.727",
pages = "8172--8181"
}@ARTICLE{kafle2019challenges,
AUTHOR = {Kafle, Kushal and Shrestha, Robik and Kanan, Christopher },
TITLE = {Challenges and Prospects in Vision and Language Research},
JOURNAL = {Frontiers in Artificial Intelligence},
VOLUME = {Volume 2 - 2019},
YEAR = {2019},
URL = {https://www.frontiersin.org/journals/artificial-intelligence/articles/10.3389/frai.2019.00028},
DOI = {10.3389/frai.2019.00028},
ISSN = {2624-8212}
} @InProceedings{hayes2020remind,
author = "Hayes, Tyler L. and Kafle, Kushal and Shrestha, Robik and Acharya, Manoj and Kanan, Christopher",
editor = "Vedaldi, Andrea and Bischof, Horst and Brox, Thomas and Frahm, Jan-Michael",
title = "{REMIND} Your Neural Network to Prevent Catastrophic Forgetting",
booktitle = "Computer Vision -- ECCV 2020",
year = "2020",
publisher = "Springer International Publishing",
address = "Cham",
pages = "466--483",
isbn = "978-3-030-58598-3"
} @InProceedings{Kafle_2018_CVPR,
author = {Kafle, Kushal and Price, Brian and Cohen, Scott and Kanan, Christopher},
title = {{DVQA}: Understanding Data Visualizations via Question Answering},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2018}
} @InProceedings{Lu_2025_CVPR,
author = {Lu, Jian and Srivastava, Shikhar and Chen, Junyu and Shrestha, Robik and Acharya, Manoj and Kafle, Kushal and Kanan, Christopher},
title = {Revisiting Multi-Modal {LLM} Evaluation},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2025},
pages = {555-564}
}@inproceedings{teney2020value,
author = {Teney, Damien and Abbasnejad, Ehsan and Kafle, Kushal and Shrestha, Robik and Kanan, Christopher and van den Hengel, Anton},
booktitle = {Advances in Neural Information Processing Systems},
editor = {H. Larochelle and M. Ranzato and R. Hadsell and M.F. Balcan and H. Lin},
pages = {407--417},
publisher = {Curran Associates, Inc.},
title = {On the Value of Out-of-Distribution Testing: An Example of {Goodhart}\textquotesingle s Law},
url = {https://proceedings.neurips.cc/paper_files/paper/2020/file/045117b0e0a11a242b9765e79cbf113f-Paper.pdf},
volume = {33},
year = {2020}
}@inproceedings{shrestha-etal-2020-negative,
title = "A negative case analysis of visual grounding methods for {VQA}",
author = "Shrestha, Robik and Kafle, Kushal and Kanan, Christopher",
editor = "Jurafsky, Dan and Chai, Joyce and Schluter, Natalie and Tetreault, Joel",
booktitle = "Proceedings of the 58th Annual Meeting of the {A}ssociation for {C}omputational {L}inguistics",
month = jul,
year = "2020",
address = "Online",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2020.acl-main.727/",
doi = "10.18653/v1/2020.acl-main.727",
pages = "8172--8181"
}@InProceedings{hayes2020remind,
author = "Hayes, Tyler L. and Kafle, Kushal and Shrestha, Robik and Acharya, Manoj and Kanan, Christopher",
editor = "Vedaldi, Andrea and Bischof, Horst and Brox, Thomas and Frahm, Jan-Michael",
title = "{REMIND} Your Neural Network to Prevent Catastrophic Forgetting",
booktitle = "Computer Vision -- ECCV 2020",
year = "2020",
publisher = "Springer International Publishing",
address = "Cham",
pages = "466--483",
isbn = "978-3-030-58598-3"
}@InProceedings{Kafle_2020_WACV,
author = {Kafle, Kushal and Shrestha, Robik and Cohen, Scott and Price, Brian and Kanan, Christopher},
title = {Answering Questions about Data Visualizations using Efficient Bimodal Fusion},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {March},
year = {2020}
}@phdthesis{kafle2020thesis,
title = {Advancing Multi-Modal Deep Learning: Towards Language-Grounded Visual Understanding},
author = {Kafle, Kushal},
school = {Rochester Institute of Technology},
year = {2020}
}@InProceedings{Shrestha_2019_CVPR,
author = {Shrestha, Robik and Kafle, Kushal and Kanan, Christopher},
title = {Answer Them All! Toward Universal Visual Question Answering Models},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2019}
}@ARTICLE{kafle2019challenges,
AUTHOR = {Kafle, Kushal and Shrestha, Robik and Kanan, Christopher },
TITLE = {Challenges and Prospects in Vision and Language Research},
JOURNAL = {Frontiers in Artificial Intelligence},
VOLUME = {Volume 2 - 2019},
YEAR = {2019},
URL = {https://www.frontiersin.org/journals/artificial-intelligence/articles/10.3389/frai.2019.00028},
DOI = {10.3389/frai.2019.00028},
ISSN = {2624-8212}
}@InProceedings{Kafle_2018_CVPR,
author = {Kafle, Kushal and Price, Brian and Cohen, Scott and Kanan, Christopher},
title = {{DVQA}: Understanding Data Visualizations via Question Answering},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2018}
}@inproceedings{kafle-etal-2017-data,
title = "Data Augmentation for Visual Question Answering",
author = "Kafle, Kushal and Yousefhussien, Mohammed and Kanan, Christopher",
editor = "Alonso, Jose M. and Bugar{\'i}n, Alberto and Reiter, Ehud",
booktitle = "Proceedings of the 10th International Conference on Natural Language Generation",
month = sep,
year = "2017",
address = "Santiago de Compostela, Spain",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/W17-3529/",
doi = "10.18653/v1/W17-3529",
pages = "198--202"
}@article{kafle2017visual,
title = {Visual question answering: Datasets, algorithms, and future challenges},
author = {Kafle, Kushal and Kanan, Christopher},
journal = {Computer Vision and Image Understanding},
year = {2017}
}@InProceedings{Kafle_2016_CVPR,
author = {Kafle, Kushal and Kanan, Christopher},
title = {Answer-Type Prediction for Visual Question Answering},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2016}
}@misc{magid2026copyingdefenseprotectingimages,
title = {Copying As Defense: Protecting Images from Editing By Eliciting Model Copying},
author = {Salma {Abdel Magid} and Sanghyuk Chun and Eric Slyman and Kushal Kafle and Olga Russakovsky},
year = {2026},
eprint = {2610.35566},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2610.35566}
}@misc{lu2026seeingwordscontrollingvisual,
title = {Seeing Through Words: Controlling Visual Retrieval Quality with Language Models},
author = {Jianglin Lu and Simon Jenni and Kushal Kafle and Jing Shi and Handong Zhao and Yun Fu},
year = {2026},
eprint = {2602.21175},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2602.21175}
}@misc{wu2026retouchiqmllmagentsinstructionbased,
title = {{RetouchIQ}: {MLLM} Agents for Instruction-Based Image Retouching with Generalist Reward},
author = {Qiucheng Wu and Jing Shi and Simon Jenni and Kushal Kafle and Tianyu Wang and Shiyu Chang and Handong Zhao},
year = {2026},
eprint = {2602.17558},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2602.17558}
}@misc{dong2026cotreferringimprovingreferring,
title = {{CoT} Referring: Improving Referring Expression Tasks with Grounded Reasoning},
author = {Qihua Dong and Luis Figueroa and Handong Zhao and Kushal Kafle and Jason Kuen and Zhihong Ding and Scott Cohen and Yun Fu},
year = {2026},
eprint = {2510.06243},
archivePrefix = {arXiv},
primaryClass = {cs.CL},
url = {https://arxiv.org/abs/2510.06243}
}@InProceedings{fioresi2026controlling,
author = "Fioresi, Joseph and Heilbron, Fabian Caba and Nathani, Pankaj and Shah, Mubarak and Kafle, Kushal",
editor = "Favaro, Paolo and Kukelova, Zuzana and Maki, Atsuto and Rohrbach, Anna and Schindler, Konrad and Tombari, Federico",
title = "Controlling Embedding Spaces with Text-Conditioned Transformations",
booktitle = "Computer Vision -- ECCV 2026",
year = "2026",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "565--584",
isbn = "978-3-032-37041-9"
}@InProceedings{sethuraman2026vitalx,
author = "Sethuraman, T. V. and Khosla, Savya and Susladkar, Onkar Kishor and Tiwari, Aditi and Oh, Seoung Wug and Kafle, Kushal and Lee, Joon-Young and Hoiem, Derek and Jenni, Simon",
editor = "Favaro, Paolo and Kukelova, Zuzana and Maki, Atsuto and Rohrbach, Anna and Schindler, Konrad and Tombari, Federico",
title = "{ViTAL-X}: Video-Text Alignment with Cross-Modal Temporal Edits",
booktitle = "Computer Vision -- ECCV 2026",
year = "2026",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "123--142",
isbn = "978-3-032-37174-4"
}@inproceedings{akdemir2026plot,
title={Plot’n polish: Zero-shot story visualization and disentangled editing with text-to-image diffusion models},
author={Akdemir, Kiymet and Shi, Jing and Kafle, Kushal and Price, Brian L and Yanardag, Pinar},
booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},
volume={40},
number={3},
pages={1694--1702},
year={2026}
}@misc{just2025finalanswerimprovingvisual,
title = {More Than the Final Answer: Improving Visual Extraction and Logical Consistency in Vision-Language Models},
author = {Hoang Anh Just and Yifei Fan and Handong Zhao and Jiuxiang Gu and Ruiyi Zhang and Simon Jenni and Kushal Kafle and Ruoxi Jia and Jing Shi},
year = {2025},
eprint = {2512.12487},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2512.12487}
}@misc{zang2025ms4uidatasetmultimodalsummarization,
title = {{MS4UI}: A Dataset for Multi-modal Summarization of User Interface Instructional Videos},
author = {Yuan Zang and Hao Tan and Seunghyun Yoon and Franck Dernoncourt and Jiuxiang Gu and Kushal Kafle and Chen Sun and Trung Bui},
year = {2025},
eprint = {2506.12623},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2506.12623}
}@InProceedings{Hernandez_2025_ICCV,
author = {Hernandez, Jefferson and Shi, Jing and Jenni, Simon and Ordonez, Vicente and Kafle, Kushal},
title = {Improving Large Vision and Language Models by Learning from a Panel of Peers},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2025},
pages = {1402-1412}
}@InProceedings{Slyman_2025_ICCV,
author = {Slyman, Eric and Tanjim, Mehrab and Kafle, Kushal and Lee, Stefan},
title = {Calibrating {MLLM}-as-a-Judge via Multimodal {Bayesian} Prompt Ensembles},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2025},
pages = {17224-17234}
}@inproceedings{khosla-etal-2025-magnet,
title = "{MAGNET}: Augmenting Generative Decoders with Representation Learning and Infilling Capabilities",
author = "Khosla, Savya and Tiwari, Aditi and Kafle, Kushal and Jenni, Simon and Zhao, Handong and Collomosse, John and Shi, Jing",
editor = "Che, Wanxiang and Nabende, Joyce and Shutova, Ekaterina and Pilehvar, Mohammad Taher",
booktitle = "Proceedings of the 63rd Annual Meeting of the {A}ssociation for {C}omputational {L}inguistics (Volume 1: Long Papers)",
month = jul,
year = "2025",
address = "Vienna, Austria",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2025.acl-long.1325/",
doi = "10.18653/v1/2025.acl-long.1325",
pages = "27328--27346",
ISBN = "979-8-89176-251-0"
}@InProceedings{Lu_2025_CVPR,
author = {Lu, Jian and Srivastava, Shikhar and Chen, Junyu and Shrestha, Robik and Acharya, Manoj and Kafle, Kushal and Kanan, Christopher},
title = {Revisiting Multi-Modal {LLM} Evaluation},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2025},
pages = {555-564}
}@misc{magid2024theyredoctorssynthesizingdiverse,
title = {They're All Doctors: Synthesizing Diverse Counterfactuals to Mitigate Associative Bias},
author = {Salma {Abdel Magid} and Jui-Hsien Wang and Kushal Kafle and Hanspeter Pfister},
year = {2024},
eprint = {2406.11331},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2406.11331}
}@InProceedings{Hua_2024_ECCV,
author = "Hua, Hang and Shi, Jing and Kafle, Kushal and Jenni, Simon and Zhang, Daoan and Collomosse, John and Cohen, Scott and Luo, Jiebo",
editor = "Leonardis, Ale{\v{s}} and Ricci, Elisa and Roth, Stefan and Russakovsky, Olga and Sattler, Torsten and Varol, G{\"u}l",
title = "{FineMatch}: Aspect-Based Fine-Grained Image and Text Mismatch Detection and Correction",
booktitle = "Computer Vision -- ECCV 2024",
year = "2025",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "474--491",
isbn = "978-3-031-72673-6"
}@InProceedings{Slyman_2024_CVPR,
author = {Slyman, Eric and Lee, Stefan and Cohen, Scott and Kafle, Kushal},
title = {{FairDeDup}: Detecting and Mitigating Vision-Language Fairness Disparities in Semantic Dataset Deduplication},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2024},
pages = {13905-13916}
}@InProceedings{Sameni_2024_CVPR,
author = {Sameni, Sepehr and Kafle, Kushal and Tan, Hao and Jenni, Simon},
title = {Building Vision-Language Models on Solid Foundations with Masked Distillation},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2024},
pages = {14216-14226}
}@InProceedings{Yang_2024_WACV,
author = {Yang, Ziyan and Kafle, Kushal and Lin, Zhe and Cohen, Scott and Ding, Zhihong and Ordonez, Vicente},
title = {{SCoRD}: Subject-Conditional Relation Detection With Text-Augmented Data},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {January},
year = {2024},
pages = {5731-5741}
}@InProceedings{Tanjim_2024_WACV,
author = {Tanjim, Md Mehrab and Singh, Krishna Kumar and Kafle, Kushal and Sinha, Ritwik and Cottrell, Garrison W.},
title = {Discovering and Mitigating Biases in {CLIP}-Based Image Editing},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {January},
year = {2024},
pages = {2984-2993}
}@InProceedings{Yang_2023_CVPR,
author = {Yang, Ziyan and Kafle, Kushal and Dernoncourt, Franck and Ordonez, Vicente},
title = {Improving Visual Grounding by Encouraging Consistent Gradient-Based Explanations},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2023},
pages = {19165-19174}
}@inproceedings{tanjim2022debiasing,
title={Debiasing Image-to-Image Translation Models},
author={Tanjim, Md Mehrab and Singh, Krishna Kumar and Kafle, Kushal and Sinha, Ritwik and Cottrell, Garrison W},
booktitle={BMVC},
pages={182},
year={2022}
}@InProceedings{pham2022improving,
author = "Pham, Khoi and Kafle, Kushal and Lin, Zhe and Ding, Zhihong and Cohen, Scott and Tran, Quan and Shrivastava, Abhinav",
editor = "Avidan, Shai and Brostow, Gabriel and Ciss{\'e}, Moustapha and Farinella, Giovanni Maria and Hassner, Tal",
title = "Improving Closed and Open-Vocabulary Attribute Prediction Using Transformers",
booktitle = "Computer Vision -- ECCV 2022",
year = "2022",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "201--219",
isbn = "978-3-031-19806-9"
}@InProceedings{shrestha2022occamnets,
author = "Shrestha, Robik and Kafle, Kushal and Kanan, Christopher",
editor = "Avidan, Shai and Brostow, Gabriel and Ciss{\'e}, Moustapha and Farinella, Giovanni Maria and Hassner, Tal",
title = "{OccamNets}: Mitigating Dataset Bias by Favoring Simpler Hypotheses",
booktitle = "Computer Vision -- ECCV 2022",
year = "2022",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "702--721",
isbn = "978-3-031-20044-1"
}@InProceedings{Shrestha_2022_WACV,
author = {Shrestha, Robik and Kafle, Kushal and Kanan, Christopher},
title = {An Investigation of Critical Issues in Bias Mitigation Techniques},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {January},
year = {2022},
pages = {1943-1954}
}@InProceedings{Ravi_2021_ICCV,
author = {Ravi, Hareesh and Kafle, Kushal and Cohen, Scott and Brandt, Jonathan and Kapadia, Mubbasir},
title = {{AESOP}: Abstract Encoding of Stories, Objects, and Pictures},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2021},
pages = {2052-2063}
}@InProceedings{Pham_2021_CVPR,
author = {Pham, Khoi and Kafle, Kushal and Lin, Zhe and Ding, Zhihong and Cohen, Scott and Tran, Quan and Shrivastava, Abhinav},
title = {Learning To Predict Visual Attributes in the Wild},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2021},
pages = {13018-13028}
}@misc{qian2020needfullyconnectedoutput,
title = {Do We Need Fully Connected Output Layers in Convolutional Networks?},
author = {Zhongchao Qian and Tyler L. Hayes and Kushal Kafle and Christopher Kanan},
year = {2020},
eprint = {2004.13587},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2004.13587}
}@inproceedings{teney2020value,
author = {Teney, Damien and Abbasnejad, Ehsan and Kafle, Kushal and Shrestha, Robik and Kanan, Christopher and van den Hengel, Anton},
booktitle = {Advances in Neural Information Processing Systems},
editor = {H. Larochelle and M. Ranzato and R. Hadsell and M.F. Balcan and H. Lin},
pages = {407--417},
publisher = {Curran Associates, Inc.},
title = {On the Value of Out-of-Distribution Testing: An Example of {Goodhart}\textquotesingle s Law},
url = {https://proceedings.neurips.cc/paper_files/paper/2020/file/045117b0e0a11a242b9765e79cbf113f-Paper.pdf},
volume = {33},
year = {2020}
}@inproceedings{shrestha-etal-2020-negative,
title = "A negative case analysis of visual grounding methods for {VQA}",
author = "Shrestha, Robik and Kafle, Kushal and Kanan, Christopher",
editor = "Jurafsky, Dan and Chai, Joyce and Schluter, Natalie and Tetreault, Joel",
booktitle = "Proceedings of the 58th Annual Meeting of the {A}ssociation for {C}omputational {L}inguistics",
month = jul,
year = "2020",
address = "Online",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2020.acl-main.727/",
doi = "10.18653/v1/2020.acl-main.727",
pages = "8172--8181"
}@InProceedings{hayes2020remind,
author = "Hayes, Tyler L. and Kafle, Kushal and Shrestha, Robik and Acharya, Manoj and Kanan, Christopher",
editor = "Vedaldi, Andrea and Bischof, Horst and Brox, Thomas and Frahm, Jan-Michael",
title = "{REMIND} Your Neural Network to Prevent Catastrophic Forgetting",
booktitle = "Computer Vision -- ECCV 2020",
year = "2020",
publisher = "Springer International Publishing",
address = "Cham",
pages = "466--483",
isbn = "978-3-030-58598-3"
}@InProceedings{Kafle_2020_WACV,
author = {Kafle, Kushal and Shrestha, Robik and Cohen, Scott and Price, Brian and Kanan, Christopher},
title = {Answering Questions about Data Visualizations using Efficient Bimodal Fusion},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {March},
year = {2020}
}@phdthesis{kafle2020thesis,
title = {Advancing Multi-Modal Deep Learning: Towards Language-Grounded Visual Understanding},
author = {Kafle, Kushal},
school = {Rochester Institute of Technology},
year = {2020}
}@InProceedings{Shrestha_2019_CVPR,
author = {Shrestha, Robik and Kafle, Kushal and Kanan, Christopher},
title = {Answer Them All! Toward Universal Visual Question Answering Models},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2019}
}@ARTICLE{kafle2019challenges,
AUTHOR = {Kafle, Kushal and Shrestha, Robik and Kanan, Christopher },
TITLE = {Challenges and Prospects in Vision and Language Research},
JOURNAL = {Frontiers in Artificial Intelligence},
VOLUME = {Volume 2 - 2019},
YEAR = {2019},
URL = {https://www.frontiersin.org/journals/artificial-intelligence/articles/10.3389/frai.2019.00028},
DOI = {10.3389/frai.2019.00028},
ISSN = {2624-8212}
}@InProceedings{Kafle_2018_CVPR,
author = {Kafle, Kushal and Price, Brian and Cohen, Scott and Kanan, Christopher},
title = {{DVQA}: Understanding Data Visualizations via Question Answering},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2018}
}@inproceedings{kafle-etal-2017-data,
title = "Data Augmentation for Visual Question Answering",
author = "Kafle, Kushal and Yousefhussien, Mohammed and Kanan, Christopher",
editor = "Alonso, Jose M. and Bugar{\'i}n, Alberto and Reiter, Ehud",
booktitle = "Proceedings of the 10th International Conference on Natural Language Generation",
month = sep,
year = "2017",
address = "Santiago de Compostela, Spain",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/W17-3529/",
doi = "10.18653/v1/W17-3529",
pages = "198--202"
}@article{kafle2017visual,
title = {Visual question answering: Datasets, algorithms, and future challenges},
author = {Kafle, Kushal and Kanan, Christopher},
journal = {Computer Vision and Image Understanding},
year = {2017}
}@InProceedings{Kafle_2016_CVPR,
author = {Kafle, Kushal and Kanan, Christopher},
title = {Answer-Type Prediction for Visual Question Answering},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2016}
}What follows is some long-winded collaboration lineage hunting, but you can't deny the facts! Kushal Kafle → Hao Tan → Leonidas Guibas → János Pach → Paul Erdős. Here's the link.
Norbert Wiener is my grand-grand-grand-mentor (via Christopher Kanan, Garrison Cottrell, and Michael Arbib), and David Hilbert and Bertrand Russell are my grand-grand-grand-grand-mentors. It only gets better from there! Another branch runs through William Feller, Richard Courant, Jacob Rosanes, and Rudolf Lipschitz, and if you keep following it, you eventually encounter some really big-shot names: Dirichlet, Fourier, Poisson, Laplace, and Lagrange. Along the way there are also David Rumelhart, Warren McCulloch, and Rudolf Kalman. Talk about standing on the shoulders of giants! Here's the link.