Faculty

Institution

Unit

Venue

Derek W Hoiem

Professor

University of Illinois Urbana-Champaign

Affiliations

The Grainger College of Engineering

Siebel School of Computing and Data Science

Derek W Hoiem is currently serving as a Siebel School Of Computing And Data Science Professor at University of Illinois Urbana-Champaign.

Honors

Create free account to unlock more features

Experiences

Create free account to unlock more features

Education

Create free account to unlock more features

Derek W Hoiem

University of Illinois Urbana-Champaign

Professor

You can click a keyword to filter the displayed items

computer vision machine vision image representation image analysis computer science machine learning data science computer graphics scene modeling pattern recognition geometric modeling digital image processing computational imaging scene understanding object recognition 3d computer vision machine learning research 3d vision deep learning multimedia information processing multimedia retrieval object detection computational geometry multimedia modeling scene analysis 3d object recognition visual grounding multi-view geometry scene interpretation feature learning vision language model architecture object categorization 3d reconstruction image classification semantic evaluation computational intelligence robot learning computer-aided design vision recognition language localization visual question answering image retrieval convolutional neural networks music information retrieval structure from motion text-to-image retrieval audio retrieval depth map image search multimodal llm spatial layout knowledge discovery visual science content-based image retrieval complete 3d depth maps surface modeling edge detection music classification image similarity vision robotics shadow detection dataset paired regions object segmentation occlusion boundaries music identification indoor scenes part detectors box annotations indoor segmentation used feature extraction unified vision system familiar objects familiar object

Notable Scholarly Works

Notable Federal Grants

Collaborators

RELOCATE: A Simple Training-Free Baseline for Visual Query Localization Using Region-Based Representations. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2025)

Savya KhoslaSethuraman T VAlexander SchwingDerek Hoiem

computer visionimage retrievalinformation retrievalmachine visionimage searchdata scienceimage representationsimple training-free baselinelocalization

Addressing Low-Shot Mvs by Detecting and Completing Planar Surfaces. 2021 International Conference on 3D Vision (3DV) (2024)

Rajbir KatariaZhizhong LiJoseph DeGolDerek Hoiem

computational imagingcomputer graphicscomputational geometrymultiview stereocomputer visioncomputer stereo visiondepth mapdeep learningmachine visiondigital image processingimage analysisdepth mapsmulti-view geometryimage representationscene modelinglow-shot mvs3d visiongeometric modeling

MIRACLE: An Online, Explainable Multimodal Interactive Concept Learning System. (2024)

Ansel BlumeKhanh Duy NguyenZhenhailong WangYangyi ChenMichal Shlapentokh-RothmanXiaomeng JinJeonghwan KimZhen ZhuJiateng LiuKuan-Hao HuangMankeerat SidhuXuanming ZhangVivian LiuRaunak SinhaTe-Lin WuAbhay ZalaElias Stengel-EskinDa YinYao XiaoUtkarsh MallZhou YuKai-Wei ChangCamille CobbKarrie KarahaliosLydia ChiltonMohit BansalNanyun PengCarl VondrickDerek HoiemHeng Ji

explanation-based learninghuman-computer interactionlearning sciencesartificial intelligencemultimodal interactionintelligent user interfaceslanguage modelscomputational intelligencelanguagemultimodal learningcognitive scienceknowledge representation and reasoning

Region-Based Representations Revisited. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2024)

Michal Shlapentokh-RothmanAnsel BlumeYao XiaoYuqun WuSethuraman T VHeyi TaoJae Yong LeeWilfredo TorresYu-Xiong WangDerek Hoiem

representation theorygroup representationgeometric representationsmachine learningregion-based representationsneural computationpattern recognitioncomputational intelligencecomputer sciencemathematics

Unified-Io 2: Scaling Autoregressive Multimodal Models With Vision, Language, Audio, and Action. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2024)

Jiasen LuChristopher ClarkSangho LeeZichen ZhangSavya KhoslaRyan MartenDerek HoiemAniruddha Kembhavi

spoken language technologyautoregressive multimodal modelsunified-io 2multimedia retrievalcomputer visionvideo interpretationmultimodal llmmultimedia information processingspeech recognitionlanguage modelsmachine visionmultimodal signal processingdata sciencemultimedia modelingmultimodal learningmachine learning

WEBWISE: Unlocking Web Interface Control for Llms via Sequential Exploration. Findings of the Association for Computational Linguistics: NAACL 2022 (2024)

Heyi TaoSethuraman T VMichal Shlapentokh-RothmanTanmay GuptaHeng JiDerek Hoiem

systems engineeringsequential explorationreinforcement learninguser interfacesllm-based agentformal verificationcomputer science

Comparing Human Object Learning With Deep Neural Networks. Journal of Vision (2023)

Yinuo PengZhen ZhuDerek HoiemRanxiao Frances Wang

neural network (machine learning)machine learningconvolutional neural networksmachine learning modelshuman object learningimage classificationnovel viewpointsdeep learningfeature learningmachine learning researchdata sciencecomputational intelligenceimage representationcognitive sciencecomputer science

VISTRUCT: Visual Structural Knowledge Extraction via Curriculum Guided Code-Vision Representation. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (2023)

Yangyi ChenXingyao WangManling LiDerek HoiemHeng Ji

information visualizationpresent vistructcomputer visionstructural knowledge extractionvistruct traininglanguage modelsvision language modelvisual reasoningvisual groundingdata sciencevisualizationimage representationmultimedia information processing

GRIT: General Robust Image Task Benchmark. arXiv (Cornell University) (2022)

Gupta, TanmayMarten, RyanKembhavi, AniruddhaHoiem, Derek

visual scienceimage perturbationscomputer visionvision recognitioncomputer vision modelsmachine visionvisual groundingimage analysisobject recognitionimage classificationimage representationvisual perceptionmachine learningtraining distributioncomputer science

Language Models With Image Descriptors Are Strong Few-Shot Video-Language Learners. arXiv (Cornell University) (2022)

Wang, ZhenhailongLi, ManlingXu, RuochenZhou, LuoweiLei, JieLin, XudongWang, ShuohangYang, ZiyiZhu, ChenguangHoiem, DerekChang, Shih-FuBansal, MohitJi, Heng

multimedia modelingimage descriptorscomputer visionmultimodal llmdeep learninglanguage modelsnatural language processingvision language modelvisual groundingvisual question answeringlanguageimage representationmachine learninglinguisticsnatural language generation

1
2
3
4
5
12
10 / page

Derek W Hoiem

Professor

University of Illinois Urbana-Champaign

Affiliations

The Grainger College of Engineering

Siebel School of Computing and Data Science

Derek W Hoiem is currently serving as a Siebel School Of Computing And Data Science Professor at University of Illinois Urbana-Champaign.

Honors

Create free account to unlock more features

Experiences

Create free account to unlock more features

Education

Create free account to unlock more features

Derek W Hoiem

University of Illinois Urbana-Champaign

Professor

You can click a keyword to filter the displayed items

Notable Scholarly Works

Notable Federal Grants

Collaborators

RELOCATE: A Simple Training-Free Baseline for Visual Query Localization Using Region-Based Representations. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2025)

Savya KhoslaSethuraman T VAlexander SchwingDerek Hoiem

computer visionimage retrievalinformation retrievalmachine visionimage searchdata scienceimage representationsimple training-free baselinelocalization

Addressing Low-Shot Mvs by Detecting and Completing Planar Surfaces. 2021 International Conference on 3D Vision (3DV) (2024)

Rajbir KatariaZhizhong LiJoseph DeGolDerek Hoiem

MIRACLE: An Online, Explainable Multimodal Interactive Concept Learning System. (2024)

Region-Based Representations Revisited. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2024)

Michal Shlapentokh-RothmanAnsel BlumeYao XiaoYuqun WuSethuraman T VHeyi TaoJae Yong LeeWilfredo TorresYu-Xiong WangDerek Hoiem

Unified-Io 2: Scaling Autoregressive Multimodal Models With Vision, Language, Audio, and Action. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2024)

Jiasen LuChristopher ClarkSangho LeeZichen ZhangSavya KhoslaRyan MartenDerek HoiemAniruddha Kembhavi

WEBWISE: Unlocking Web Interface Control for Llms via Sequential Exploration. Findings of the Association for Computational Linguistics: NAACL 2022 (2024)

Heyi TaoSethuraman T VMichal Shlapentokh-RothmanTanmay GuptaHeng JiDerek Hoiem

systems engineeringsequential explorationreinforcement learninguser interfacesllm-based agentformal verificationcomputer science

Comparing Human Object Learning With Deep Neural Networks. Journal of Vision (2023)

Yinuo PengZhen ZhuDerek HoiemRanxiao Frances Wang

VISTRUCT: Visual Structural Knowledge Extraction via Curriculum Guided Code-Vision Representation. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (2023)

Yangyi ChenXingyao WangManling LiDerek HoiemHeng Ji

GRIT: General Robust Image Task Benchmark. arXiv (Cornell University) (2022)

Gupta, TanmayMarten, RyanKembhavi, AniruddhaHoiem, Derek

Language Models With Image Descriptors Are Strong Few-Shot Video-Language Learners. arXiv (Cornell University) (2022)

Wang, ZhenhailongLi, ManlingXu, RuochenZhou, LuoweiLei, JieLin, XudongWang, ShuohangYang, ZiyiZhu, ChenguangHoiem, DerekChang, Shih-FuBansal, MohitJi, Heng

1
2
3
4
5
12
10 / page

Similar Faculty Members

Svetlana Lazebnik

Institution

University of Illinois Urbana-Champaign

machine vision

memetic computing

Bharath Hariharan

Institution

Cornell University

3d computer vision

3d reconstruction

Yuxiong Wang

Institution

University of Illinois Urbana-Champaign

machine learning

computer science

Alexander Gerhard Schwing

Institution

University of Illinois Urbana-Champaign

robotics perception

technology

Kobus Barnard

Institution

University of Arizona

video understanding

shape modeling

Stefan Lee

Institution

Oregon State University

computational intelligence

ai architecture

Sinisa Todorovic

Institution

Oregon State University

multiple instance learning

computational intelligence

Mark Hasegawa-Johnson

Institution

University of Illinois Urbana-Champaign

speech recognition

audio signal processing

Kavita Bala

Institution

Cornell University

material modeling

graphics

Alexei Efros

Institution

University of California, Berkeley

computer vision

computer science

Similar Faculty Members

Svetlana Lazebnik

Institution

University of Illinois Urbana-Champaign

machine vision

memetic computing

Bharath Hariharan

Institution

Cornell University

3d computer vision

3d reconstruction

Yuxiong Wang

Institution

University of Illinois Urbana-Champaign

machine learning

computer science

Alexander Gerhard Schwing

Institution

University of Illinois Urbana-Champaign

robotics perception

technology

Kobus Barnard

Institution

University of Arizona

video understanding

shape modeling

Stefan Lee

Institution

Oregon State University

computational intelligence

ai architecture

Sinisa Todorovic

Institution

Oregon State University

multiple instance learning

computational intelligence

Mark Hasegawa-Johnson

Institution

University of Illinois Urbana-Champaign

speech recognition

audio signal processing

Kavita Bala

Institution

Cornell University

material modeling

graphics

Alexei Efros

Institution

University of California, Berkeley

computer vision

computer science