Biography

I am now working as a researcher at The Hong Kong University of Science and Technology. Prior to that, I obtained my Ph.D. degree in Computer Science from City University of Hong Kong in 2023 and worked there as a postdoctoral researcher and research fellow from 2023 to 2025, supervised by Prof. Rynson W.H. Lau. I received my B.Eng. degree in Computer Science and Technology (Elite Program) from South China University of Technology in 2019. I did some research on computer systems at The University of Hong Kong and The Chinese University of Hong Kong during my undergraduate studies.

My primary research interests lie in building human-aligned, efficient, and robust multimodal and computer vision applications. I aim to bridge the theory and practice of computer vision and computer graphics, particularly in areas such as autonomous driving, medical imaging, and embodied AI. My recent projects focus on human-aligned perception and generation, 3D perception and generation, inconspicuous object segmentation, and medical image analysis and synthesis.

For potential collaborations, please feel free to reach out to me via email or WeChat.

    Recent News [archives]

[Mar. 2026] UniFunc3D is available on arXiv.
[Feb. 2026] HVSBench is accepted to CVPR 2026 Findings.
[Feb. 2026] Our operando infrared dynamics benchmark is available on arXiv.
[Nov. 2025] One paper is accepted to AAAI 2026.
[Oct. 2025] One paper is accepted to TIP.
[Dec. 2024] Two papers are accepted to AAAI 2025.
[Sept. 2024] A paper is accepted to NeurIPS 2024.
[Aug. 2024] We construct OpenScan, a new benchmark for generalized 3D open-vocabulary 3D scene understanding.
[Mar. 2024] A paper is accepted to CVPR 2024.
[Oct. 2023] A paper is accepted to AAAI 2024.
[Jul. 2023] A paper on self-supervised learning is accepted to ICCV 2023.
[May 2023] I pass my Ph.D. thesis defense!
[Mar. 2023] A paper is accepted to CVPR 2023.
[Nov. 2022] Three papers are accepted to AAAI 2023, including two selected for oral presentations, for which I served as corresponding author.
[Oct. 2022] Grateful to be recognized as an Outstanding Reviewer for ECCV 2022.

    Preprints

UniFunc3D: Unified Active Spatial-Temporal Grounding for 3D Functionality Segmentation

Jiaying Lin, Dan Xu.
arXiv Preprint.
[project] [arxiv] [paper] [code]

From Static Spectra to Operando Infrared Dynamics: Physics Informed Flow Modeling and a Benchmark

Shuquan Ye, Ben Fei, Hongbin Xu, Jiaying Lin, Wanli Ouyang.
arXiv Preprint.
[project] [arxiv] [paper] [code]

Rethinking Video Salient Object Ranking

Jiaying Lin, Huankang Guan, Rynson W.H. Lau.
Arxiv, 2022.
[arxiv]

    Selected Publications [All]

    (* indicates equal contribution, # indicates corresponding author, @ indicates junior undergraduate students I mentored.)

Do MLLMs Exhibit Human-like Perceptual Behaviors? HVSBench: A Benchmark for MLLM Alignment with Human Perceptual Behavior

Jiaying Lin*, Shuquan Ye*, Dan Xu, Wanli Ouyang, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026 (Findings).
[project] [arxiv] [paper] [code]
*Equal Contribution.

OpenScan: A Benchmark for Generalized Open-Vocabulary 3D Scene Understanding

Youjun Zhao, Jiaying Lin#, Shuquan Ye, Qianshi Pang@, Rynson W.H. Lau.
Fortieth AAAI Conference on Artificial Intelligence (AAAI), 2026.
[arxiv] [code and data] [Zhihu (in Chinese)]

A Contrastive-Learning Framework for Unsupervised Salient Object Detection

Huankang Guan, Jiaying Lin, Rynson W.H. Lau.
IEEE Transactions on Image Processing (TIP), 2025.
[project] [paper] [code]

Leveraging RGB-D Data with Cross-Modal Context Mining for Glass Surface Detection

Jiaying Lin*, Yuen-Hei Yeung*@, Shuquan Ye, Rynson W.H. Lau.
Thirty-Ninth AAAI Conference on Artificial Intelligence (AAAI), 2025.
[project] [arxiv] [paper] [code]

Hierarchical Cross-Modal Alignment for Open-Vocabulary 3D Object Detection

Youjun Zhao*, Jiaying Lin*, Rynson W.H. Lau.
Thirty-Ninth AAAI Conference on Artificial Intelligence (AAAI), 2025.
[project] [paper] [code]

Boosting Weakly-Supervised Referring Image Segmentation via Progressive Comprehension

Zaiquan Yang, Yuhao Liu, Jiaying Lin, Gerhard Hancke, Rynson W.H. Lau.
Thirty-Eighth Conference on Neural Information Processing Systems (NeurIPS), 2024.
[paper]

Effective Video Mirror Detection with Inconsistent Motion Cues

Alex Warren, Ke Xu, Jiaying Lin, Gary Tam, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
[project] [paper] [code]

Multi-view Dynamic Reflection Prior for Video Glass Surface Detection

Fang Liu*, Yuhao Liu*, Jiaying Lin#, Ke Xu, Rynson W.H. Lau.
Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI), 2024.
[project] [paper] [code]

Self-supervised Pre-training for Mirror Detection

Jiaying Lin, Rynson W.H. Lau.
IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
[project] [paper] [code]

Learning to Detect Mirrors from Videos via Dual Correspondences

Jiaying Lin*, Xin Tan*, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
[project] [paper] [code]

Weakly-Supervised Camouflaged Object Detection with Scribble Annotations

Ruozhen He@*, Qihua Dong@*, Jiaying Lin#, Rynson W.H. Lau
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023. (Oral, 10.9%)
[project] [arxiv] [paper] [code and dataset]

Efficient Mirror Detection via Multi-level Heterogeneous Learning

Ruozhen He@, Jiaying Lin#, Rynson W.H. Lau
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023. (Oral, 10.9%)
[arxiv] [paper] [code]

Symmetry-Aware Transformer-based Mirror Detection

Tianyu Huang@, Bowen Dong, Jiaying Lin, Xiaohui Liu, Rynson W.H. Lau, Wangmeng Zuo
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023.
[arxiv] [code]

Exploiting Semantic Relations for Glass Surface Detection

Jiaying Lin*, Yuen-Hei Yeung*@, Rynson W.H. Lau.
Thirty-Sixth Conference on Neural Information Processing Systems (NeurIPS), 2022. (Spotlight, 5.16%)
[project] [paper] [code] [dataset]

Frequency-aware Camouflaged Object Detection

Jiaying Lin*, Xin Tan*, Ke Xu, Lizhuang Ma, Rynson W.H. Lau.
ACM Transactions on Multimedia Computing Communications and Applications (TOMM), 2022.
[paper] [results]

Mirror Detection with the Visual Chirality Cue

Xin Tan, Jiaying Lin, Ke Xu, Pan Chen, Lizhuang Ma, Rynson W.H. Lau.
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022.
[paper]

Learning Semantic Associations for Mirror Detection

Huankang Guan, Jiaying Lin, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[paper] [poster] [code]

Rich Context Aggregation with Reflection Prior for Glass Surface Detection

Jiaying Lin, Zebang He, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[project] [paper] [code] [dataset]

Progressive Mirror Detection

Jiaying Lin, Guodong Wang, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[project] [paper] [code] [dataset]

Coherence and Identity Learning for Arbitrary-length Face Video Generation

Shuquan Ye, Chu Han, Jiaying Lin, Guoqiang Han, Shengfeng He.
International Conference on Pattern Recognition (ICPR), 2020.
[paper]

An Estimation of Distribution Algorithm for Large-Scale Optimization with Cooperative Co-evolution and Local Search

Jiaying Lin, Wei-Neng Chen, Jun Zhang.
International Conference on Information Science and Technology (ICONIP), 2018.
[paper]

    Experiences

    Activities

Journal Reviewer

  • International Journal of Computer Vision (IJCV)
  • IEEE Transactions on Image Processing (TIP)
  • IEEE Transactions on Multimedia (TMM)
  • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)

Area Chair / Senior Program Committee

  • NeurIPS

Conference Reviewer / Program Committee

  • CVPR 2022, ECCV 2022, AAAI 2023, CVPR 2023, ICCV 2023, NeurIPS 2023, AAAI 2024, WACV 2024, CVPR 2024, ECCV 2024, SIGGRAPH 2024, SIGGRAPH Asia 2024, NeurIPS 2024, CVPR 2025, AAAI 2025, ICCV 2025, NeurIPS 2025, ACMMM 2025, AAAI 2026, CVPR 2026, ECCV 2026, ACMMM 2026.

    Teaching and Collaborators

Teaching at CityU

During my Ph.D. studies at CityUHK, I served as both a co-instructor (Lecturer) and teaching assistant for eight course offerings across four courses:

  • Introduction to Computer Studies (CS1102)
    • Semester A 2019/20
  • Virtual Reality (CS4188/CS5188)
    • Semester B 2019/20
    • Semester B 2020/21
    • Semester B 2021/22
    • Semester B 2022/23
  • Multimedia Technologies and Applications (CS4185/CS5185)
    • Semester A 2021/22
    • Semester A 2022/23
  • Machine Learning (CS4487)
    • Semester A 2020/21

Mentoring

For undergraduate and master’s students: I recognize that information asymmetry can pose a significant barrier to accessing research opportunities at early career stages. If my research areas align with your interests, I encourage you to reach out via email or Wechat.

Below is a non-exhaustive list of mentored junior researchers (undergraduate and master’s students) who have co-authored publications in top-tier venues:

  • Qianshi Pang (undergraduate student at SCUT, now a MPhil student at SYSU)
  • Qihua Dong (undergraduate student at CityU, now a Ph.D. student at Northeastern University)
  • Ruozhen He (undergraduate student at CityU, now a Ph.D. student at Rice University)
  • Zebang He (MSc student at CityU, now a Ph.D. student at PolyU)
  • Yuen-Hei Yeung (undergraduate student at CityU, won the Innovation and Technology Scholarship 2021 during his internship in our group [link], now a Master student at NYU)
  • Tianyu Huang (undergraduate student at HIT, now a CityU-HIT Joint Ph.D. student)

    Patents

    Honors & Awards

  • CVPR DEI Award, CVPR 2023
  • AAAI Student Scholarship, AAAI 2023
  • Outstanding Reviewer, ECCV 2022.
  • Research Tuition Scholarship, City University of Hong Kong (Top 6%, 21/344), 2022 - 2023
  • Postgraduate Studentship, City University of Hong Kong, 2019 - 2023
  • Undergraduate Studentship, South China University of Technology, 2016, 2017, 2018
  • Elite Student Program, South China University of Technology (Top 0.4%), 2015 - 2019

    Misc