I am currently a Research Fellow at City University of Hong Kong. Prior to that, I obtained my Ph.D. degree in Computer Science from City University of Hong Kong in 2023, supervised by Prof. Rynson W.H. Lau. I received my B.Eng. degree in Computer Science and Engineering (Elite Program) from South China University of Technology in 2019.

My research focuses on building robust and multimodal vision applications such as:

• Detecting inconspicuous objects (e.g., mirrors, glass, and camouflaged objects) from real-world data
• Open-vocabulary 3D perception
• 3D vision with imperfect or multimodal data

[Aug. 2024] I am actively seeking job opportunities. Feel free to reach out to me!

[Dec. 2024] Two papers are accepted to AAAI 2025.
[Sept. 2024] A paper is accepted to NeurIPS 2024.
[Aug. 2024] We construct OpenScan, a new benchmark for generalized 3D open-vocabulary 3D scene understanding.
[Mar. 2024] A paper is accepted to CVPR 2024.
[Oct. 2023] A paper is accepted to AAAI 2024.
[Jul. 2023] A paper on self-supervised learning is accepted to ICCV 2023.
[May 2023] I pass my Ph.D. thesis defense!
[Mar. 2023] A paper is accepted to CVPR 2023.
[Nov. 2022] Three papers are accepted to AAAI 2023, including two selected for oral presentations, for which I served as corresponding author.
[Oct. 2022] Grateful to be recognized as an Outstanding Reviewer for ECCV 2022.

Do Multimodal Large Language Models See Like Humans?

Jiaying Lin^*, Shuquan Ye^*, Rynson W.H. Lau.
Arxiv, 2024.
[project] [arxiv]

OpenScan: A Benchmark for Generalized Open-Vocabulary 3D Scene Understanding

Youjun Zhao, Jiaying Lin, Shuquan Ye, Qianshi Pang, Rynson W.H. Lau.
Arxiv, Aug 2024.
[arxiv] [code and data] [Zhihu (in Chinese)]

Rethinking Video Salient Object Ranking

Jiaying Lin, Huankang Guan, Rynson W.H. Lau.
Arxiv, 2022.
[arxiv]

Leveraging RGB-D Data with Cross-Modal Context Mining for Glass Surface Detection

Jiaying Lin^*, Yuen-Hei Yeung^*, Shuquan Ye, Rynson W.H. Lau.
Thirty-Ninth Conference AAAI Conference on Artificial Intelligence (AAAI), 2025.
[project] [arxiv] [paper] [code]

Hierarchical Cross-Modal Alignment for Open-Vocabulary 3D Object Detection

Youjun Zhao^*, Jiaying Lin^*, Rynson W.H. Lau.
Thirty-Ninth Conference AAAI Conference on Artificial Intelligence (AAAI), 2025.
[project] [paper] [code]

Boosting Weakly-Supervised Referring Image Segmentation via Progressive Comprehension

Zaiquan Yang, Yuhao Liu, Jiaying Lin, Gerhard Hancke, Rynson W.H. Lau.
Thirty-Eighth Conference on Neural Information Processing Systems (NeurIPS), 2024.
[paper]

Effective Video Mirror Detection with Inconsistent Motion Cues

Alex Warren, Ke Xu, Jiaying Lin, Gary Tam, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
[project] [paper] [code]

Multi-view Dynamic Reflection Prior for Video Glass Surface Detection

Fang Liu, Yuhao Liu, Jiaying Lin#, Ke Xu, Rynson W.H. Lau.
Thirty-Eighth Conference AAAI Conference on Artificial Intelligence (AAAI), 2024.
[project] [paper] [code]

Self-supervised Pre-training for Mirror Detection

Jiaying Lin, Rynson W.H. Lau.
IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
[project] [paper] [code]

Learning to Detect Mirrors from Videos via Dual Correspondences

Jiaying Lin^*, Xin Tan^*, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
[project] [paper] [code]

Weakly-Supervised Camouflaged Object Detection with Scribble Annotations

Ruozhen He@^*, Qihua Dong@^*, Jiaying Lin#, Rynson W.H. Lau
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023. (Oral)
[project] [arxiv] [paper] [code and dataset]

Efficient Mirror Detection via Multi-level Heterogeneous Learning

Ruozhen He@, Jiaying Lin#, Rynson W.H. Lau
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023. (Oral)
[arxiv] [paper] [code]

Symmetry-Aware Transformer-based Mirror Detection

Tianyu Huang@, Bowen Dong, Jiaying Lin, Xiaohui Liu, Rynson W.H. Lau, Wangmeng Zuo
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023.
[arxiv] [code]

Exploiting Semantic Relations for Glass Surface Detection

Jiaying Lin^*, Yuen-Hei Yeung^*@, Rynson W.H. Lau.
Thirty-Sixth Conference on Neural Information Processing Systems (NeurIPS), 2022. (Spotlight)
[project] [paper] [code] [dataset]

Frequency-aware Camouflaged Object Detection

Jiaying Lin^*, Xin Tan^*, Ke Xu, Lizhuang Ma, Rynson W.H. Lau.
ACM Transactions on Multimedia Computing Communications and Applications (TOMM), 2022.
[paper] [results]

Mirror Detection with the Visual Chirality Cue

Xin Tan, Jiaying Lin, Ke Xu, Pan Chen, Lizhuang Ma, Rynson W.H. Lau.
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022.
[paper]

Learning Semantic Associations for Mirror Detection

Huankang Guan, Jiaying Lin, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[paper] [poster] [code]

Rich Context Aggregation with Reflection Prior for Glass Surface Detection

Jiaying Lin, Zebang He, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[project] [paper] [code] [dataset]

Progressive Mirror Detection

Jiaying Lin, Guodong Wang, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[project] [paper] [code] [dataset]

Coherence and Identity Learning for Arbitrary-length Face Video Generation

Shuquan Ye, Chu Han, Jiaying Lin, Guoqiang Han, Shengfeng He.
International Conference on Pattern Recognition (ICPR), 2020.
[paper]

An Estimation of Distribution Algorithm for Large-Scale Optimization with Cooperative Co-evolution and Local Search

Jiaying Lin, Wei-Neng Chen, Jun Zhang.
International Conference on Information Science and Technology (ICONIP), 2018.
[paper]

I also researched on operating system and computer architecture. It was lucky for me to work with the geniuses in these research groups.

• Research Assistant, supervised by Dr. Ming-Chang Yang
  Memory and Storage Systems Research Group
  The Chinese University of Hong Kong.
  Feb. 2019 - May 2019

• Research Assistant, supervised by Dr. Heming Cui
  Systems Software Group
  The University of Hong Kong
  Jun. 2018 - Nov. 2018

Journal Reviewer

• International Journal of Computer Vision (IJCV)
• IEEE Transactions on Image Processing (TIP)
• IEEE Transactions on Multimedia (TMM)
• IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)

Conference Reviewer / Program Committee

• CVPR 2022, ECCV 2022, AAAI 2023, CVPR 2023, ICCV 2023, NeurIPS 2023, AAAI 2024, CVPR 2024, ECCV 2024, AAAI 2025

Teaching Assistant at CityU

• Introduction to Computer Studies (CS1102)
  • Semester A 2019/20
• Virtual Reality (CS4188/CS5188)
  • Semester B 2019/20
  • Semester B 2020/21
  • Semester B 2021/22
• Multimedia Technologies and Applications (CS4185/CS5185)
  • Semester A 2021/22
  • Semester A 2022/23
• Machine Learning (CS4487)
  • Semester A 2020/21

Mentoring

Below is a non-exhaustive list for junior students I work(ed) with.

• Qianshi Pang (undergraduate student at SCUT)
• Huankang Guan (Ph.D. student at CityU)
• Ruozhen He (undergraduate student at CityU, now a Ph.D. student at Rice University)
• Zebang He (MSc student at CityU, now a Ph.D. student at PolyU)
• Yuen Hei Yeung (undergraduate student at CityU, won the Innovation and Technology Scholarship 2021 during his internship in our group [link])
• Tianyu Huang (undergraduate student at HIT, now a CityU-HIT Joint Ph.D. student)

• Ship name identification method, system, computer equipment and storage medium, CN111582182A

• Outstanding Reviewer, ECCV 2022.
• Research Tuition Scholarship, City University of Hong Kong, 2022 - 2023
• Postgraduate Studentship, City University of Hong Kong, 2019 - 2023
• Undergraduate Studentship, South China University of Technology, 2015 - 2019
• Elite Student Program, South China University of Technology (Top 0.4%), 2015 - 2019

CV & CG papers on Cats
Special thanks to Shuquan Ye.