I am currently a Research Fellow at City University of Hong Kong. I obtained my Ph.D. degree in Computer Science from City University of Hong Kong, under the supervision of Prof. Rynson W.H. Lau in 2023. Prior to that, I received my B.Eng. degree in Computer Science and Engineering (Elite Program) from South China University of Technology in 2019.

I have been working on interesting problems in deep learning, computer vision, and computer graphics.

[Aug. 2024] I am actively seeking job opportunities. Feel free to reach out to me!

[Dec. 2024] Two papers are accepted to AAAI 2025.
[Sept. 2024] A paper is accepted to NeurIPS 2024.
[Aug. 2024] We construct OpenScan, a new benchmark for generalized 3D open-vocabulary 3D scene understanding.
[Mar. 2024] A paper is accepted to CVPR 2024.
[Oct. 2023] A paper is accepted to AAAI 2024.
[Jul. 2023] A paper on self-supervised learning is accepted to ICCV 2023.
[May 2023] I pass my Ph.D. thesis defense!
[Mar. 2023] A paper is accepted to CVPR 2023.
[Nov. 2022] Three papers are accepted to AAAI 2023, including two selected for oral presentations, for which I served as corresponding author.
[Oct. 2022] Grateful to be recognized as an Outstanding Reviewer for ECCV 2022.

Do Multimodal Large Language Models See Like Humans?

Jiaying Lin^*, Shuquan Ye^*, Rynson W.H. Lau.
Arxiv, 2024.
[project] [arxiv]

OpenScan: A Benchmark for Generalized Open-Vocabulary 3D Scene Understanding

Youjun Zhao, Jiaying Lin, Shuquan Ye, Qianshi Pang, Rynson W.H. Lau.
Arxiv, Aug 2024.
[arxiv] [code and data] [Zhihu (in Chinese)]

Rethinking Video Salient Object Ranking

Jiaying Lin, Huankang Guan, Rynson W.H. Lau.
Arxiv, 2022.
[arxiv]

Leveraging RGB-D Data with Cross-Modal Context Mining for Glass Surface Detection

Jiaying Lin^*, Yuen-Hei Yeung^*, Shuquan Ye, Rynson W.H. Lau.
Thirty-Ninth Conference AAAI Conference on Artificial Intelligence (AAAI), 2025.
[project] [arxiv] [paper] [code]

Hierarchical Cross-Modal Alignment for Open-Vocabulary 3D Object Detection

Youjun Zhao^*, Jiaying Lin^*, Rynson W.H. Lau.
Thirty-Ninth Conference AAAI Conference on Artificial Intelligence (AAAI), 2025.
[project] [paper] [code]

Boosting Weakly-Supervised Referring Image Segmentation via Progressive Comprehension

Zaiquan Yang, Yuhao Liu, Jiaying Lin, Gerhard Hancke, Rynson W.H. Lau.
Thirty-Eighth Conference on Neural Information Processing Systems (NeurIPS), 2024.
[paper]

Effective Video Mirror Detection with Inconsistent Motion Cues

Alex Warren, Ke Xu, Jiaying Lin, Gary Tam, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
[project] [paper] [code]

Multi-view Dynamic Reflection Prior for Video Glass Surface Detection

Fang Liu, Yuhao Liu, Jiaying Lin#, Ke Xu, Rynson W.H. Lau.
Thirty-Eighth Conference AAAI Conference on Artificial Intelligence (AAAI), 2024.
[project] [paper] [code]

Self-supervised Pre-training for Mirror Detection

Jiaying Lin, Rynson W.H. Lau.
IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
[project] [paper] [code]

Learning to Detect Mirrors from Videos via Dual Correspondences

Jiaying Lin^*, Xin Tan^*, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
[project] [paper] [code]

Weakly-Supervised Camouflaged Object Detection with Scribble Annotations

Ruozhen He@^*, Qihua Dong@^*, Jiaying Lin#, Rynson W.H. Lau
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023. (Oral)
[project] [arxiv] [paper] [code and dataset]

Efficient Mirror Detection via Multi-level Heterogeneous Learning

Ruozhen He@, Jiaying Lin#, Rynson W.H. Lau
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023. (Oral)
[arxiv] [paper] [code]

Symmetry-Aware Transformer-based Mirror Detection

Tianyu Huang@, Bowen Dong, Jiaying Lin, Xiaohui Liu, Rynson W.H. Lau, Wangmeng Zuo
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023.
[arxiv] [code]

Exploiting Semantic Relations for Glass Surface Detection

Jiaying Lin^*, Yuen-Hei Yeung^*@, Rynson W.H. Lau.
Thirty-Sixth Conference on Neural Information Processing Systems (NeurIPS), 2022. (Spotlight)
[project] [paper] [code] [dataset]

Frequency-aware Camouflaged Object Detection

Jiaying Lin^*, Xin Tan^*, Ke Xu, Lizhuang Ma, Rynson W.H. Lau.
ACM Transactions on Multimedia Computing Communications and Applications (TOMM), 2022.
[paper] [results]

Mirror Detection with the Visual Chirality Cue

Xin Tan, Jiaying Lin, Ke Xu, Pan Chen, Lizhuang Ma, Rynson W.H. Lau.
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022.
[paper]

Learning Semantic Associations for Mirror Detection

Huankang Guan, Jiaying Lin, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[paper] [poster] [code]

Rich Context Aggregation with Reflection Prior for Glass Surface Detection

Jiaying Lin, Zebang He, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[project] [paper] [code] [dataset]

Progressive Mirror Detection

Jiaying Lin, Guodong Wang, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[project] [paper] [code] [dataset]

Coherence and Identity Learning for Arbitrary-length Face Video Generation

Shuquan Ye, Chu Han, Jiaying Lin, Guoqiang Han, Shengfeng He.
International Conference on Pattern Recognition (ICPR), 2020.
[paper]

An Estimation of Distribution Algorithm for Large-Scale Optimization with Cooperative Co-evolution and Local Search

Jiaying Lin, Wei-Neng Chen, Jun Zhang.
International Conference on Information Science and Technology (ICONIP), 2018.
[paper]

I also researched on operating system and computer architecture. It was lucky for me to work with the geniuses in these research groups.

• Research Assistant, supervised by Dr. Ming-Chang Yang
  Memory and Storage Systems Research Group
  The Chinese University of Hong Kong.
  Feb. 2019 - May 2019

• Research Assistant, supervised by Dr. Heming Cui
  Systems Software Group
  The University of Hong Kong
  Jun. 2018 - Nov. 2018

Journal Reviewer

• International Journal of Computer Vision (IJCV)
• IEEE Transactions on Image Processing (TIP)
• IEEE Transactions on Multimedia (TMM)
• IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)

Conference Reviewer / Program Committee

• CVPR 2022, ECCV 2022, AAAI 2023, CVPR 2023, ICCV 2023, NeurIPS 2023, AAAI 2024, CVPR 2024, ECCV 2024, AAAI 2025

Teaching Assistant at CityU

• Introduction to Computer Studies (CS1102)
  • Semester A 2019/20
• Virtual Reality (CS4188/CS5188)
  • Semester B 2019/20
  • Semester B 2020/21
  • Semester B 2021/22
• Multimedia Technologies and Applications (CS4185/CS5185)
  • Semester A 2021/22
  • Semester A 2022/23
• Machine Learning (CS4487)
  • Semester A 2020/21

Mentoring

Below is a non-exhaustive list for junior students I work(ed) with.

• Qianshi Pang (undergraduate student at SCUT)
• Huankang Guan (Ph.D. student at CityU)
• Ruozhen He (undergraduate student at CityU, now a Ph.D. student at Rice University)
• Zebang He (MSc student at CityU, now a Ph.D. student at PolyU)
• Yuen Hei Yeung (undergraduate student at CityU, won the Innovation and Technology Scholarship 2021 during his internship in our group [link])
• Tianyu Huang (undergraduate student at HIT, now a CityU-HIT Joint Ph.D. student)

• Ship name identification method, system, computer equipment and storage medium, CN111582182A

• Outstanding Reviewer, ECCV 2022.
• Research Tuition Scholarship, City University of Hong Kong, 2022 - 2023
• Postgraduate Studentship, City University of Hong Kong, 2019 - 2023
• Undergraduate Studentship, South China University of Technology, 2015 - 2019
• Elite Student Program, South China University of Technology (Top 0.4%), 2015 - 2019

CV & CG papers on Cats
Special thanks to Shuquan Ye.