Biography

I’m currently a Ph.D. candidate in Computer Science at City University of Hong Kong (CityU) supervised by Prof. Rynson W.H. Lau. I have been working on new, practical, and essential problems in deep learning, computer vision, and computer graphics. My recent research focus mainly lies in:

  • Multimodal learning for image, video and 3D vision.
  • Prompt tuning from visual data
  • 3D vision with weak/imperfect data
  • Detecting inconspicuous objects (e.g., mirror, glass, and camouflaged objects) for robust vision applications.

I am always open to collaborations! Please don’t hesitate to drop me an email if you are interested.

Education

  • 09/2019 - Present: PhD candidate, Department of Computer Science, City University of Hong Kong
  • 09/2015 - 07/2019: Computer Science and Technology (Elite Class), South China University of Technology

    News

[Nov. 2022] Shuquan constructed the first human-annotated 3D question answering dataset a year ago and now the corresponding paper is finally accepted to TVCG! We believe this ground-breaking work can largely facilitate machine perception of 3D real-world scenarios. [link]
[Nov. 2022] Three papers are accepted to AAAI 2023. Stay tuned for more details.
[Nov. 2022] My first academic collaborator Shuquan gets her first TPAMI paper, which describes the first framework to empower the point cloud segmentation model with resistance to annotation noise. Congratulations! [link]
[Oct. 2022] I will serve as a reviewer for CVPR 2023.
[Oct. 2022] Grateful to be recognized as an Outstanding Reviewer for ECCV 2022.
[Sept. 2022] A paper is accepted to NeurIPS 2022.
[Aug. 2022] I will serve as a reviewer for AAAI 2023.
[June 2022] A paper is accepted to TOMM.
[June 2022] A paper is accepted to TPAMI.
[Mar. 2022] A paper is accepted to CVPR 2022.
[Feb. 2022] I will serve as a reviewer for ECCV 2022.
[Oct. 2021] I will serve as a reviewer for CVPR 2022.
[July 2021] Yuen Hei (one of the CityU undergraduate students I mentor) won the Innovation and Technology Scholarship 2021. Congrats, Yuen Hei! [link]
[Mar. 2021] A paper is accepted to CVPR 2021.
[June 2020] A paper is accepted to ICPR 2020.
[Mar. 2020] A paper is accepted to CVPR 2020.

    Preprints

Depth-aware Glass Surface Detection with Cross-modal Context Mining

Jiaying Lin*, Yuen-Hei Yeung*@, Rynson W.H. Lau.
Arxiv, 2022.
[arxiv]

Rethinking Video Salient Object Ranking

Jiaying Lin, Huankang Guan, Rynson W.H. Lau.
Arxiv, 2022.
[arxiv]

    Selected Publications [All]

    (* indicates equal contribution, # indicates corresponding author, @ indicates undergraduate student I mentored.)

Weakly-Supervised Camouflaged Object Detection with Scribble Annotations

Ruozhen He@*, Qihua Dong@*, Jiaying Lin#, Rynson W.H. Lau
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023.
[project] [arxiv] [paper] [code] [dataset]

Efficient Mirror Detection via Multi-level Heterogeneous Learning

Ruozhen He@, Jiaying Lin#, Rynson W.H. Lau
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023.
[paper] [code]

Symmetry-Aware Transformer-based Mirror Detection

Tianyu Huang@, Bowen Dong, Jiaying Lin, Xiaohui Liu, Rynson W.H. Lau, Wangmeng Zuo
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023.
[arxiv] [code]

Exploiting Semantic Relations for Glass Surface Detection

Jiaying Lin*, Yuen-Hei Yeung*@, Rynson W.H. Lau.
Thirty-Sixth Conference on Neural Information Processing Systems (NeurIPS), 2022.
[project] [paper] [code] [dataset]

Frequency-aware Camouflaged Object Detection

Jiaying Lin*, Xin Tan*, Ke Xu, Lizhuang Ma, Rynson W.H. Lau.
ACM Transactions on Multimedia Computing Communications and Applications (TOMM), 2022.
[paper] [results]

Mirror Detection with the Visual Chirality Cue

Xin Tan, Jiaying Lin, Ke Xu, Pan Chen, Lizhuang Ma, Rynson W.H. Lau.
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022.
[paper]

Learning Semantic Associations for Mirror Detection

Huankang Guan, Jiaying Lin, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[paper] [poster] [code]

Rich Context Aggregation with Reflection Prior for Glass Surface Detection

Jiaying Lin, Zebang He, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[project] [paper] [code] [dataset]

Progressive Mirror Detection

Jiaying Lin, Guodong Wang, Rynson W.H. Lau.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[project] [paper] [code] [dataset]

Coherence and Identity Learning for Arbitrary-length Face Video Generation

Shuquan Ye, Chu Han, Jiaying Lin, Guoqiang Han, Shengfeng He.
International Conference on Pattern Recognition (ICPR), 2020.
[paper]

An Estimation of Distribution Algorithm for Large-Scale Optimization with Cooperative Co-evolution and Local Search

Jiaying Lin, Wei-Neng Chen, Jun Zhang.
International Conference on Information Science and Technology (ICONIP), 2018.
[paper]

    Experiences

I also researched on operating system and computer architecture. It was lucky for me to work with the geniuses in these research groups.

  • Research Assistant, supervised by Dr. Ming-Chang Yang
    Memory and Storage Systems Research Group
    The Chinese University of Hong Kong.
    Feb. 2019 - May 2019

  • Research Assistant, supervised by Dr. Heming Cui
    Systems Software Group
    The University of Hong Kong
    Jun. 2018 - Nov. 2018

    Activities

Journal Reviewer

  • International Journal of Computer Vision (IJCV)
  • IEEE Transactions on Image Processing (TIP)
  • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)

Conference Reviewer / Program Committee

  • CVPR 2022, ECCV 2022, AAAI 2023

    Teaching and Collaborators

Teaching Assistant at CityU

  • Introduction to Computer Studies (CS1102)
    • Semester A 2019/20
  • Virtual Reality (CS4188/CS5188)
    • Semester B 2019/20
    • Semester B 2020/21
    • Semester B 2021/22
  • Multimedia Technologies and Applications (CS4185/CS5185)
    • Semester A 2021/22
    • Semester A 2022/23
  • Machine Learning (CS4487)
    • Semester A 2020/21

Junior students I work(ed) with

  • Huankang Guan (Ph.D. student at CityU)
  • Ruozhen He (undergraduate student at CityU)

  • Zebang He (MSc student at CityU, now Ph.D. student at PolyU)
  • Yuen Hei Yeung (undergraduate student at CityU, now at UIUC)
  • Tianyu Huang (undergraduate student at HIT, now CityU-HIT Joint Ph.D. student)

    Patents

    Honors & Awards

  • Outstanding Reviewer, ECCV 2022.
  • Research Tuition Scholarship, City University of Hong Kong, 2022 - 2023
  • Postgraduate Studentship, City University of Hong Kong, 2019 - 2023
  • Undergraduate Studentship, South China University of Technology, 2015 - 2019
  • Elite Student Program, South China University of Technology (Top 0.4%), 2015 - 2019

    Misc