Ruian He | 何瑞安

I am a 3rd-year PhD student in School of Computer Science at Fudan University, supervised by Prof. Bo Yan. Before that, I received my Bachelor's degree of Computer Science at Fudan University in 2021.

My research interests lie in the field of video synthesis, low-level vision and postprocessing of rendering.

Email: rahe16 (at) fudan.edu.cn.

CV  /  Google Scholar  /  Semantic Scholar  /  DBLP  /  Github  /  Zhihu  /  Bilibili

profile photo
News
  • [April 2024] One paper has been published in Nature Methods.
Publications

(*: Equal contribution)

clean-usnob
Pre-training a Foundation Model for Generalizable Fluorescence Microscopy-Based Image Restoration
Chenxi Ma*, Weimin Tan*, Ruian He, Bo Yan
Nature Methods, 2024

We provide a universal fluorescence microscopy-based image restoration (UniFMIR) model to address different restoration problems, and show that UniFMIR offers higher image restoration precision, better generalization and increased versatility.

clean-usnob
Low-latency Space-time Supersampling for Real-time Rendering
Ruian He*, Shili Zhou*, Yuqi Sun, Ri Cheng, Weimin Tan , Bo Yan
AAAI, 2024

We recognize the shared context and mechanisms between frame supersampling and extrapolation, save up to 75% of time against the conventional two-stage pipeline that necessitates 17ms.

clean-usnob
SAMFlow: Eliminating Any Fragmentation in Optical Flow with Segment Anything Model
Shili Zhou, Ruian He, Weimin Tan , Bo Yan
AAAI, 2024

Through theoretical analysis, we find the pre-trained large vision models are helpful in optical flow estimation, and SAM is suitable for solving the fragmentation problem.

clean-usnob
Context-Aware Iteration Policy Network for Efficient Optical Flow Estimation
Ri Cheng, Ruian He, Xuhao Jiang, Shili Zhou, Weimin Tan , Bo Yan
AAAI, 2024

We develop a Context-Aware Iteration Policy Network, which determines the optimal number of iterations per sample and reduce FLOPs by about 40%/20% for the Sintel/KITTI datasets.

clean-usnob
Uncertainty-Guided Spatial Pruning Architecture for Efficient Frame Interpolation
Ri Cheng , Xuhao Jiang , Ruian He, Shili Zhou , Weimin Tan , Bo Yan
ACMMM, 2023

We develop an Uncertainty-Guided Spatial Pruning (UGSP) architecture to skip redundant computation for efficient frame interpolation dynamically.

clean-usnob
MVFlow: Deep Optical Flow Estimation of Compressed Videos with Motion Vector Prior
Shili Zhou*, Xuhao Jiang*, Weimin Tan, Ruian He, Bo Yan
ACMMM, 2023

We propose an optical flow model, MVFlow, which uses motion vectors to improve the speed and accuracy of optical flow estimation for compressed videos.

clean-usnob
Motion Matters: Difference-based Multi-scale Learning for Infrared UAV Detection
Ruian He, Shili Zhou, Ri Cheng, Yuqi Sun, Weimin Tan, Bo Yan
The 3nd Anti-UAV Workshop & Challenge - CVPR Workshops, 2023

Our method utilizes the frame difference of multiple previous frames and fuse multiple spatial-temporal scales.

clean-usnob
Fine-grained Blind Face Inpainting with 3D Face Component Disentanglement
Yu Bai, Ruian He, Weimin Tan, Bo Yan, Yangle Lin
ICASSP, 2023

We propose a novel fine-grained blind face inpainting framework and build up a new dataset called CelebO-3D.

clean-usnob
Co-completion for occluded facial expression recognition
Zhen Xing*, Weimin Tan*, Ruian He, Yangle Lin, Bo Yan
ACMMM, 2022

We propose a task-specific framework which first combines occlusion discarding and feature completion together to reduce the interference of occlusions on instance level.

Academic Service

Conference Reviewer / Program Committee Member for AAAI (2023, 2024), CVPR (2022, 2024), ICCV (2023), ECCV (2024), IEEEVR (2023), ACMMM (2024).

Journal Reviewer for TCSVT (2024).

Competition Prizes
Awards and Scholarships
  • Award for Outstanding Ph.D. Students. 2021, 2022, 2023.
  • Boxue Scholarship (Top 10%). 2017.
  • Award for Outstanding Undergraduate Students. 2018, 2019, 2020.



Updated at April 2024.