1 code implementation • 13 Mar 2024 • Tiange Xiang, Yixiao Zhang, Yongyi Lu, Alan Yuille, Chaoyi Zhang, Weidong Cai, Zongwei Zhou
To this end, we propose a Simple Space-Aware Memory Matrix for In-painting and Detecting anomalies from radiography images (abbreviated as SimSID).
no code implementations • 29 Nov 2023 • Chaoyi Zhang, Kevin Lin, Zhengyuan Yang, JianFeng Wang, Linjie Li, Chung-Ching Lin, Zicheng Liu, Lijuan Wang
We present MM-Narrator, a novel system leveraging GPT-4 with multimodal in-context learning for the generation of audio descriptions (AD).
1 code implementation • 27 Jul 2023 • Zhiyuan Li, Dongnan Liu, Heng Wang, Chaoyi Zhang, Weidong Cai
We further show that with a simple extension, the generated pseudo sentences can be deployed as weak supervision to boost the 1% semi-supervised image caption benchmark up to 93. 4 CIDEr score (+8. 9) which showcases the versatility and effectiveness of our approach.
no code implementations • 18 Jul 2023 • Tengfei Xue, Yuqian Chen, Chaoyi Zhang, Alexandra J. Golby, Nikos Makris, Yogesh Rathi, Weidong Cai, Fan Zhang, Lauren J. O'Donnell
TractCloud achieves efficient and consistent whole-brain white matter parcellation across the lifespan (from neonates to elderly subjects, including brain tumor patients) without the need for registration.
no code implementations • 8 Jul 2023 • Yuqian Chen, Leo R. Zekelman, Chaoyi Zhang, Tengfei Xue, Yang song, Nikos Makris, Yogesh Rathi, Alexandra J. Golby, Weidong Cai, Fan Zhang, Lauren J. O'Donnell
We evaluate the effectiveness of the proposed method by predicting individual performance on two neuropsychological assessments of language using a dataset of 20 association white matter fiber tracts from 806 subjects from the Human Connectome Project.
no code implementations • 7 May 2023 • Xinwen Zhang, Chaoyi Zhang, Dongnan Liu, Qianbi Yu, Weidong Cai
The adversarial methods showed advanced performance by producing synthetic images to mitigate the domain shift, a common problem due to the hardship of acquiring labelled data in medical field.
1 code implementation • 6 Feb 2023 • Dingxin Zhang, Jianhui Yu, Chaoyi Zhang, Weidong Cai
To solve this problem, we propose a rotation-invariant geometric relation to restore the relative pose with equivariant information for patches defined over different scales.
no code implementations • 5 Jan 2023 • Yuqian Chen, Fan Zhang, Leo R. Zekelman, Tengfei Xue, Chaoyi Zhang, Yang song, Nikos Makris, Yogesh Rathi, Weidong Cai, Lauren J. O'Donnell
This work shows the potential of incorporating anatomical information, especially known anatomical similarities between input features, to guide convolutions in neural networks.
no code implementations • 31 Dec 2022 • Jianhui Yu, Chaoyi Zhang, Weidong Cai
Recent investigations on rotation invariance for 3D point clouds have been devoted to devising rotation-invariant feature descriptors or learning canonical spaces where objects are semantically aligned.
1 code implementation • 15 Oct 2022 • Runkai Zhao, Heng Wang, Chaoyi Zhang, Weidong Cai
In this paper, we propose a novel framework for 3D neuron reconstruction.
no code implementations • 13 Oct 2022 • Tengfei Xue, Fan Zhang, Leo R. Zekelman, Chaoyi Zhang, Yuqian Chen, Suheyla Cetin-Karayumak, Steve Pieper, William M. Wells, Yogesh Rathi, Nikos Makris, Weidong Cai, Lauren J. O'Donnell
We propose a novel deep regression method, namely TractoSCR, that allows full supervision for contrastive learning in regression tasks using diffusion MRI tractography.
no code implementations • 10 Oct 2022 • Qianbi Yu, Dongnan Liu, Chaoyi Zhang, Xinwen Zhang, Weidong Cai
To further facilitate the data efficiency of the cross-domain segmentation methods on the fundus images, we explore UDA optic disc and cup segmentation problems using few labeled source data in this work.
1 code implementation • 18 Jul 2022 • Tengfei Xue, Fan Zhang, Chaoyi Zhang, Yuqian Chen, Yang song, Alexandra J. Golby, Nikos Makris, Yogesh Rathi, Weidong Cai, Lauren J. O'Donnell
We propose a novel two-stage deep-learning-based framework, Superficial White Matter Analysis (SupWMA), that performs an efficient and consistent parcellation of 198 SWM clusters from whole-brain tractography.
no code implementations • 6 Jul 2022 • Yuqian Chen, Fan Zhang, Chaoyi Zhang, Tengfei Xue, Leo R. Zekelman, Jianzhong He, Yang song, Nikos Makris, Yogesh Rathi, Alexandra J. Golby, Weidong Cai, Lauren J. O'Donnell
In this paper, we propose a deep-learning-based framework for neuropsychological score prediction using microstructure measurements estimated from diffusion magnetic resonance imaging (dMRI) tractography, focusing on predicting performance on a receptive vocabulary assessment task based on a critical fiber tract for language, the arcuate fasciculus (AF).
no code implementations • 1 Jun 2022 • Shunqi Mao, Chaoyi Zhang, Heng Wang, Weidong Cai
In audio-visual navigation (AVN), an intelligent agent needs to navigate to a constantly sound-making object in complex 3D environments based on its audio and visual perceptions.
no code implementations • 7 May 2022 • Peizhou Huang, Chaoyi Zhang, Xiaoliang Zhang, Xiaojuan Li, Liang Dong, Leslie Ying
Experiment results demonstrate that the proposed method requires a reduced amount of training data to achieve high reconstruction quality among the state-of-art of MR reconstruction utilizing the Noise2Noise method.
1 code implementation • 2 May 2022 • Yuqian Chen, Chaoyi Zhang, Tengfei Xue, Yang song, Nikos Makris, Yogesh Rathi, Weidong Cai, Fan Zhang, Lauren J. O'Donnell
In this work, we propose a novel deep learning framework for white matter fiber clustering, Deep Fiber Clustering (DFC), which solves the unsupervised clustering problem as a self-supervised learning task with a domain-specific pretext task to predict pairwise fiber distances.
1 code implementation • 22 Apr 2022 • Heng Wang, Chaoyi Zhang, Jianhui Yu, Weidong Cai
Dense captioning in 3D point clouds is an emerging vision-and-language task involving object-level 3D scene understanding.
no code implementations • 11 Mar 2022 • Tiange Xiang, Chaoyi Zhang, Xinyi Wang, Yang song, Dongnan Liu, Heng Huang, Weidong Cai
With the backward skip connections, we propose a U-Net based network family, namely Bi-directional O-shape networks, which set new benchmarks on multiple public medical imaging segmentation datasets.
1 code implementation • 29 Jan 2022 • Tengfei Xue, Fan Zhang, Chaoyi Zhang, Yuqian Chen, Yang song, Nikos Makris, Yogesh Rathi, Weidong Cai, Lauren J. O'Donnell
Most parcellation methods focus on the deep white matter (DWM), while fewer methods address the superficial white matter (SWM) due to its complexity.
1 code implementation • 6 Jan 2022 • Dongnan Liu, Chaoyi Zhang, Yang song, Heng Huang, Chenyu Wang, Michael Barnett, Weidong Cai
Recent advances in unsupervised domain adaptation (UDA) techniques have witnessed great success in cross-domain computer vision tasks, enhancing the generalization ability of data-driven deep learning architectures by bridging the domain distribution gaps.
1 code implementation • 9 Dec 2021 • Jianhui Yu, Chaoyi Zhang, Heng Wang, Dingxin Zhang, Yang song, Tiange Xiang, Dongnan Liu, Weidong Cai
General point clouds have been increasingly investigated for different tasks, and recently Transformer-based networks are proposed for point cloud analysis.
Ranked #1 on 3D Point Cloud Classification on IntrA
2 code implementations • CVPR 2023 • Tiange Xiang, Yixiao Zhang, Yongyi Lu, Alan L. Yuille, Chaoyi Zhang, Weidong Cai, Zongwei Zhou
Radiography imaging protocols focus on particular body regions, therefore producing images of great similarity and yielding recurrent anatomical structures across patients.
no code implementations • 13 Sep 2021 • Tiange Xiang, Yang song, Chaoyi Zhang, Dongnan Liu, Mei Chen, Fan Zhang, Heng Huang, Lauren O'Donnell, Weidong Cai
With image-level labels only, patch-wise classification would be sub-optimal due to inconsistency between the patch appearance and image-level label.
no code implementations • 14 Aug 2021 • Heng Wang, Chaoyi Zhang, Jianhui Yu, Yang song, SiQi Liu, Wojciech Chrzanowski, Weidong Cai
Recently, a series of deep learning based segmentation methods have been proposed to improve the quality of raw 3D optical image stacks by removing noises and restoring neuronal structures from low-contrast background.
no code implementations • 11 Jul 2021 • Yuqian Chen, Chaoyi Zhang, Yang song, Nikos Makris, Yogesh Rathi, Weidong Cai, Fan Zhang, Lauren J. O'Donnell
White matter fiber clustering (WMFC) enables parcellation of white matter tractography for applications such as disease classification and anatomical tract segmentation.
1 code implementation • 26 Jun 2021 • Xinyi Wang, Tiange Xiang, Chaoyi Zhang, Yang song, Dongnan Liu, Heng Huang, Weidong Cai
We evaluate BiX-NAS on two segmentation tasks using three different medical image datasets, and the experimental results show that our BiX-NAS searched architecture achieves the state-of-the-art performance with significantly lower computational cost.
no code implementations • 3 Jun 2021 • Tiange Xiang, Chaoyi Zhang, Yang song, SiQi Liu, Hongliang Yuan, Weidong Cai
This add-on graph regularizes the network during training and can be completely skipped during inference.
2 code implementations • ICCV 2021 • Tiange Xiang, Chaoyi Zhang, Yang song, Jianhui Yu, Weidong Cai
Discrete point cloud objects lack sufficient shape descriptors of 3D geometries.
Ranked #10 on 3D Part Segmentation on ShapeNet-Part
no code implementations • 20 Apr 2021 • Yang Ma, Chaoyi Zhang, Mariano Cabezas, Yang song, Zihao Tang, Dongnan Liu, Weidong Cai, Michael Barnett, Chenyu Wang
Further, we review technical strategies, such as domain adaptation, to enhance MS lesion segmentation in real-world clinical settings.
1 code implementation • CVPR 2021 • Chaoyi Zhang, Jianhui Yu, Yang song, Weidong Cai
Scene understanding is a critical problem in computer vision.
Ranked #4 on 3d scene graph generation on 3DSSG
1 code implementation • 20 Feb 2021 • Yuqian Chen, Yang song, Chaoyi Zhang, Fan Zhang, Lauren O'Donnell, Wojciech Chrzanowski, Weidong Cai
Cell segmentation and tracking in microscopy images are of great significance to new discoveries in biology and medicine.
no code implementations • 22 Jan 2021 • Heng Wang, Yang song, Chaoyi Zhang, Jianhui Yu, SiQi Liu, Hanchuan Peng, Weidong Cai
One of the critical steps in improving accurate single neuron reconstruction from three-dimensional (3D) optical microscope images is the neuronal structure segmentation.
1 code implementation • 1 Jul 2020 • Tiange Xiang, Chaoyi Zhang, Dongnan Liu, Yang song, Heng Huang, Weidong Cai
U-Net has become one of the state-of-the-art deep learning-based approaches for modern computer vision tasks such as semantic segmentation, super resolution, image denoising, and inpainting.
1 code implementation • 9 May 2020 • Jianhui Yu, Chaoyi Zhang, Yang song, Weidong Cai
Micro-expressions are reflections of people's true feelings and motives, which attract an increasing number of researchers into the study of automatic facial micro-expression recognition.
Generative Adversarial Network Micro Expression Recognition +1
no code implementations • 20 Apr 2020 • Chaoyi Zhang, Yang song, Lina Yao, Weidong Cai
Point cloud is a principal data structure adopted for 3D geometric information encoding.
no code implementations • 3 Feb 2020 • Hongyu Li, Zifei Liang, Chaoyi Zhang, Ruiying Liu, Jing Li, Weihong Zhang, Dong Liang, Bowen Shen, Xiaoliang Zhang, Yulin Ge, Jiangyang Zhang, Leslie Ying
We also demonstrate that the trained neural network is robust to noise and motion in the testing data, and the network trained using healthy volunteer data can be directly applied to stroke patient data without compromising the lesion detectability.
1 code implementation • International Joint Conference on Artificial Intelligence (IJCAI-19) 2019 • Dongnan Liu, Donghao Zhang, Yang song, Chaoyi Zhang, Fan Zhang, Lauren O’Donnell, Weidong Cai
Automated detection and segmentation of individual nuclei in histopathology images is important for cancer diagnosis and prognosis.