Vision and System Design Lab

Publications

Here are some research papers published by our group in the past years. You can filter and search for the content through relevant tags.

computer vision medical image LLM tiny ML hardware accelerator compute-in-memory co-design eda

2024

A 28nm 0.22μJ/Token Memory-Compute-Intensity-Aware CNN-Transformer Accelerator with Hybrid-Attention-Based Layer-Fusion and Cascaded Pruning for Semantic-Segmentation
A 28nm 0.22μJ/Token Memory-Compute-Intensity-Aware CNN-Transformer Accelerator with Hybrid-Attention-Based Layer-Fusion and Cascaded Pruning for Semantic-Segmentation
Pingcheng Dong, Yonghao Tan, Xuejiao Liu, Peng Luo, Yu Liu, Luhong Liang, Yitong Zhou, Di Pang, Manto Yung, Dong Zhang, Xijie Huang, Shih-Yang Liu, Yongkun Wu, Fengshi Tian, Chi-Ying Tsui, Fengbin Tu, Kwang-Ting Cheng
IEEE International Solid-State Circuits Conference (ISSCC), 2025.
hardware accelerator computer vision co-design
RoLoRA: Finetuning Outlier-free Model with Rotation for Weight-Activation Quantization
RoLoRA: Finetuning Outlier-free Model with Rotation for Weight-Activation Quantization
Xijie Huang, Zechun Liu, Shih-Yang Liu, Kwang-Ting Cheng
Empirical Methods in Natural Language Processing (EMNLP), 2024.
tiny ML LLM
Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
Empirical Methods in Natural Language Processing (EMNLP), 2024.
tiny ML LLM
Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precision
Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precision
Xijie Huang, Zhiqiang Shen, Pingcheng Dong, Kwang-Ting Cheng
Transactions on Machine Learning Research (TMLR), 2024.
tiny ML computer vision
Robust and Efficient Quantization-aware Training via Coreset Selection
Robust and Efficient Quantization-aware Training via Coreset Selection
Xijie Huang, Zechun Liu, Shih-Yang Liu, Kwang-Ting Cheng
Transactions on Machine Learning Research (TMLR), 2024.
tiny ML computer vision
Labeled-to-Unlabeled Distribution Alignment for Partially-Supervised Multi-Organ Medical Image Segmentation
Labeled-to-Unlabeled Distribution Alignment for Partially-Supervised Multi-Organ Medical Image Segmentation
Xixi Jiang, Dong Zhang, Xiang Li, Kangyi Liu, Kwang-Ting Cheng, Xin Yang
Medical Image Analysis, 2024.
computer vision medical image
Vessel-Promoted OCT to OCTA Image Translation by Heuristic Contextual Constraints
Vessel-Promoted OCT to OCTA Image Translation by Heuristic Contextual Constraints
Shuhan Li, Dong Zhang, Xiaomeng Li, Chubin Ou, Lin An, Yanwu Xu, Weihua Yang, Yanchun Zhang, Kwang-Ting Cheng.
Medical Image Analysis, 2024.
computer vision medical image
Iterative Online Image Synthesis via Diffusion Model for Imbalanced Classification
Iterative Online Image Synthesis via Diffusion Model for Imbalanced Classification
Shuhan Li, Yi Lin, Hao Chen, Kwang-Ting Cheng
Medical Image Computing and Computer Assisted Intervention (MICCAI), 2024
computer vision medical image
Rethinking Autoencoders for Medical Anomaly Detection from A Theoretical Perspective
Aligning Medical Images with General Knowledge from Large Language Models
Yu Cai, Hao Chen, Kwang-Ting Cheng
Medical Image Computing and Computer Assisted Intervention (MICCAI), 2024
computer vision medical image
Aligning Medical Images with General Knowledge from Large Language Models
Aligning Medical Images with General Knowledge from Large Language Models
Xiao Fang, Yi Lin, Dong Zhang, Kwang-Ting Cheng, and Hao Chen
Medical Image Computing and Computer Assisted Intervention (MICCAI), 2024
computer vision medical image
LE-NAS: Learning-based Ensemble with NAS for Dose Prediction
LE-NAS: Learning-based Ensemble with NAS for Dose Prediction
Yi Lin, Yanfei Liu, Hao Chen, Xin Yang, Kai Ma, Yefeng Zheng, Kwang-Ting Cheng
IEEE Transactions on Cybernetics
computer vision medical image
BoNuS: Boundary Mining for Nuclei Segmentation with Partial Point Labels
BoNuS: Boundary Mining for Nuclei Segmentation with Partial Point Labels
Yi Lin, Zeyu Wang, Dong Zhang, Kwang-Ting Cheng, Hao Chen
IEEE Transactions on Medical Imaging (TMI)
computer vision medical image
DoRA: Weight-Decomposed Low-Rank Adaptation
DoRA: Weight-Decomposed Low-Rank Adaptation
Shih-Yang Liu, Chien-Yi Wang, Hongxu Yin, Pavlo Molchanov, Yu-Chiang Frank Wang, Kwang-Ting Cheng, Min-Hung Chen
Proceedings of the 41th International Conference on Machine Learning (ICML), 2024
tiny ML LLM
Genetic Quantization-Aware Approximation for Non-Linear Operations in Transformers
Genetic Quantization-Aware Approximation for Non-Linear Operations in Transformers
Pingcheng Dong, Yonghao Tan, Dong Zhang, Tianwei Ni, Xuejiao Liu, Yu Liu, Peng Luo, Luhong Liang, Shih-Yang Liu, Xijie Huang, Huaiyu Zhu, Yun Pan, Fengwei An, Kwang-Ting Cheng
2024 61st ACM/IEEE Design Automation Conference (DAC)
tiny ML eda co-design
AdaP-CIM: Compute-in-Memory Based Neural Network Accelerator using Adaptive Posit
AdaP-CIM: Compute-in-Memory Based Neural Network Accelerator using Adaptive Posit
Jingyu He, Fengbin Tu, Kwang-Ting Cheng, Chi-Ying Tsui
2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)
hardware accelerator compute-in-memory

2023

Nuclei segmentation with point annotations from pathology images via self-supervised learning and co-training
Nuclei segmentation with point annotations from pathology images via self-supervised learning and co-training
Yi Lin, Zhiyong Qu, Hao Chen, Zhongke Gao, Yuexiang Li, Lili Xia, Kai Ma, Yefeng Zheng, Kwang-Ting Cheng
Medical Image Analysis (MEDIA), 2023
computer vision medical image
Dual-distribution discrepancy with self-supervised refinement for anomaly detection in medical images
Dual-distribution discrepancy with self-supervised refinement for anomaly detection in medical images
Yu Cai, Hao Chen, Xin Yang, Yu Zhou, Kwang-Ting Cheng
Medical Image Analysis (MEDIA), 2023
computer vision medical image
Compete to Win: Enhancing Pseudo Labels for Barely-supervised Medical Image Segmentation
Compete to Win: Enhancing Pseudo Labels for Barely-supervised Medical Image Segmentation
Huimin Wu, Xiaomeng Li, Yiqun Lin, Kwang-Ting Cheng
IEEE Transactions on Medical Imaging (TMI), 2023
computer vision medical image
FedMix: Mixed Supervised Federated Learning for Medical Image Segmentation
FedMix: Mixed Supervised Federated Learning for Medical Image Segmentation
Jeffry Wicaksana, Zengqiang Yan, Dong Zhang, Xijie Huang, Huimin Wu, Xin Yang, Kwang-Ting Cheng
IEEE Transactions on Medical Imaging (TMI), 2023
computer vision medical image
The Lighter The Better: Rethinking Transformers in Medical Image Segmentation Through Adaptive Pruning
The Lighter The Better: Rethinking Transformers in Medical Image Segmentation Through Adaptive Pruning
Xian Lin, Li Yu, Kwang-Ting Cheng, Zengqiang Yan
IEEE Transactions on Medical Imaging (TMI), 2023
computer vision medical image
Few Shot Medical Image Segmentation with Cross Attention Transformer
Few Shot Medical Image Segmentation with Cross Attention Transformer
Yi Lin, Yufan Chen, Kwang-Ting Cheng, Hao Chen
Medical Image Computing and Computer Assisted Intervention (MICCAI), 2023
computer vision medical image
Radiomics-Informed Deep Learning for Classification of Atrial Fibrillation Sub-Types from Left-Atrium CT Volumes
Radiomics-Informed Deep Learning for Classification of Atrial Fibrillation Sub-Types from Left-Atrium CT Volumes
Weihang Dai, Xiaomeng Li, Taihui Yu, Di Zhao, Jun Shen, Kwang-Ting Cheng
Medical Image Computing and Computer Assisted Intervention (MICCAI), 2023
computer vision medical image
Rethinking Boundary Detection in Deep Learning Models for Medical Image Segmentation
Rethinking Boundary Detection in Deep Learning Models for Medical Image Segmentation
Yi Lin, Dong Zhang, Xiao Fang, Yufan Chen, Kwang-Ting Cheng, Hao Chen
Information Processing in Medical Imaging (IPMI), 2023
computer vision medical image
Dynamic Sub-Cluster-Aware Network for Few-Shot Skin Disease Classification
Dynamic Sub-Cluster-Aware Network for Few-Shot Skin Disease Classification
Shuhan LI, Xiaomeng Li, Xiaowei Xu, Kwang-Ting Cheng
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2023
computer vision medical image
Exploring feature representation learning for semi-supervised medical image segmentation
Exploring feature representation learning for semi-supervised medical image segmentation
Huimin Wu, Xiaomeng Li, Kwang-Ting Cheng
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2023
computer vision medical image
Semi-Supervised Contrastive Learning for Deep Regression with Ordinal Rankings from Spectral Seriation
Semi-Supervised Contrastive Learning for Deep Regression with Ordinal Rankings from Spectral Seriation
Weihang Dai, Yao Du, Hanru Bai, Kwang-Ting Cheng, Xiaomeng Li
37th Conference on Neural Information Processing Systems (NeurIPS), 2023
computer vision medical image
CAE-GReaT: Convolutional-Auxiliary Efficient Graph Reasoning Transformer for Dense Image Predictions
CAE-GReaT: Convolutional-Auxiliary Efficient Graph Reasoning Transformer for Dense Image Predictions
Dong Zhang, Yi Lin, Jinhui Tang, Kwang-Ting Cheng
International Journal of Computer Vision (IJCV), 2023
computer vision
LLM-FP4: 4-Bit Floating-Point Quantized Transformers
LLM-FP4: 4-Bit Floating-Point Quantized Transformers
Shih-yang Liu, Zechun Liu, Xijie Huang, Pingcheng Dong, Kwang-Ting Cheng
The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP)
LLM tiny ML
Oscillation-free quantization for low-bit vision transformers
Oscillation-free quantization for low-bit vision transformers
Shih-Yang Liu, Zechun Liu, Kwang-Ting Cheng
International Conference on Machine Learning (ICML), 2023
computer vision tiny ML
Architecting Efficient Multi-modal AIoT Systems
Architecting Efficient Multi-modal AIoT Systems
Xiaofeng Hou, Jiacheng Liu, Xuehan Tang, Chao Li, Jia Chen, Luhong Liang, Kwang-Ting Cheng, Minyi Guo
Proceedings of the 50th Annual International Symposium on Computer Architecture (ISCA), 2023
hardware accelerator co-design
MMExit: Enabling Fast and Efficient Multi-modal DNN Inference with Adaptive Network Exits
MMExit: Enabling Fast and Efficient Multi-modal DNN Inference with Adaptive Network Exits
Xiaofeng Hou, Jiacheng Liu, Xuehan Tang, Chao Li, Kwang-Ting Cheng, Li Li, and Minyi Guo
The 29th International European Conference on Parallel and Distributed Computing, 2023
hardware accelerator co-design
AutoDCIM: An Automated Digital CIM Compiler
AutoDCIM: An Automated Digital CIM Compiler
Jia Chen, Fengbin Tu, Kunming Shao, Fengshi Tian, Xiao Huo, Chi-Ying Tsui, Kwang-Ting Cheng
2023 60th ACM/IEEE Design Automation Conference (DAC)
eda compute-in-memory
RVComp: Analog Variation Compensation for RRAM-based In-Memory Computing
RVComp: Analog Variation Compensation for RRAM-based In-Memory Computing
Jingyu He, Yucong Huang, Miguel Lastras, Tao Ye, Chi-Ying Tsui, Kwang-Ting Cheng
2023 28th Asia and South Pacific Design Automation Conference (ASP-DAC)
hardware accelerator compute-in-memory
A 1920×1080 129fps 4.3pJ/pixel Stereo-Matching Processor for Pico Aerial Vehicles
A 1920×1080 129fps 4.3pJ/pixel Stereo-Matching Processor for Pico Aerial Vehicles
Pingcheng Dong, Zhuoyu Chen, Ke Li, Lei Chen, Kwang-Ting Cheng, Fengwei An
2023 IEEE European Solid-State Circuits Conference (ESSCIRC)
hardware accelerator co-design
BIOS: A 40nm Bionic Sensor-defined 0.47pJ/SOP, 268.7TSOPs/W Configurable Spiking Neuron-in-Memory Processor for Wearable Healthcare
BIOS: A 40nm Bionic Sensor-defined 0.47pJ/SOP, 268.7TSOPs/W Configurable Spiking Neuron-in-Memory Processor for Wearable Healthcare
Fengshi Tian, Xiaomeng Wang, Jinbo Chen, Jiakun Zheng, Hui Wu, Xuejiao Liu, Fengbin Tu, Jie Yang, Mohamad Sawan, Chi-Ying Tsui, Kwang-Ting Tim Cheng
2023 IEEE European Solid-State Circuits Conference (ESSCIRC)
hardware accelerator compute-in-memory
A Tiny Accelerator for Mixed-Bit Sparse CNN Based on Efficient Fetch Method of SIMO SPad
A Tiny Accelerator for Mixed-Bit Sparse CNN Based on Efficient Fetch Method of SIMO SPad
Xianghong Hu, Xuejiao Liu, Yu Liu, Haowei Zhang, Xijie Huang, Xihao Guan, Luhong Liang, Chi Ying Tsui, Xiaoming Xiong, Kwang-Ting Cheng
IEEE Transactions on Circuits and Systems II: Express Briefs
hardware accelerator tiny ML co-design
SNNOpt: An Application-Specific Design Framework for Spiking Neural Networks
SNNOpt: An Application-Specific Design Framework for Spiking Neural Networks
Jingyu He, Ziyang Shen, Fengshi Tian, Jinbo Chen, Jie Yang, Mohamad Sawan, Kwang-Ting Cheng, Paul Bogdan, Chi-Ying Tsui
2023 IEEE 5th International Conference on Artificial Intelligence Circuits and Systems (AICAS)
co-design
Binary is All You Need: Ultra-Efficient Arrhythmia Detection with a Binary-Only Compressive System
Binary is All You Need: Ultra-Efficient Arrhythmia Detection with a Binary-Only Compressive System
Fengshi Tian, Xiaomeng Wang, Jinbo Chen, Jie Yang, Mohamad Sawan, Chi-Ying Tsui, Kwang-Ting Tim Cheng
2023 IEEE 5th International Conference on Artificial Intelligence Circuits and Systems (AICAS)
hardware accelerator compute-in-memory

2022

Cyclical Self-Supervision for Semi-Supervised Ejection Fraction Prediction From Echocardiogram Videos
Cyclical Self-Supervision for Semi-Supervised Ejection Fraction Prediction From Echocardiogram Videos
Weihang Dai, Xiaomeng Li, Xinpeng Ding, Kwang-Ting Cheng
IEEE Transactions on Medical Imaging (TMI), 2022
computer vision medical image
InsMix: Towards Realistic Generative Data Augmentation for Nuclei Instance Segmentation
InsMix: Towards Realistic Generative Data Augmentation for Nuclei Instance Segmentation
Yi Lin, Zeyu Wang, Kwang-Ting Cheng, Hao Chen
Medical Image Computing and Computer Assisted Intervention (MICCAI), 2022
computer vision medical image
Dual-Distribution Discrepancy for Anomaly Detection in Chest X-Rays
Dual-Distribution Discrepancy for Anomaly Detection in Chest X-Rays
Yu Cai, Hao Chen, Xin Yang, Yu Zhou, Kwang-Ting Cheng
Medical Image Computing and Computer Assisted Intervention (MICCAI), 2022
computer vision medical image
Graph Reasoning Transformer for Image Parsing
Graph Reasoning Transformer for Image Parsing
Dong Zhang, Jinhui Tang, Kwang-Ting Cheng
ACM Multimedia (ACM MM), 2022
computer vision
Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation
Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation
Zechun Liu, Kwang-Ting Cheng, Dong Huang, Eric Xing, Zhiqiang Shen
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
computer vision tiny ML
Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space
Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space
Arnav Chavan, Zhiqiang Shen, Zhuang Liu, Zechun Liu, Kwang-Ting Cheng, Eric Xing
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
computer vision tiny ML
SDQ: Stochastic Differentiable Quantization with Mixed Precision
SDQ: Stochastic Differentiable Quantization with Mixed Precision
Xijie Huang, Zhiqiang Shen, Shichao Li, Zechun Liu, Xianghong Hu, Jeffry Wicaksana, Eric Xing, Kwang-Ting Cheng
International Conference on Machine Learning (ICML), 2022
computer vision tiny ML co-design
Customized Federated Learning for Multi-Source Decentralized Medical Image Classification
Customized Federated Learning for Multi-Source Decentralized Medical Image Classification
Jeffry Wicaksana, Zengqiang Yan, Xin Yang, Yang Liu, Lixin Fan, Kwang-Ting Cheng
IEEE Journal of Biomedical and Health Informatics (JBHI), 2022
computer vision medical image
Imitation Learning-Based Algorithm for Drone Cinematography System
Imitation Learning-Based Algorithm for Drone Cinematography System
Yuanjie Dang, Chong Huang, Peng Chen, Ronghua Liang, Xin Yang, Kwang-Ting Cheng
IEEE Transactions on Cognitive and Developmental Systems, 2022
computer vision
Adaptive Contrast for Image Regression in Computer-Aided Disease Assessment
Adaptive Contrast for Image Regression in Computer-Aided Disease Assessment
Weihang Dai, Xiaomeng Li, Wan Hang Keith Chiu, Michael D. Kuo, Kwang-Ting Cheng
IEEE Transactions on Medical Imaging (TMI), 2022
computer vision medical image
Stereo Neural Vernier Caliper
Stereo Neural Vernier Caliper
Shichao Li, Zechun Liu, Zhiqiang Shen, Kwang-Ting Cheng
AAAI Conference on Artificial Intelligence (AAAI), 2022
computer vision
Automated Vision-Based Wellness Analysis for Elderly Care Centers
Automated Vision-Based Wellness Analysis for Elderly Care Centers
Xijie Huang, Jeffry Wicaksana, Shichao Li, Kwang-Ting Cheng
AAAI Conference on Artificial Intelligence (AAAI) Workshop on Health Intelligence, 2022
computer vision
More on Google Scholar