Domain-Specific Computer Architectures for Emerging Applications II From Deep Learning to Large Language Models

1. Foundations of Domain-Specific Computer Architectures in the Era of Foundation Models
Chao Wang

2. An Overview of Large Language Models and Fundamental Algorithms
Hang Gu, Teng Wang, Wenqi Lou, Lei Gong, Chao Wang, Xuehai Zhou

3. Modeling and Evaluation Framework for Constrained Dataflow in Spatial Accelerators
Wei Wei Song, Yuxing He, Lei Gong, Wenqi Lou, Teng Wang, Chao Wang, Xuehai Zhou

4. Heterogeneous Acceleration and Adaptive Mapping for Vision Transformers
Qianyu Cheng, Yuan Sun, Teng Wang, Wenqi Lou, Lei Gong, Chao Wang, Xuehai Zhou

5. Collaborative Design of MoE ViT: Quantization and Computation Orchestration
Jiale Dong, Linkun Pan, Yiming Liu, Wenqi Lou, Teng Wang, Lei Gong, Chao Wang, Xuehai Zhou

6. Scalable Inference Acceleration System for LLM
Zhendong Zheng, Teng Wang, Wenqi Lou, Lei Gong, Chao Wang, Xuehai Zhou

7. A Compiler Framework for Automatic Generation of High-Performance FPGA Accelerators for Sparse Tensor Computations   
Xingyan Chen, Zihan Wang, Lei Gong, Wenqi Lou, Teng Wang, Chao Wang, Xuehai Zhou

8. Tensor Program Auto-Tuning for Tensorized  Intrinsics and Diverse GPU
Haowen Hou, Zihan Wang, Lei Gong, Wenqi Lou, Teng Wang, Chao Wang, Xuehai Zhou

9. High-Level Synthesis Toolchain Enhancement
Chao Shi, Teng Wang, Wenqi Lou, Lei Gong, Chao Wang, Xuehai Zhou

10. Neural Architecture Search with Zero/Few-Shot Performance Proxies
Linkun Pan, Qiaochu Liang, Wenqi Lou, Teng Wang, Lei Gong, Chao Wang, Xuehai Zhou

11. CNN-FPGA Co-Optimization: Synergistic Design of Operator Search, Model Compression, and Hardware Acceleration
Guochong Sui, Cheng Tang, Yiming Liu, Wenqi Lou, Teng Wang, Lei Gong, Chao Wang, Xuehai Zhou

12. CNN-ASIC Co-Search and Joint Optimization: Zero-Cost Proxy-Driven Heterogeneous Multi-Core Accelerator Design
Guochong Sui, Cheng Tang, Wei Fu, Wenqi Lou, Teng Wang, Lei Gong, Chao Wang, Xuehai Zhou

Biography

Chao Wang is a Professor, Vice Dean of the School of Software, and doctoral supervisor at the University of Science and Technology of China (USTC). His research interests include FPGA-based reconfigurable computing, intelligent processors, and intelligent computing systems. He has led or participated in national and provincial-level research projects and contributed to intelligent computing systems based on domestic AI chips.

Wenqi Lou is an Associate Researcher and master's supervisor in the School of Software at USTC. He received his PhD in computer architecture from USTC in 2023. His research interests include intelligent accelerator architectures, FPGA accelerator design, and hardware-software co-optimization for the deployment of deep learning models.

Teng Wang is an Associate Researcher in the School of Software at USTC. He received his PhD in computer architecture from USTC in 2023. His research focuses on reconfigurable hardware accelerators and neural network processors.

Lei Gong is an Associate Professor in the School of Computer Science and Technology at USTC. He received his PhD in computer science from USTC in 2019. His research interests include FPGA-based accelerator design and artificial intelligence and machine learning systems.

Xuehai Zhou is a Professor and doctoral supervisor at USTC. His research interests include heterogeneous multicore architectures, reconfigurable systems, application-specific hardware acceleration, and embedded system design. He has led or participated in more than 30 national research projects.