Ricky Xie (谢睿奇)

Ricky Xie (谢睿奇)

Tsinghua University

My name is Ricky Xie (谢睿奇) , and I am currently a undergraduate student at Tsinghua University, ZhiLi College, where I am majoring in Mathematical and Physical Sciences with a minor in Computer Science. I am also conducting research at the NICS-EFC Group in the Department of Electronics at Tsinghua University. My research interests include Efficient Deep Learning, Computer Vision, and the development of Efficient Attention Mechanisms. In the summer of 2025, I also join the Efficient Computing Lab at Yale University for a research internship focusing on Embodied Intelligence.

In the near future, I will be pursuing a Master’s degree in Electronic Information at Tsinghua University, continuing my academic and research journey in the field of advanced technologies.

📝 Publications

NuerIPS 2025
sym

PAROAttention: Pattern-Aware ReOrdering for Efficient Sparse and Quantized Attention in Visual Generation Models

Tianchen Zhao, Ke Hong, Xinhao Yang, Xuefeng Xiao, Huixia Li, Feng Ling, Ruiqi Xie, Siqi Chen, Hongyu Zhu, Yichong Zhang, Yu Wang

Project Page

  • We analyze key challenges in attention sparsity and low-bit quantization for visual generation models, identifying their common issue as “diverse and scattered” attention patterns.
  • Based on the “locality” prior in visual feature extraction, we show that these patterns arise from the tokenization process, which disrupts 3D spatial adjacency.
  • We design a simple “Token Reorder” method to convert diverse attention patterns into a unified, hardware-friendly block pattern, improving attention and end-to-end acceleration while maintaining generation quality.

🎖 Honors and Awards

  • 2023.09 First Prize, National College Students Mathematics Competition
  • 2023.10 Tsinghua University Comprehensive Excellence Scholarship, Good Book Scholarship
  • 2024.10 Tsinghua University Comprehensive Excellence Scholarship, Tsinghua Friends - Shenhua Scholarship
  • 2025.10 Tsinghua University Comprehensive Excellence Scholarship, Tsinghua Friends - Zhenggerucing Scholarship

📖 Educations

  • 2022.09 - 2026.07, Undergraduate Student in Mathematical and Physical Sciences, Tsinghua University
  • 2026.09 - Expected, Master’s student in Electronic Information, Tsinghua University

💻 Internships