Mingjie Sun

About Me

I am a Ph.D. student in the Computer Science Department at Carnegie Mellon University, where I am fortunate to be advised by Zico Kolter. I obtained my Bachelor's degree from Yao Class, Tsinghua University in 2019.

I am interested in empirical deep learning.

Research

* indicates equal contribution

For a complete list of technical reports, please see my Google Scholar

• Massive Activations in Large Language Models
  Mingjie Sun, Xinlei Chen, J. Zico Kolter, Zhuang Liu
  Conference on Language Modeling (COLM), 2024
  [paper] [code] [project page]
• A Simple and Effective Pruning Approach for Large Language Models
  Mingjie Sun*, Zhuang Liu*, Anna Bair, J. Zico Kolter
  International Conference on Learning Representations (ICLR) 2024
  [paper] [code] [project page] [openreview] [slide]
• Single Image Backdoor Inversion via Robust Smoothed Classifiers
  Mingjie Sun, J. Zico Kolter
  Computer Vision and Pattern Recognition (CVPR) 2023
  [paper] [code] [video]
• (Certified!!) Adversarial Robustness for Free!
  Nicholas Carlini*, Florian Tramèr*, Krishnamurthy (Dj) Dvijotham, Leslie Rice, Mingjie Sun, J. Zico Kolter
  International Conference on Learning Representations (ICLR) 2023
  [paper] [code] [openreview]
• Test-Time Adaptation via Conjugate Pseudo-Labels
  Sachin Goyal*, Mingjie Sun*, Aditi Raghunathan, J. Zico Kolter
  Neural Information Processing Systems (NeurIPS) 2022
  [paper] [code] [openreview] [Zico's talk]
• Denoised Smoothing: A Provable Defense for Pretrained Classifiers
  Hadi Salman, Mingjie Sun, Greg Yang, Ashish Kapoor, J. Zico Kolter
  Neural Information Processing Systems (NeurIPS) 2020
  [paper] [code] [blog post]
• Rethinking the Value of Network Pruning
  Zhuang Liu*, Mingjie Sun*, Tinghui Zhou, Gao Huang, Trevor Darrell
  International Conference on Learning Representations (ICLR) 2019
  [paper] [code] [openreview]
  NeurIPS'18 Compact Neural Networks Workshop Best Paper Award