Mingjie Sun

About Me

I am a Member of Technical Staff at Thinking Machines Lab. I obtained my Ph.D. in Computer Science Department from Carnegie Mellon University, advised by Zico Kolter, and my B.S. in Computer Science from Yao Class, Tsinghua University.

Research

* indicates equal contribution

For a complete list of technical reports, please see my Google Scholar

• Idiosyncrasies in Large Language Models
  Mingjie Sun*, Yida Yin*, Zhiqiu Xu, J. Zico Kolter, Zhuang Liu
  International Conference on Machine Learning (ICML) 2025
  [paper] [code] [project page] [media] [cmu news]
• Test-Time Adaptation Induces Stronger Accuracy and Agreement-on-the-Line
  Eungyeup Kim, Mingjie Sun, Christina Baek, Aditi Raghunathan, J. Zico Kolter
  Neural Information Processing Systems (NeurIPS) 2024
  [paper] [openreview]
• Massive Activations in Large Language Models
  Mingjie Sun, Xinlei Chen, J. Zico Kolter, Zhuang Liu
  Conference on Language Modeling (COLM) 2024
  Oral at ICLR 2024 ME-FoMo Workshop
  [paper] [code] [project page] [openreview]
• A Simple and Effective Pruning Approach for Large Language Models
  Mingjie Sun*, Zhuang Liu*, Anna Bair, J. Zico Kolter
  International Conference on Learning Representations (ICLR) 2024
  [paper] [code] [project page] [openreview] [slide]
• Single Image Backdoor Inversion via Robust Smoothed Classifiers
  Mingjie Sun, J. Zico Kolter
  Computer Vision and Pattern Recognition (CVPR) 2023
  [paper] [code] [video]
• (Certified!!) Adversarial Robustness for Free!
  Nicholas Carlini*, Florian Tramèr*, Krishnamurthy (Dj) Dvijotham, Leslie Rice, Mingjie Sun, J. Zico Kolter
  International Conference on Learning Representations (ICLR) 2023
  [paper] [code] [openreview]
• Test-Time Adaptation via Conjugate Pseudo-Labels
  Sachin Goyal*, Mingjie Sun*, Aditi Raghunathan, J. Zico Kolter
  Neural Information Processing Systems (NeurIPS) 2022
  [paper] [code] [openreview] [Zico's talk]
• Denoised Smoothing: A Provable Defense for Pretrained Classifiers
  Hadi Salman, Mingjie Sun, Greg Yang, Ashish Kapoor, J. Zico Kolter
  Neural Information Processing Systems (NeurIPS) 2020
  [paper] [code] [blog post]
• Rethinking the Value of Network Pruning
  Zhuang Liu*, Mingjie Sun*, Tinghui Zhou, Gao Huang, Trevor Darrell
  International Conference on Learning Representations (ICLR) 2019
  Best Paper Award at NeurIPS 2018 Compact Deep Neural Networks Workshop
  [paper] [code] [openreview]