Jiawei Liu

I’m a final-year Ph.D. student at University of Illinois Urbana-Champaign, working with Lingming Zhang. My research explores how Software Engineering/Programming Language can benefit and benefit from Machine Learning and its systems, with a focus on improving software reliability & quality and developer productivity.

Software Engineering with Language Models
Developing models and evaluators to generate high-quality code:
Software Engineering for ML Systems
Building automated tools to improve the reliability of ML systems and to simplify its deployment:
  • Automating test program synthesis [NeuRI][NNSmith][Tzer], which has spotted hundreds critical bugs for daily ML frameworks and compilers
  • Engineering ML systems and compilers productively using top-down development [TapML] and pattern languages [Relax]

📰 Some recent blog & coding: R1 for Code Generation and Speculative Code Editing.

📬 Shortest path to me: jiawei6@illinois.edu

ResearchShow More

  1. Proceedings of the 34th ACM SIGSOFT International Symposium on Software Testing and Analysis. 2025
  2. Forty-first International Conference on Machine Learning. 2024
    Adopted by Meta Llama 3.1, Google CodeGemma, and IBM Granite
  3. Anton Lozhkov, Raymond Li, Loubna Ben AllalFederico Cassano, Joel Lamy-Poirier, Nouamane Tazi, Ao Tang, Dmytro Pykhtar,  Jiawei LiuYuxiang Wei and 56 more authors
    arXiv preprint arXiv:2402.19173. 2024
  4. Thirty-seventh Conference on Neural Information Processing Systems. 2023
    800k HuggingFace downloads; integrated by various industries
  5. Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 2023
    🏆 ACM SIGSOFT Distinguished Paper Award
  6. Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2. 2023
    🏆 Distinguished Artifact Award
  7. Proceedings of the ACM on Programming Languages 6 (OOPSLA1). Apr 2022

Service

Organizing: LLM4Code@ICSE'{24,25} (Publicity Chair)

Program Committee/Reviewer: ASE'25, ASE'24, TSE, TOSEM, NeurIPS'24, ICLR'25

Artifact Evaluation Committee: PLDI'23, OSDI'22, ATC'22

Invited Talk

NLP+SE Seminar, UT Austin: Smelling the Quality of LLM-generated Code Mar 2025

Programming Systems, Uber: Evaluating LLMs for Correct & Efficient Code Generation Sept 2024

ARiSE Lab, Columbia University: Simplify the Making of Great Software in the ML Era April 2024

Snowflake GenAI: Rigorous Evaluation of LLMs for Code (Slides) Feb 2024

AST Lab, ETH Zürich: Generating Test-Cases for ML Compilers (Slides) Jan 2024

GAI4SE, NC State University: LLMs for Software Testing (Guest Lecture) Nov 2023

Apache TVM Conference: Automating DL Compiler Bug Finding with NNSmith Mar 2023

SAMPL, University of Washington: Coverage-Guided Tensor Compiler Fuzzing May 2022