Publications


BOOKS AND BOOK ARTICLES


[B1] Lei Bu, Liqian Chen, Yunwei Dong, Xiaowei Huang, Jianlin Li, Qin Li, Wanwei Liu, Wenjian Ruan, Fu Song, Youcheng Sun, Jingyi Wang, Min Wu, Zhiwu Xu, Bai Xue, Pengfei Yang, Xinping Yi, Lijun Zhang and Min Zhang. Research Progress and Trends on Formal Verification of Artificial Intelligence Systems. CCF 2019-2020 Progress Report on Chinese Computer Science and Technology. China Machine Press, pages 491-539, 2020.


REFEREED JOURNAL AND CONFERENCE ARTICLES

* corresponding author

Preprint

[Arxiv] Xiaohan Yuan, Jinfeng Li, Dongxia Wang, Yuefeng Chen, Xiaofeng Mao, Longtao Huang, Hui Xue, Wenhai Wang, Kui Ren and Jingyi Wang. S-Eval: Automatic and Adaptive Test Generation for Benchmarking Safety Evaluation of Large Lanuguage Models. arXiv:2405.14191, 2024. (Paper link, Github link, HuggingFace Leaderboard Link)

[Arxiv] Xiaoxia Liu, Jingyi Wang, Jun Sun, Xiaohan Yuan, Guoliang Dong, Peng Di, Wenhai Wang, Dongxia Wang. Prompting Frameworks for Large Language Models: A Survey. arXiv:2311.12785, 2023. (Paper link, Github link, Media Coverage: AGI Leap Summit, Best Paper Award)


2024

[ICSE, CCF A] Jianan Ma, Pengfei Yang, Jingyi Wang*, Youcheng Sun, Chengchao Huang and Zhen Wang. VeRe: Verification Guided Synthesis for Repairing Deep Neural Networks. 46th International Conference on Software Engineering, Lisbon, Portugal, Apr, 2024. (Acceptance rate: 234/1051=22%)

[ISSTA, CCF A] Xiangshan Gao, Jialuo Chen, Jingyi Wang*, Jie Shi, Peng Cheng and Jiming Chen. TeDA: A Testing Framework for Data Usage Auditing in Deep Learning Model Development. 33rd International Symposium on Software Testing and Analysis, Vienna, Austria, Sep 2024.

[ISSTA, CCF A] Jialuo Chen, Jingyi Wang*, Youcheng Sun, Peng Cheng and Jiming Chen. Isolation-based Debugging for Neural Networks. 33rd International Symposium on Software Testing and Analysis, Vienna, Austria, Sep 2024. (First round accepted 42/471, acceptance rate: 8.9%)

[ISSTA, CCF A] Zuohui Chen, Jun Zhou, Youcheng Sun, Jingyi Wang*, Qi Xuan and Xiaoniu Yang. Interpretability based Neural Network Repair. 33rd International Symposium on Software Testing and Analysis, Vienna, Austria, Sep 2024.

[TSE, CCF A] Shunkai Zhu, Jingyi Wang*, Jun Sun, Jie Yang, Xingwei Lin, Tianyi Wang, Liyi Zhang and Peng Cheng. Better Pay Attention Whilst Fuzzing. IEEE Transactions on Software Engineering. (Accepted)

[TDSC, CCF A] Xiangshan Gao, Xingjun Ma, Jingyi Wang, Youcheng Sun, Bo Li, Shouling Ji, Peng Cheng and Jiming Chen. VERIFI: Towards Verifiable Federated Unlearning, IEEE Transactions on Dependable and Secure Computing. (Accepted)

[TOSEM, CCF A] Zhe Zhao, Guangke Chen, Tong Liu, Taishan Li, Fu Song, Jingyi Wang and Jun Sun. Attack as Detection: Using Adversarial Attack Methods to Detect Abnormal Examples, ACM Transactions on Software Engineering and Methodology. (Accepted)

[RA-L] Yifan Jia, Christopher M. Poskitt, Peixin Zhang, Jingyi Wang*, Jun Sun, Sudipta Chattopadhyay. Robust and Fast DNN Model Training for Trustworthy Robots. IEEE Robotics and Automation Letters. (Accepted)

[AsiaCCS/CPSS] Zichen Wang, Jingyi Wang*, Fu Song, Kun Wang, Hongyi Pu and Peng Cheng. K-RAPID: A Formal Executable Semantics of the RAPID Robot Programming Language, the 10th ACM Cyber-Physical System Security Workshop, held in conjunction with ACM AsiaCCS’24 Singapore, July 2024.


2023

[CCS, CCF A] Wenya Wang, Xingwei Lin, Jingyi Wang*, Wang Gao, Dawu Gu, Wei Lv, and Jiashui Wang. HODOR: Shrinking Attack Surface on Node.js via System Call Limitation. 30th ACM Conference on Computer and Communications Security, Copenhagen, Denmark, Nov 2023.

[TSE, CCF A] Kun Wang, Jingyi Wang*, Christopher M. Poskitt, Xiangxiang Chen, Jun Sun, and Peng Cheng. K-ST: A Formal Executable Semantics of the Structured Text Language for PLCs. IEEE Transactions on Software Engineering. (Accepted)

[ISSTA, CCF A] Huizhong Guo, Jinfeng Li, Jingyi Wang, Xiangyu Liu, Dongxia Wang, Zehong Hu, Rong Zhang and Hui Xue. FairRec: Fairness Testing for Deep Recommender Systems, 32nd International Symposium on Software Testing and Analysis, Seattle, USA, July 2023. (First round acceptance 20/159, acceptance rate: 12.6%)

[TOSEM, CCF A] Mengdi Zhang, Jun Sun, Jingyi Wang and Bing Sun. TestSGD: Interpretable Testing of Neural Networks Against Subtle Group Discrimination. ACM Transactions on Software Engineering and Methodology. (Accepted)

[Black Hat Europe] Wenya Wang, Xingwei Lin, Jingyi Wang, Wang Gao, Dawu Gu. HODOR: Reducing Attack Surface on Node.js via System Call Limitation. Black Hat Europe, London, United Kingdom, Dec, 2023.

[ICSE Demo] Jialuo Chen, Youcheng Sun, Jingyi Wang, Peng Cheng and Xingjun Ma. Copy, Right? A Testing Framework for Copyright Protection of Deep Learning Models. 45th International Conference on Software Engineering, Demostractions track, Melbourne, Australia, May, 2023.

[CONFEST/FMICS] Huan Sun, Ziyu Mao, Jingyi Wang*, Ziyan Zhao, Wenhai Wang. Applying Rely-guarantee Reasoning on Concurrent Memory Management and Mailbox in μC/OS-II: A Case Study. 28th International Conference on Formal Methods for Industrial Critical Systems, part of CONFEST 2023, Antwerp, Belgium, Sep, 2023.


2022

[S&P, CCF A] Jialuo Chen, Jingyi Wang*, Tinglan Peng, Youcheng Sun, Peng Cheng, Shouling Ji, Xingjun Ma, Bo Li and Dawn Song. Copy, Right? A Testing Framework for Copyright Protection of Deep Learning Models. 43rd IEEE Symposium on Security and Privacy, Oakland, USA, May 2022.

[ICSE, CCF A] Haibin Zheng, Zhiqing Chen, Tianyu Du, Xuhong Zhang, Yao Cheng, Shouling Ji, Jingyi Wang, Yue Yu and Jinyin Chen. NeuronFair: Interpretable White-Box Fairness Testing through Biased Neuron Identification. 44th International Conference on Software Engineering, Pittsburgh, PA, USA, May, 2022. (197/751, Acceptance rate: 26%)

[TOSEM, CCF A] Jialuo Chen, Jingyi Wang*, Xingjun Ma, Youcheng Sun, Jun Sun, Peixin Zhang and Peng Cheng. QuoTe: Quality-oriented Testing for Deep Learning Systems. ACM Transactions on Software Engineering and Methodology. (Accepted)

[ASE-J, CCF B] Mengdi Zhang, Jun Sun and Jingyi Wang. Which neural network makes more explainable decisions? An approach towards measuring explainability. Automated Software Engineering, 2022.

[FITEE] Rongkuan Ma, Hao Zheng, Jingyi Wang, Mufeng Wang, Qiang Wei and Qingxian Wang. Automatic Protocol Reverse-engineering for Industrial Control Systems with Dynamic Taint Analysis. Frontiers of Information Technology & Electronic Engineering, 2022. (Spotlight Paper)

[IoT] Yangyang Geng, Yuqi Chen, Rongkuan Ma, Qiang Wei, Jie Pan, Jingyi Wang, Peng Cheng and Qingxian Wang. Defending Cyber-physical Systems through Reverse Engineering Based Memory Sanity Check. IEEE Internet of Things Journal, 2022.


2021

[ICSE, CCF A] Jingyi Wang, Jialuo Chen, Youcheng Sun, Xingjun Ma, Dongxia Wang, Jun Sun and Peng Cheng. RobOT: Robustness-Oriented Testing for Deep Learning Systems. 43rd International Conference on Software Engineering, Madrid, Spain (online), May 2021. (138/615, Acceptance rate: 22%)

[TSE, CCF A] Peixin Zhang, Jingyi Wang*, Jun Sun, Xinyu Wang, Guoliang Dong, Xinggen Wang, Ting Dai and Jin Song Dong. Automatic Fairness Testing of Neural Classifiers through Adversarial Sampling, IEEE Transactions on Software Engineering. (Accepted)

[ISSTA, CCF A] Zhe Zhao, Guangke Chen, Jingyi Wang, Yiwei Yang, Fu Song and Jun Sun. Attack as Defense: Characterizing Adversarial Examples using Robustness, 30th International Symposium on Software Testing and Analysis (online), July 2021. (51/233, Acceptance rate: 22%)

[ETAPS/TACAS, CCF B] Pengfei Yang, Renjue Li, Jianlin Li, Cheng-Chao Huang, Jingyi Wang, Jun Sun, Bai Xue and Lijun Zhang. Improving Neural Network Verification through Spurious Region Guided Refinement, 27th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, Luxembourg, Luxembourg (online), Apr 2021.

[JCST, CCF B] Ke Liu, Jingyi Wang, Qiang Wei, Zhengyong Zhang, Jun Sun, Rongkuan Ma, Ruilong Deng. HRPDF: A Software-Based Heterogeneous Redundant Proactive Defense Framework for Programmable Logic Controller, Journal of Computer Science and Technology. (Accepted)

[IJCIP] Yifan Jia, Jingyi Wang, Christopher M. Poskitt, Sudipta Chattopadhyay, Jun Sun and Yuqi Chen. Adversarial Attacks and Mitigation for Anomaly Detectors of Cyber-Physical Systems, International Journal of Critical Infrastructure Protection. (Accepted)


2020

[ASE, CCF A] Guoliang Dong, Jingyi Wang*, Jun Sun, Yang Zhang, Xinyu Wang, Ting Dai, Xingen Wang and Jin Song Dong. Towards Interpreting Recurrent Neural Network through Probabilistic Abstraction. 35th IEEE/ACM International Conference on Automated Software Engineering, Melbourne, Australia (online), Sep 2020. (92/414, Acceptance rate: 22.5%)

[ICSE, CCF A] Peixin Zhang, Jingyi Wang*, Jun Sun, Guoliang Dong, Xinyu Wang, Ting Dai, Xingen Wang and Jin Song Dong. White-box Fairness Testing through Adversarial Sampling. 42nd International Conference on Software Engineering, Seoul, South Korea (online), Oct 2020. (129/617, Acceptance rate: 20.9%, ACM SIGSOFT Distinguished Paper Award, ACM SIGSOFT Research Highlights.)

[ICECCS, CCF C] Yizhen Dong, Peixin Zhang, Jingyi Wang*, Shuang Liu, Jun Sun, Jianye Hao, Xinyu Wang, Li Wang, Jin Song Dong and Ting Dai. An Empirical Study on the Correlation between Coverage and Robustness for Deep Neural Networks. 25th International Conference on Engineering of Complex Computer Systems, October 2020, Singapore (online).


Before 2020

[TSE, CCF A] Jingyi Wang, Jun Sun, Shengchao Qin and Cyrille Jegourel. Automatically ‘Verifying’ Discrete-Time Complex Systems through Learning, Abstraction and Refinement, IEEE Transactions on Software Engineering, 2018.

[FM, CCF A] Jingyi Wang, Jun Sun, Yifan Jia, Shengchao Qin and Zhiwu Xu. Towards ‘Verifying’ a Water Treatment System, 22nd International Symposium on Formal Methods, Oxford, UK, July 2018. (Acceptance rate: 28%)

[ICSE, CCF A] Jingyi Wang, Guoliang Dong, Jun Sun, Xinyu Wang and Peixin Zhang. Adversarial Sample Detection for Deep Neural Networks through Model Mutation Testing. 41st International Conference on Software Engineering, Montreal, Canada, May 2019. (109/529, Acceptance rate: 20.6%)

[ICSE, CCF A] Xinyu Wang, Jun Sun, Zhenbang Chen, Peixin Zhang, Jingyi Wang* and Yun Lin. Towards Optimal Concolic Testing, 40th International Conference on Software Engineering, Gothenburg, Sweden, May 2018. (Acceptance rate:20.9%, ACM SIGSOFT Distinguished Paper Award)

[ETAPS/FASE, CCF B] Jingyi Wang, Jun Sun, Qixia Yuan, Jun Pang. Should We Learn Probabilistic Models for Model Checking? A New approach and an Empirical Study, 20th International Conference on Fundamental Approaches to Software Engineering, Uppsala, Sweden, Apr 2017. (Acceptance rate: 27%)

[DSN, CCF B] Cyrille Jegourel, Jingyi Wang and Jun Sun. Importance Sampling of Interval Markov Chains, 48th International Conference on Dependable Systems and Networks, Luxembourg, Nov 2018. (Acceptance rate: 26.7%)

[FM, CCF A] Pingfan Kong, Yi Li, Xiaohong Chen, Jun Sun, Meng Sun, Jingyi Wang. Towards Concolic Testing for Hybrid Systems, 21st International Symposium on Formal Methods, Cyprus, Nov 2016.

[STTT, CCF C] Jingyi Wang, Jun Sun, Qixia Yuan, and Jun Pang. Learning Probabilistic Models for Model Checking: An Evolutionary Approach and an Empirical Study, International Journal on Software Tools for Technology Transfer, 2018.

[ICFEM, CCF C] Jingyi Wang, Xiaohong Chen, Jun Sun, Shengchao Qin. Improving Probability Estimation through Active Probabilistic Model Learning, 19th International Conference on Formal Engineering Methods, Xi’an, China, Nov 2017.