Quality Assurance of A GPT-based Sentiment Analysis System: Adversarial Review Data Generation and Detection

Kushal Dave, Steve Lawrence, and David M. Pennock. Mining the Peanut Gallery: Opinion Extraction and Semantic Classification of Product Reviews. In Proceedings of the 12th International Conference on World Wide Web (WWW ’03). ACM, New York, NY, USA, 519–528. 2003. https://doi.org/10.1145/775152.775226

2003

Earlier work this paper cites.

Ribeiro, M. T., Wu, T., Guestrin, C., and Singh, S. (2020). Beyond accuracy: Behavioral testing of NLP models with CheckList. arXiv preprint arXiv:2005.04118

Original

2005

Earlier work this paper cites.

Zhang, Yin, Rong Jin, and Zhi-Hua Zhou. Understanding bag-of-words model: a statistical framework. International journal of machine learning and cybernetics 1, no. 1: 43-52, 2010

2010

Earlier work this paper cites.

Battista Biggio, Igino Corona, Davide Maiorca, Blaine Nelson, Nedim Srndi/c, Pavel Laskov, Giorgio Giacinto, and Fabio Roli. Evasion attacks against machine learning at test time. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 387–402, 2013

2013

Earlier work this paper cites.

Diekmann, A., B. Jann, W. Przepiorka and S. Wehrli, Reputation formation and the evolution of cooperation in anonymous online markets. Am. Sociol. Rev., 79: 65-85, 2014

2014

Earlier work this paper cites.

C. Szegedy et al. Intriguing properties of neural networks. in Proc. 2nd Int. Conf. Learn. Representation, pp. 14–16, 2014

2014

Earlier work this paper cites.

Ian J. Goodfellow, J. Shlens, and C. Szegedy, Explaining and harnessing adversarial examples. in Proc. 3rd Int. Conf. Learn. Representation, pp. 7–9, 2015

2015

Earlier work this paper cites.

Moosavi-Dezfooli, S. M., Fawzi, A., and Frossard, P. Deepfool: a simple and accurate method to fool deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2574-2582, 2016

2016

Earlier work this paper cites.

Church, Kenneth Ward. Word2Vec. Natural Language Engineering 23, no. 1: 155-162, 2017

2017

Earlier work this paper cites.

N. Carlini and D. A. Wagner, Adversarial examples are not easily detected: Bypassing ten detection methods/ in Proc. 10th ACMWorkshop Artif. Intell. Secur., pp. 3–14, 2017

2017

Earlier work this paper cites.

A. Kurakin, Ian J. Goodfellow, and S. Bengio, Adversarial examples in the physical world. in Proc. 5th Int. Conf. Learn. Representation, 2017, arXiv:1607.02533

Original

2017

Earlier work this paper cites.

I.Evtimov, K.Eykholt, E.Fernandes, T.Kohno, B.Li, A.Prakash, A.Rahmati, and D. Song, Robust physical-world attacks on deep learning models, 2017. arXiv preprint arXiv:1707.08945

Original

2017

Earlier work this paper cites.

K. Pei, Y.Cao, J.Yang, and S.Jana, Deepxplore:Automated white box testing of deep learning systems. in Proceedings of the 26th Symposium on Operating Systems Principles. ACM,pp.1–18, 2017

2017

Earlier work this paper cites.

Qaiser, Shahzad, and Ramsha Ali. Text mining: use of TF-IDF to examine the relevance of words to documents. International Journal of Computer Applications 181, no. 1: 25-29, 2018

2018

Cited alongside, same era.

Aralikatte, Rahul, Giriprasad Sridhara, Neelamadhav Gantayat, and Senthil Mani. Fault in your stars: an analysis of android app reviews. In Proceedings of the acm india joint international conference on data science and management of data, pp. 57-66. 2018

2018

Cited alongside, same era.

Elmurngi, Elshrif Ibrahim, and Abdelouahed Gherbi. Unfair reviews detection on amazon reviews using sentiment analysis with supervised learning techniques. J. Comput. Sci. 14, no. 5: 714-726, 2018

2018

Cited alongside, same era.

Patel, Nidhi A., and Rakesh Patel. A survey on fake review detection using machine learning techniques. In 2018 4th International Conference on Computing Communication and Automation (ICCCA), pp. 1-6. IEEE, 2018

2018

Cited alongside, same era.

Ouyang, T., Seo, Y., and Oiwa, Y. Quality assurance study with mismatched data in sentiment analysis. In 2022 29th Asia-Pacific Software Engineering Conference (APSEC) (pp. 442-446). IEEE. 2022, December

2022

Later among the works it cites.

Ouyang, T., Isobe, Y., Sultana, S., Seo, Y., and Oiwa, Y. Autonomous driving quality assurance with data uncertainty analysis. In 2022 International Joint Conference on Neural Networks (IJCNN) (pp. 1-7). IEEE. 2022, July

2022

Later among the works it cites.

OpenAI. https://chat.openai.com.chat, 2023

2023

Closest in time.

Jiao, W. X., W. X. Wang, J. T. Huang, Xing Wang, and Z. P. Tu. Is ChatGPT a good translator? Yes with GPT-4 as the engine, 2023. arXiv preprint arXiv:2301.08745

Original

2023

Closest in time.

Wu, Haoran, Wenxuan Wang, Yuxuan Wan, Wenxiang Jiao, and Michael Lyu. ChatGPT or Grammarly? Evaluating ChatGPT on Grammatical Error Correction Benchmark, 2023. arXiv preprint arXiv:2303.13648