2023

AI-Generated Content (AIGC): A Survey

Wu, Jiayang, Gan, Wensheng, Chen, Zefeng et al.

Understand

To address the challenges of digital intelligence in the digital economy, artificial intelligence-generated content (AIGC) has emerged.

AIGC uses artificial intelligence to assist or replace manual content generation by generating content based on user-inputted keywords or requirements.
The development of large model algorithms has significantly strengthened the capabilities of AIGC, which makes AIGC products a promising generative tool and adds convenience to our lives.
As an upstream technology, AIGC has unlimited potential to support different downstream applications.

Built on

J. Lawrence, Introduction to Neural Networks . California Scientific Software, 1993
1993
Earlier work this paper cites.
L. O. Chua and T. Roska, “The CNN paradigm,” IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications , vol. 40, no. 3, pp. 147–156, 1993
1993
Earlier work this paper cites.
C. M. Bishop, “Neural networks and their applications,” Review of Scientific Instruments , vol. 65, no. 6, pp. 1803–1832, 1994
1994
Earlier work this paper cites.
M. Bates, “Models of natural language understanding,” National Academy of Sciences , vol. 92, no. 22, pp. 9977–9982, 1995
1995
Earlier work this paper cites.
T. M. Mitchell and T. M. Mitchell, Machine Learning . McGraw-hill New York, 1997, vol. 1, no. 9
1997
Earlier work this paper cites.
M. Pollefeys and L. V. Gool, “From images to 3D models,” Communications of the ACM , vol. 45, no. 7, pp. 50–55, 2002
2002
Earlier work this paper cites.
S. Stumpf, V. Rajaram, L. Li, M. Burnett, T. Dietterich, E. Sullivan, R. Drummond, and J. Herlocker, “Toward harnessing user feedback for machine learning,” in 12th International Conference on Intelligent User Interfaces , 2007, pp. 82–91
2007
Earlier work this paper cites.
X. Wu, V. Kumar, J. Ross Quinlan, J. Ghosh, Q. Yang, H. Motoda, G. J. McLachlan, A. Ng, B. Liu, P. S. Yu, Z. Zhou, M. Steinbach, D. J. Hand, and D. Steinberg, “Top 10 algorithms in data mining,” Knowledge and Information Systems , vol. 14, pp. 1–37, 2008
2008
Earlier work this paper cites.
D. L. Olson and D. Delen, Advanced data mining techniques . Springer Science & Business Media, 2008
2008
Earlier work this paper cites.
J. Zhang, “Multi-source remote sensing data fusion: Status and trends,” International Journal of Image and Data Fusion , vol. 1, no. 1, pp. 5–24, 2010
2010
Earlier work this paper cites.
K. E. Jennings, “Developing creativity: Artificial barriers in artificial intelligence,” Minds and Machines , vol. 20, pp. 489–501, 2010
2010
Earlier work this paper cites.
A. Bahrammirzaee, “A comparative survey of artificial intelligence applications in finance: Artificial neural networks, expert system and hybrid intelligent systems,” Neural Computing and Applications , vol. 19, no. 8, pp. 1165–1195, 2010
2010
Earlier work this paper cites.
R. M. Joshi, S. Tao, P. Aaron, and B. Quiroz, “Cognitive component of componential model of reading applied to different orthographies,” Journal of Learning Disabilities , vol. 45, no. 5, pp. 480–486, 2012
2012
Earlier work this paper cites.
J. Kim, “The institutionalization of YouTube: From user-generated content to professionally generated content,” Media, Culture & Society , vol. 34, no. 1, pp. 53–67, 2012
2012
Earlier work this paper cites.
J. Han, M. Kamber, and J. Pei, “Data mining concepts and techniques third edition,” University of Illinois at Urbana-Champaign Micheline Kamber Jian Pei Simon Fraser University , 2012
2012
Earlier work this paper cites.
J. He, M. Zhou, and L. Jiang, “Generating chinese classical poems with statistical machine translation models,” in 26th AAAI Conference on Artificial Intelligence , 2012, pp. 1650–1656
2012
Earlier work this paper cites.
D. Chen and H. Zhao, “Data security and privacy protection issues in cloud computing,” in International Conference on Computer Science and Electronics Engineering . IEEE, 2012, pp. 647–651
2012
Earlier work this paper cites.
V. Bolón-Canedo, N. Sánchez-Maroño, and A. Alonso-Betanzos, “A review of feature selection methods on synthetic data,” Knowledge and Information Systems , vol. 34, pp. 483–519, 2013
2013
Earlier work this paper cites.
J. Koutnik, K. Greff, F. Gomez, and J. Schmidhuber, “A clockwork RNN,” in International Conference on Machine Learning . PMLR, 2014, pp. 1863–1871
2014
Earlier work this paper cites.
D. P. Kingma and M. Welling, “Auto-encoding variational bayes,” in 2nd International Conference on Learning Representations , 2014
2014
Earlier work this paper cites.
M. David Stone and N. David Woodcock, “Interactive, direct and digital marketing: A future that depends on better use of business intelligence,” Journal of Research in Interactive Marketing , vol. 8, no. 1, pp. 4–17, 2014
2014
Earlier work this paper cites.
Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature , vol. 521, no. 7553, pp. 436–444, 2015
2015
Earlier work this paper cites.
D. Rezende and S. Mohamed, “Variational inference with normalizing flows,” in International Conference on Machine Learning . PMLR, 2015, pp. 1530–1538
2015
Earlier work this paper cites.
Z. Ghahramani, “Probabilistic machine learning and artificial intelligence,” Nature , vol. 521, no. 7553, pp. 452–459, 2015
2015
Earlier work this paper cites.
R. L. Jackson, P. Hoffman, G. Pobric, and M. A. Lambon Ralph, “The nature and neural correlates of semantic association versus conceptual similarity,” Cerebral Cortex , vol. 25, no. 11, pp. 4319–4333, 2015
2015
Earlier work this paper cites.
Y. Zhang, M. Chen, and L. Liu, “A review on text mining,” in 6th IEEE International Conference on Software Engineering and Service Science . IEEE, 2015, pp. 681–685
2015
Earlier work this paper cites.
A. M. Rush, S. Chopra, and J. Weston, “A neural attention model for abstractive sentence summarization,” in Conference on Empirical Methods in Natural Language Processing . The Association for Computational Linguistics, 2015, pp. 379–389
2015
Earlier work this paper cites.
D. J. Welbourne and W. J. Grant, “Science communication on YouTube: Factors that affect channel and video popularity,” Public Understanding of Science , vol. 25, no. 6, pp. 706–718, 2016
2016
Earlier work this paper cites.
I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning . MIT press, 2016
2016
Earlier work this paper cites.
L. Dong and M. Lapata, “Language to logical form with neural attention,” in 54th Annual Meeting of the Association for Computational Linguistics . The Association for Computer Linguistics, 2016, pp. 33–43
2016
Earlier work this paper cites.
P. Jain, M. Gyanchandani, and N. Khare, “Big data privacy: A technological perspective and review,” Journal of Big Data , vol. 3, pp. 1–25, 2016
2016
Earlier work this paper cites.
S. Reed, Z. Akata, X. Yan, L. Logeswaran, B. Schiele, and H. Lee, “Generative adversarial text to image synthesis,” in International Conference on Machine Learning . PMLR, 2016, pp. 1060–1069
2016
Earlier work this paper cites.
S. Chopra, M. Auli, and A. M. Rush, “Abstractive sentence summarization with attentive recurrent neural networks,” in The Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , 2016, pp. 93–98
2016
Earlier work this paper cites.
A. See, P. J. Liu, and C. D. Manning, “Get to the point: Summarization with pointer-generator networks,” in 55th Annual Meeting of the Association for Computational Linguistics , 2017, pp. 1073–1083
2017
Earlier work this paper cites.
L. Yu, W. Zhang, J. Wang, and Y. Yu, “Seqgan: Sequence generative adversarial nets with policy gradient,” in AAAI conference on artificial intelligence , vol. 31, no. 1, 2017, pp. 2852–2858
2017
Earlier work this paper cites.
V. Sze, Y.-H. Chen, J. Emer, A. Suleiman, and Z. Zhang, “Hardware for machine learning: Challenges and opportunities,” in IEEE Custom Integrated Circuits Conference . IEEE, 2017, pp. 1–8
2017
Earlier work this paper cites.
M. Rabinovich, M. Stern, and D. Klein, “Abstract syntax networks for code generation and semantic parsing,” in 55th Annual Meeting of the Association for Computational Linguistics . Association for Computational Linguistics, 2017, pp. 1139–1149
2017
Earlier work this paper cites.
P. Yin and G. Neubig, “A syntactic neural model for general-purpose code generation,” in 55th Annual Meeting of the Association for Computational Linguistics . Association for Computational Linguistics, 2017, pp. 440–450
2017
Earlier work this paper cites.
S. Sun, C. Luo, and J. Chen, “A review of natural language processing techniques for opinion mining systems,” Information Fusion , vol. 36, pp. 10–25, 2017
2017
Earlier work this paper cites.

Similar

A. L’heureux, K. Grolinger, H. F. Elyamany, and M. A. Capretz, “Machine learning with big data: Challenges and approaches,” IEEE Access , vol. 5, pp. 7776–7797, 2017
2017
Cited alongside, same era.
H. Zhang, C. Liu, M. Zhang, and R. Zhu, “A hot spot clustering method based on improved kmeans algorithm,” in 14th International Computer Conference on Wavelet Active Media Technology and Information Processing . IEEE, 2017, pp. 32–35
2017
Cited alongside, same era.
J. Hayes and G. Danezis, “Generating steganographic images via adversarial training,” Advances in Neural Information Processing Systems , vol. 30, pp. 1–10, 2017
2017
Cited alongside, same era.
S. Wu, J. Wieland, O. Farivar, and J. Schiller, “Automatic alt-text: Computer-generated image descriptions for blind users on a social network service,” in ACM Conference on Computer Supported Cooperative Work and Social Computing , 2017, pp. 1180–1192
2017
Cited alongside, same era.
S. Song, H. Chen, and Z. Shi, “Intension classification of user queries in intelligent customer service system,” in International Conference on Asian Language Processing . IEEE, 2017, pp. 83–86
2017
Cited alongside, same era.
F. Jiang, Y. Jiang, H. Zhi, Y. Dong, H. Li, S. Ma, Y. Wang, Q. Dong, H. Shen, and Y. Wang, “Artificial intelligence in healthcare: Past, present and future,” Stroke and Vascular Neurology , vol. 2, no. 4, 2017
2017
Cited alongside, same era.
Z. Li, J. Cai, S. He, and H. Zhao, “Seq2seq dependency parsing,” in 27th International Conference on Computational Linguistics , 2018, pp. 3203–3214
2018
Cited alongside, same era.
W. J. Dally, C. T. Gray, J. Poulton, B. Khailany, J. Wilson, and L. Dennison, “Hardware-enabled artificial intelligence,” in IEEE Symposium on VLSI Circuits . IEEE, 2018, pp. 3–6
2018
Cited alongside, same era.
J. Lehtinen, J. Munkberg, J. Hasselgren, S. Laine, T. Karras, M. Aittala, and T. Aila, “Noise2Noise: Learning image restoration without clean data,” in 35th International Conference on Machine Learning , vol. 80. PMLR, 2018, pp. 2971–2980
2018
Cited alongside, same era.
A. El Saddik, “Digital twins: The convergence of multimedia technologies,” IEEE Multimedia , vol. 25, no. 2, pp. 87–92, 2018
2018
Cited alongside, same era.
K. Amit, Artificial Intelligence and Soft Computing: Behavioral and Cognitive Modeling of the Human Brain . CRC press, 2018
2018
Cited alongside, same era.
C. Yuan, J. Wu, H. Li, and L. Wang, “Personality recognition based on user generated content,” in 15th International Conference on Service Systems and Service Management . IEEE, 2018, pp. 1–6
2018
Cited alongside, same era.

Then

S. Gao, Y. Liu, Y. Kang, and F. Zhang, “User-generated content: A promising data source for urban informatics,” Urban Informatics , pp. 503–522, 2021
2021
Later among the works it cites.
H. Ren, H. Dai, Z. Dai, M. Yang, J. Leskovec, D. Schuurmans, and B. Dai, “Combiner: Full attention transformer with sparse computation cost,” Advances in Neural Information Processing Systems , vol. 34, pp. 22 470–22 482, 2021
2021
Later among the works it cites.
E. Hoogeboom, A. A. Gritsenko, J. Bastings, B. Poole, R. v. d. Berg, and T. Salimans, “Autoregressive diffusion models,” in 10th International Conference on Learning Representations , 2021, pp. 1–23
2021
Later among the works it cites.
B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng, “Nerf: Representing scenes as neural radiance fields for view synthesis,” Communications of the ACM , vol. 65, no. 1, pp. 99–106, 2021
2021
Later among the works it cites.
A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark et al. , “Learning transferable visual models from natural language supervision,” in International Conference on Machine Learning . PMLR, 2021, pp. 8748–8763
2021
Later among the works it cites.
X. Han, Z. Zhang, N. Ding, Y. Gu, X. Liu, Y. Huo, J. Qiu, Y. Yao, A. Zhang, L. Zhang et al. , “Pre-trained models: Past, present and future,” AI Open , vol. 2, pp. 225–250, 2021
2021
Later among the works it cites.
D. C. Geary, “Mitochondrial functioning and the relations among health, cognition, and aging: where cell biology meets cognitive science,” International Journal of Molecular Sciences , vol. 22, no. 7, p. 3562, 2021
2021
Later among the works it cites.
Y. Xu, X. Liu, X. Cao, C. Huang, E. Liu, S. Qian, X. Liu, Y. Wu, F. Dong, C.-W. Qiu et al. , “Artificial intelligence: A powerful paradigm for scientific research,” The Innovation , vol. 2, no. 4, pp. 1–21, 2021
2021
Later among the works it cites.
S. I. Nikolenko, Synthetic Data for Deep Learning . Springer, 2021, vol. 174
2021
Later among the works it cites.
L. Zhuang, L. Wayne, S. Ya, and Z. Jun, “A robustly optimized BERT pre-training approach with post-training,” in 20th Chinese National Conference on Computational Linguistics , 2021, pp. 1218–1227
2021
Later among the works it cites.
M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. d. O. Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman et al. , “Evaluating large language models trained on code,” arXiv preprint arXiv:2107.03374 , 2021
Original
2021
Later among the works it cites.
J. Austin, A. Odena, M. Nye, M. Bosma, H. Michalewski, D. Dohan, E. Jiang, C. Cai, M. Terry, Q. Le et al. , “Program synthesis with large language models,” arXiv preprint arXiv:2108.07732 , 2021
Original
2021
Later among the works it cites.
M.-F. de Lima-Santos and W. Ceron, “Artificial intelligence in news media: Current perceptions and future outlook,” Journalism and Media , vol. 3, no. 1, pp. 13–26, 2021
2021
Later among the works it cites.
Y. Wan and M. Ren, “New visual expression of anime film based on artificial intelligence and machine learning technology,” Journal of Sensors , vol. 2021, pp. 1–10, 2021
2021
Later among the works it cites.
H. Ning, H. Wang, Y. Lin, W. Wang, S. Dhelim, F. Farha, J. Ding, and M. Daneshmand, “A survey on metaverse: the state-of-the-art, technologies, applications, and challenges,” arXiv preprint arXiv:2111.09673 , 2021
Original
2021
Later among the works it cites.
W. Sun, X. Min, W. Lu, and G. Zhai, “A deep learning based no-reference quality assessment model for UGC videos,” in 30th ACM International Conference on Multimedia , 2022, pp. 856–865
2022
Later among the works it cites.
S. Loeschcke, S. Belongie, and S. Benaim, “Text-driven stylization of video objects,” in Computer Vision – ECCV Workshops , 2022, pp. 594–609
2022
Later among the works it cites.
Z. Lv and S. Xie, “Artificial intelligence in the digital twins: State of the art, challenges, and future research topics,” Digital Twin , vol. 1, no. 12, pp. 1–12, 2022
2022
Later among the works it cites.
H.-Y. Lin, “Large-scale artificial intelligence models,” Computer , vol. 55, no. 05, pp. 76–80, 2022
2022
Later among the works it cites.
D. Adams and K.-M. Chuah, “Artificial intelligence-based tools in research writing: Current trends and future potentials,” Artificial Intelligence in Higher Education , pp. 169–184, 2022
2022
Later among the works it cites.
D. Ippolito, A. Yuan, A. Coenen, and S. Burnam, “Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers,” arXiv preprint arXiv:2211.05030 , pp. 1–18, 2022
Original
2022
Later among the works it cites.
S. Mystakidis, “Metaverse,” Encyclopedia , vol. 2, no. 1, pp. 486–497, 2022
2022
Later among the works it cites.
Z. Chen, J. Wu, W. Gan, and Z. Qi, “Metaverse security and privacy: An overview,” in IEEE International Conference on Big Data . IEEE, 2022, pp. 2950–2959
2022
Later among the works it cites.
J. Sun, W. Gan, H.-C. Chao, and P. S. Yu, “Metaverse: Survey, applications, security, and opportunities,” arXiv preprint arXiv:2210.07990 , 2022
Original
2022
Later among the works it cites.
J. Sun, W. Gan, Z. Chen, J. Li, and P. S. Yu, “Big data meets metaverse: A survey,” arXiv preprint arXiv:2210.16282 , pp. 1–17, 2022
Original
2022
Later among the works it cites.
L. Bonifacio, H. Abonizio, M. Fadaee, and R. Nogueira, “InPars: Data augmentation for information retrieval using large language models,” arXiv preprint arXiv:2202.05144 , 2022
Original
2022
Later among the works it cites.
S. S. Shuvo and Y. Yilmaz, “Home energy recommendation system (HERS): A deep reinforcement learning method based on residents’ feedback and activity,” IEEE Transactions on Smart Grid , vol. 13, no. 4, pp. 2812–2821, 2022
2022
Later among the works it cites.
B. Guembe, A. Azeta, S. Misra, V. C. Osamor, L. Fernandez-Sanz, and V. Pospelova, “The Emerging Threat of AI-driven Cyber Attacks: A review,” Applied Artificial Intelligence , vol. 36, no. 1, pp. 1–35, 2022
2022
Later among the works it cites.
Q. Dong, L. Li, D. Dai, C. Zheng, Z. Wu, B. Chang, X. Sun, J. Xu, and Z. Sui, “A survey for in-context learning,” arXiv preprint arXiv:2301.00234 , 2022
Original
2022
Later among the works it cites.
K. Roose, “An AI-generated picture won an art prize: Artists aren’t happy,” 2022. [Online]. Available: https://www.nytimes.com/2022/09/02/technology/ai-artificial-intelligence-artists.html
2022
Later among the works it cites.
T. Wu, M. Terry, and C. J. Cai, “AI chains: Transparent and controllable human-AI interaction by chaining large language model prompts,” in The CHI Conference on Human Factors in Computing Systems , 2022, pp. 1–22
2022
Later among the works it cites.
U. Singer, A. Polyak, T. Hayes, X. Yin, J. An, S. Zhang, Q. Hu, H. Yang, O. Ashual, O. Gafni, D. Parikh, S. Gupta, Y. Taigman, and MetaAI, “Make-a-video: Text-to-video generation without text-video data,” arXiv preprint arXiv:2209.14792 , pp. 1–13, 2022
Original
2022
Later among the works it cites.
M. Reisenbichler, T. Reutterer, D. A. Schweidel, and D. Dan, “Frontiers: Supporting content marketing with natural language generation,” Marketing Science , vol. 41, no. 3, pp. 441–452, 2022
2022
Later among the works it cites.
H. Lin, S. Wan, W. Gan, J. Chen, and H.-C. Chao, “Metaverse in education: Opportunities and challenges,” in IEEE International Conference on Big Data . IEEE, 2022, pp. 2857–2866
2022
Later among the works it cites.
W. Gan, Z. Ye, S. Wan, and P. S. Yu, “Web 3.0: The future of Internet,” in Companion Proceedings of the ACM Web Conference , 2023, pp. 1–10
2023
Closest in time.
X. Wang, G. Chen, G. Qian, P. Gao, X.-Y. Wei, Y. Wang, Y. Tian, and W. Gao, “Large-scale multi-modal pre-trained models: A comprehensive survey,” arXiv preprint arXiv:2302.10035 , 2023
Original
2023
Closest in time.
S. Sun, Y. Liu, D. Iter, C. Zhu, and M. Iyyer, “How does in-context learning help prompt tuning?” arXiv preprint arXiv:2302.11521 , 2023
Original
2023
Closest in time.
Y. Shen, L. Heacock, J. Elias, K. D. Hentel, B. Reig, G. Shih, and L. Moy, “ChatGPT and other large language models are double-edged swords,” p. 230163, 2023
2023
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…