Generating Visual Stories with Grounded and Coreferent Characters

Character-centric storytelling

Original

Aditya Surikuchi and Jorma Laaksonen. 2019 · 1909

Earlier work this paper cites.

The hungarian method for the assignment problem

Harold W Kuhn. 1955 · 1955

Earlier work this paper cites.

Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel

J Peter Kincaid, Robert P Fishburne Jr, Richard L Rogers, and Brad S Chissom. 1975 · 1975

Earlier work this paper cites.

Evaluation metrics for end-to-end coreference resolution systems

Jie Cai and Michael Strube. 2010a · 2010

Earlier work this paper cites.

Evaluation metrics for end-to-end coreference resolution systems

Jie Cai and Michael Strube. 2010b · 2010

Earlier work this paper cites.

Learning latent personas of film characters

David Bamman, Brendan O’Connor, and Noah A. Smith. 2013 · 2013

Earlier work this paper cites.

Facenet: A unified embedding for face recognition and clustering

Florian Schroff, Dmitry Kalenichenko, and James Philbin. 2015 · 2015

Earlier work this paper cites.

Visual storytelling

Ting-Hao Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, et al. 2016 · 2016

Earlier work this paper cites.

Visual relationship detection with language priors

Cewu Lu, Ranjay Krishna, Michael Bernstein, and Li Fei-Fei. 2016 · 2016

Earlier work this paper cites.

Unitbox: An advanced object detection network

Jiahui Yu, Yuning Jiang, Zhangyang Wang, Zhimin Cao, and Thomas Huang. 2016 · 2016

Earlier work this paper cites.

Contextualize, show and tell: A neural visual storyteller

Original

Diana Gonzalez-Rico and Gibran Fuentes-Pineda. 2018 · 2018

Earlier work this paper cites.

The steep road to happily ever after: an analysis of current visual storytelling models

Yatri Modi and Natalie Parde. 2019 · 2019

Earlier work this paper cites.

Knowledgeable storyteller: A commonsense-driven generative model for visual storytelling

Pengcheng Yang, Fuli Luo, Peng Chen, Lei Li, Zhiyi Yin, Xiaodong He, and Xu Sun. 2019 · 2019

Earlier work this paper cites.

Plan-and-write: Towards better automatic storytelling

Lili Yao, Nanyun Peng, Ralph Weischedel, Kevin Knight, Dongyan Zhao, and Rui Yan. 2019 · 2019

Earlier work this paper cites.

End-to-end object detection with transformers

Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko. 2020 · 2020

Earlier work this paper cites.

Content planning for neural story generation with aristotelian rescoring

Seraphina Goldfarb-Tarrant, Tuhin Chakrabarty, Ralph Weischedel, and Nanyun Peng. 2020 · 2020

Earlier work this paper cites.

Diverse and relevant visual storytelling with scene graph embeddings

Xudong Hong, Rakshith Shetty, Asad Sayeed, Khushboo Mehra, Vera Demberg, and Bernt Schiele. 2020 · 2020

Earlier work this paper cites.

Knowledge-enriched visual storytelling

Chao-Chun Hsu, Zi-Yuan Chen, Chi-Yang Hsu, Chih-Chia Li, Tzu-Yuan Lin, Ting-Hao Huang, and Lun-Wei Ku. 2020 · 2020

Earlier work this paper cites.

What makes a good story? designing composite rewards for visual storytelling

Junjie Hu, Yu Cheng, Zhe Gan, Jingjing Liu, Jianfeng Gao, and Graham Neubig. 2020 · 2020

Earlier work this paper cites.

Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension

Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020 · 2020

Earlier work this paper cites.

A character-centric neural model for automated story generation

Danyang Liu, Juntao Li, Meng-Hsuan Yu, Ziming Huang, Gongshen Liu, Dongyan Zhao, and Rui Yan. 2020 · 2020

Cited alongside, same era.

Deepspeed: System optimizations enable training deep learning models with over 100 billion parameters

Jeff Rasley, Samyam Rajbhandari, Olatunji Ruwase, and Yuxiong He. 2020 · 2020

Cited alongside, same era.

Storytelling from an image stream using scene graphs

Ruize Wang, Zhongyu Wei, Piji Li, Qi Zhang, and Xuanjing Huang. 2020 · 2020

Cited alongside, same era.

“let your characters tell their story”: A dataset for character-centric narrative understanding

Faeze Brahman, Meng Huang, Oyvind Tafjord, Chao Zhao, Mrinmaya Sachan, and Snigdha Chaturvedi. 2021 · 2021

Cited alongside, same era.

Commonsense knowledge aware concept selection for diverse and informative visual storytelling

Hong Chen, Yifei Huang, Hiroya Takamura, and Hideki Nakayama. 2021 · 2021

Cited alongside, same era.

Segment anything

Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, et al. 2023 · 2023

Later among the works it cites.

Are large language models robust zero-shot coreference resolvers?

Original

Nghia T Le and Alan Ritter. 2023 · 2023

Later among the works it cites.

Mimic-it: Multi-modal in-context instruction tuning

Original

Bo Li, Yuanhan Zhang, Liangyu Chen, Jinghao Wang, Fanyi Pu, Jingkang Yang, Chunyuan Li, and Ziwei Liu. 2023 · 2023

Later among the works it cites.

Detecting and grounding important characters in visual stories

Danyang Liu and Frank Keller. 2023 · 2023

Later among the works it cites.

Visual storytelling with question-answer plans

Original

Danyang Liu, Mirella Lapata, and Frank Keller. 2023 · 2023

Later among the works it cites.