Fine-tuning and aligning question answering models for complex information extraction tasks

Fine-tuning language models from human preferences

Original

Ziegler, D. M., Stiennon, N., Wu, J., Brown, T. B., Radford, A., Amodei, D., Christiano, P., and Irving, G. (2019) · 1909

Earlier work this paper cites.

Binary codes capable of correcting deletions, insertions, and reversals

Levenshtein, V. I. (1966) · 1966

Earlier work this paper cites.

Bleu: A method for automatic evaluation of machine translation

Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. (2002) · 2002

Earlier work this paper cites.

ROUGE: A package for automatic evaluation of summaries

Lin, C.-Y. (2004) · 2004

Earlier work this paper cites.

The history of information retrieval research

Sanderson, M. and Croft, W. B. (2012) · 2012

Earlier work this paper cites.

Language-independent model for machine translation evaluation with reinforced factors

Han, L., Wong, D. F., Chao, L. S., He, L., Lu, Y., Xing, J., and Zeng, X. (2013) · 2013

Earlier work this paper cites.

Squad: 100,000+ questions for machine comprehension of text

Rajpurkar, P., Zhang, J., Lopyrev, K., and Liang, P. (2016) · 2016

Earlier work this paper cites.

Transkribus - a service platform for transcription, recognition and retrieval of historical documents

Kahle, P., Colutto, S., Hackl, G., and Mühlberger, G. (2017) · 2017

Earlier work this paper cites.

Know what you don’t know: Unanswerable questions for squad

Rajpurkar, P., Jia, R., and Liang, P. (2018) · 2018

Earlier work this paper cites.

Ocr-d: An end-to-end open source ocr framework for historical printed documents

Neudecker, C., Baierer, K., Federbusch, M., Boenig, M., Würzner, K.-M., Hartmann, V., and Herrmann, E. (2019) · 2019

Earlier work this paper cites.

Generalizing question answering system with pre-trained language model fine-tuning

Su, D., Xu, Y., Winata, G. I., Xu, P., Kim, H., Liu, Z., and Fung, P. (2019) · 2019

Earlier work this paper cites.

Goal-based evaluation of text mining results in an industrial use case

Drawehn, J., Blohm, M., Kintz, M., and Kochanowski, M. (2020) · 2020

Cited alongside, same era.

Make your Customers Happy Again. AI and NLP for a Customer Complaint Management Platform

Kintz, M., Dukino, C., Blohm, M., and Hanussek, M. (2020) · 2020

Cited alongside, same era.

Transformers: State-of-the-art natural language processing

Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., Davison, J., Shleifer, S., von Platen, P., Ma, C., Jernite, Y., Plu, J., Xu, C., Scao, T. L., Gugger, S., Drame, M., Lhoest, Q., and Rush, A. M. (2020) · 2020

Cited alongside, same era.

cushlepor: customising hlepor metric using optuna for higher agreement with human judgments or pre-trained language model labse

Han, L., Sorokina, I., Erofeev, G., and Gladkoff, S. (2021) · 2021

Cited alongside, same era.

How can we know when language models know? on the calibration of language models for question answering

Jiang, Z., Araki, J., Ding, H., and Neubig, G. (2021) · 2021

Improving alignment of dialogue agents via targeted human judgements

Glaese, A., McAleese, N., Trebacz, M., Aslanides, J., Firoiu, V., Ewalds, T., Rauh, M., Weidinger, L., Chadwick, M., Thacker, P., Campbell-Gillingham, L., Uesato, J., Huang, P.-S., Comanescu, R., Yang, F., See, A., Dathathri, S., Greig, R., Chen, C., Fritz, D., Elias, J. S., Green, R., Mokrá, S., Fernando, N., Wu, B., Foley, R., Young, S., Gabriel, I., Isaac, W., Mellor, J., Hassabis, D., Kavukcuoglu, K., Hendricks, L. A., and Irving, G. (2022) · 2022

Later among the works it cites.

Illustrating reinforcement learning from human feedback (rlhf)

Lambert, N., Castricato, L., von Werra, L., and Havrilla, A. (2022) · 2022

Later among the works it cites.

Document ai (intelligent document processing)

Microsoft (2022) · 2022

Later among the works it cites.

Training language models to follow instructions with human feedback

Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Gray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., and Lowe, R. (2022) · 2022

Later among the works it cites.

Unifying vision, text, and layout for universal document processing

Tang, Z., Yang, Z., Wang, G., Fang, Y., Liu, Y., Zhu, C., Zeng, M., Zhang, C., and Bansal, M. (2022) · 2022