Voices from the Frontier: A Comprehensive Analysis of the OpenAI Developer Forum

C. B. Seaman, “Qualitative methods in empirical studies of software engineering,” IEEE Transactions on software engineering , vol. 25, no. 4, pp. 557–572, 1999

1999

Earlier work this paper cites.

C. Rosen and E. Shihab, “What are mobile developers asking about? a large scale study using stack overflow,” Empirical Software Engineering , vol. 21, pp. 1192–1223, 2016

2016

Earlier work this paper cites.

P. K. Venkatesh, S. Wang, F. Zhang, Y. Zou, and A. E. Hassan, “What do client developers concern when using web apis? an empirical study on developer forums and stack overflow,” in 2016 IEEE International Conference on Web Services (ICWS) . IEEE, 2016, pp. 131–138

2016

Earlier work this paper cites.

S. Ahmed and M. Bagherzadeh, “What do concurrency developers ask about? a large-scale study using stack overflow,” in Proceedings of the 12th ACM/IEEE international symposium on empirical software engineering and measurement , 2018, pp. 1–10

2018

Earlier work this paper cites.

J. Atwood, “Discourse trust levels,” https://blog.discourse.org/2018/06/understanding-discourse-trust-levels/ , 2018

2018

Earlier work this paper cites.

Z. Wan, X. Xia, and A. E. Hassan, “What do programmers discuss about blockchain? a case study on the use of balanced lda and the reference architecture of a domain to capture online discussions about blockchain platforms across stack exchange communities,” IEEE Transactions on Software Engineering , vol. 47, no. 7, pp. 1331–1349, 2019

2019

Earlier work this paper cites.

T. Zhang, C. Gao, L. Ma, M. Lyu, and M. Kim, “An empirical study of common challenges in developing deep learning applications,” in 2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE) . IEEE, 2019, pp. 104–115

2019

Earlier work this paper cites.

A. Abdellatif, D. Costa, K. Badran, R. Abdalkareem, and E. Shihab, “Challenges in chatbot development: A study of stack overflow posts,” in Proceedings of the 17th international conference on mining software repositories , 2020, pp. 174–185

2020

Earlier work this paper cites.

Z. Chen, Y. Cao, Y. Liu, H. Wang, T. Xie, and X. Liu, “A comprehensive study on challenges in deploying deep learning based software,” in Proceedings of the 28th ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering , 2020, pp. 750–762

2020

Earlier work this paper cites.

J. Han, E. Shihab, Z. Wan, S. Deng, and X. Xia, “What do programmers discuss about deep learning frameworks,” Empirical Software Engineering , vol. 25, pp. 2694–2747, 2020

2020

Earlier work this paper cites.

J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat et al. , “Gpt-4 technical report,” arXiv preprint arXiv:2303.08774 , 2023

Original

2023

Earlier work this paper cites.

X. Hou, Y. Zhao, Y. Liu, Z. Yang, K. Wang, L. Li, X. Luo, D. Lo, J. Grundy, and H. Wang, “Large language models for software engineering: A systematic literature review,” arXiv e-prints , pp. arXiv–2308, 2023

2023

Earlier work this paper cites.

https://community.openai.com/t/gpt-3-5-turbo-api-call-randomly-hangs-indefinitely/293385 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/bug-error-413-the-data-value-transmitted-exceeds-the-capacity-limit-when-calling-v1-images-edits/464513 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/gpt-3-5-turbo-1106-model-consistently-responds-with-unnecessary-and-inappropriate-function-calls-confirmed-bug-jan-26/603102 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/assistant-run-remains-queued-for-a-long-time-ii/547875 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/api-key-bug-insufficient-quota-error-on-paid-account-with-available-balance/717097 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/consistent-billing-bug-causing-account-to-be-negative/706641 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/slow-stream-when-assistant-instructions-exceed-9-000-characters/851660 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/bug-assistants-streaming-responses-thread-message-delta-events-characters-missing/797939 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/gpt-4o-api-bug-cant-take-in-image-url-from-assistant-in-messages-only-user/748357 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/file-upload-and-acting-on-it-in-an-assistant-v2-conversation/856370 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/can-not-add-files-to-vector-store/738145 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/bug-when-upload-js-file-server-replies-openai-badrequesterror-error-code-400/769418 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/has-anyone-noticed-gpt4o-quality-drop-last-few-days/829203 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/gpt-4o-performing-poorly-for-code-related-tasks-why/805602 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/help-openai-fix-over-refusals/409799 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/gpt-4-turbo-refusing-to-follow-instructions/548716 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/refusal-to-work-with-copyrighted-material-in-4-turbo-0125-preview/671453 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/is-api-gpt4-way-less-intelligent-than-chatgpt4/253218 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/problem-of-retrieving-information-from-file-search-playground-vs-api-usage/722245 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/async-api-random-garbage-text-with-gpt-4-turbo-but-not-gpt-4o-or-gpt-3-5-turbo/791641 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/difference-between-gpts-and-using-api/780947 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/audio-issues-on-ios-app-chatgpt/815847 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/chatgpt-app-unable-to-view-conversation-text-while-using-voice-features/792894 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/why-the-quality-of-dall-e3-api-is-significantly-lower-compared-to-the-original/492970 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/whisper-hallucinations-dropped-sentences-help/473368 , Accessed July 16, 2024

2024

Earlier work this paper cites.

https://community.openai.com/t/seeking-advice-on-integrating-tts-1-api-for-reading-pdf-book-aloud/766983 , Accessed July 16, 2024

2024

Cited alongside, same era.

https://community.openai.com/t/batch-api-custom-id-does-not-support-uuid/742152 , Accessed July 16, 2024

2024

Cited alongside, same era.

https://community.openai.com/t/getting-invalid-image-url-in-batch-api/859709 , Accessed July 16, 2024

2024

Cited alongside, same era.

https://community.openai.com/t/error-you-uploaded-an-unsupported-image-please-make-sure-your-image-is-below-20-mb-in-size-and-is-of-one-the-following-formats-png-jpeg-gif-webp/849277 , Accessed July 16, 2024

2024

Cited alongside, same era.

https://community.openai.com/t/getting-intermittent-failed-runs-in-assistant-api-when-generating-images-with-code-interpreter/713062 , Accessed July 16, 2024

2024

https://community.openai.com/t/the-prompt-defender-initiative-advancing-gpt-safety-standards/587766 , Accessed July 16, 2024

2024

Closest in time.

https://community.openai.com/t/what-are-the-latest-strategies-for-prevening-prompt-leaks/725650 , Accessed July 16, 2024

2024

Closest in time.

https://community.openai.com/t/found-a-real-case-of-plugin-innate-security-privacy-breaches/469532 , Accessed July 16, 2024

2024

Closest in time.

https://community.openai.com/t/shouldnt-custom-gpt-remember-what-im-talking-to/740289 , Accessed July 16, 2024

2024

Closest in time.

https://community.openai.com/t/i-need-help-in-generating-reports-using-chatgpt-similar-to-given-template-structure/861669 , Accessed July 16, 2024

2024

Closest in time.