Fetching the paper…
Reading the bibliography…
With the exponential growth in data volume and the emergence of data-intensive applications, particularly in the field of machine learning, concerns related to resource utilization, privacy, and fairness have become paramount.
C. E. Shannon, “A mathematical theory of communication.” Bell Syst. Tech. J. , vol. 27, no. 3, pp. 379–423, 1948
1948
Earlier work this paper cites.
M. D. Donsker and S. R. S. Varadhan, “Asymptotic evaluation of certain markov process expectations for large time, I,” Communications on Pure and Applied Mathematics , vol. 28, no. 1, pp. 1–47, 1975. [Online]. Available: https://onlinelibrary.wiley.com/doi/abs/10.1002/cpa.3160280102
1975
Earlier work this paper cites.
K. Hornik, M. Stinchcombe, and H. White, “Multilayer feedforward networks are universal approximators,” Neural Networks , vol. 2, no. 5, pp. 359–366, 1989
1989
Earlier work this paper cites.
A. V. Oppenheim, A. S. Willsky, and S. H. Nawab, Signals & systems (2nd ed.) . USA: Prentice-Hall, Inc., 1996
1996
Earlier work this paper cites.
D. Barber and F. Agakov, “The im algorithm: a variational approach to information maximization,” in Proceedings of the 16th International Conference on Neural Information Processing Systems , ser. NIPS’03. Cambridge, MA, USA: MIT Press, 2003, p. 201–208
2003
Earlier work this paper cites.
A. Kraskov, H. Stögbauer, and P. Grassberger, “Estimating mutual information,” Physical review E , vol. 69, no. 6, p. 066138, 2004
2004
Earlier work this paper cites.
A. Goldsmith, Wireless Communications . Cambridge University Press, 2005
2005
Earlier work this paper cites.
A. El Gamal and Y.-H. Kim, Network information theory . Cambridge university press, 2011
2011
Earlier work this paper cites.
L. Bottou, “Online algorithms and stochastic approximations,” in Online Learning and Neural Networks , D. Saad, Ed. Cambridge, UK: Cambridge University Press, 1998, revised, oct 2012. [Online]. Available: http://leon.bottou.org/papers/bottou-98x
2012
Earlier work this paper cites.
R. Socher, A. Perelygin, J. Wu, J. Chuang, C. D. Manning, A. Ng, and C. Potts, “Recursive deep models for semantic compositionality over a sentiment treebank,” in Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing . Seattle, Washington, USA: Association for Computational Linguistics, Oct. 2013, pp. 1631–1642. [Online]. Available: https://www.aclweb.org/anthology/D13-1170
2013
Earlier work this paper cites.
A. Makhdoumi, S. Salamatian, N. Fawaz, and M. Médard, “From the information bottleneck to the privacy funnel,” in IEEE Information Theory Workshop (ITW) , 2014, pp. 501–505
2014
Cited alongside, same era.
X. Chen, Y. Duan, R. Houthooft, J. Schulman, I. Sutskever, and P. Abbeel, “Infogan: Interpretable representation learning by information maximizing generative adversarial nets,” in Advances in Neural Information Processing Systems , D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett, Eds., vol. 29. Curran Associates, Inc., 2016. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2016/file/7c9d0b1f96aebd7b5eca8c3edaa19ebb-Paper.pdf
2016
Cited alongside, same era.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. u. Kaiser, and I. Polosukhin, “Attention is all you need,” in Advances in Neural Information Processing Systems , I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, Eds., vol. 30. Curran Associates, Inc., 2017. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
J. Song and S. Ermon, “Understanding the limitations of variational mutual information estimators,” in International Conference on Learning Representations , 2020. [Online]. Available: https://openreview.net/forum?id=B1x62TNtDS
2020
Later among the works it cites.
K. Song, X. Tan, T. Qin, J. Lu, and T.-Y. Liu, “Mpnet: Masked and permuted pre-training for language understanding,” Advances in Neural Information Processing Systems , vol. 33, pp. 16 857–16 867, 2020
2020
Later among the works it cites.
K. Choi and S. Lee, “Regularized mutual information neural estimation,” 2021. [Online]. Available: https://openreview.net/forum?id=Lvb2BKqL49a
2021
Later among the works it cites.
A. Miglani, “Coronavirus tweets nlp - text classification,” Kaggle.com, 2021. [Online]. Available: https://www.kaggle.com/datasets/datatattle/covid-19-nlp-text-classification
2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2017
Cited alongside, same era.
A. Beutel, J. Chen, Z. Zhao, and E. H. Chi, “Data decisions and theoretical implications when adversarially learning fair representations,” 2017
2017
Cited alongside, same era.
2018
Cited alongside, same era.
A. Radford, K. Narasimhan, T. Salimans, I. Sutskever et al. , “Improving language understanding by generative pre-training,” 2018
2018
Cited alongside, same era.
2018
Cited alongside, same era.
2018
Cited alongside, same era.
A. Williams, N. Nangia, and S. Bowman, “A broad-coverage challenge corpus for sentence understanding through inference,” in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) . Association for Computational Linguistics, 2018, pp. 1112–1122. [Online]. Available: http://aclweb.org/anthology/N18-1101
2018
Cited alongside, same era.
P. Cheng, M. R. Min, D. Shen, C. Malon, Y. Zhang, Y. Li, and L. Carin, “Improving disentangled text representation learning with information-theoretic guidance,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , D. Jurafsky, J. Chai, N. Schluter, and J. Tetreault, Eds. Online: Association for Computational Linguistics, Jul. 2020, pp. 7530–7541. [Online]. Available: https://aclanthology.org/2020.acl-main.673
2020
Cited alongside, same era.
A. Chowdhery, S. Narang, J. Devlin, M. Bosma, G. Mishra, A. Roberts, P. Barham, H. W. Chung, C. Sutton, S. Gehrmann et al. , “Palm: Scaling language modeling with pathways,” Journal of Machine Learning Research , vol. 24, no. 240, pp. 1–113, 2023
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
B. D. Kim, V. A. Vasudevan, J. Woo, A. Cohen, R. G. L. D’Oliveira, T. Stahlbuhk, and M. Médard, “Crypto-mine: Cryptanalysis via mutual information neural estimation,” 2023
2023
Later among the works it cites.
H. Esfahanizadeh, W. Wu, M. Ghobadi, R. Barzilay, and M. Médard, “InfoShape: Task-based neural data shaping via mutual information,” in ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, jun 2023. [Online]. Available: https://doi.org/10.1109%2Ficassp49357.2023.10095632
2023
Later among the works it cites.
G. Ioannides, A. Jadhav, A. Sharma, S. Navali, and A. W. Black, “Compressed models for co-reference resolution: enhancing efficiency with debiased word embeddings,” 2023. [Online]. Available: https://doi.org/10.1038/s41598-023-45677-0
2023
Later among the works it cites.