Built on

P. Popovski, O. Simeone, F. Boccardi, D. Gündüz, and O. Sahin, “Semantic-effectiveness filtering and control for post-5g wireless connectivity,” CoRR , vol. abs/1907.02441, 2019. [Online]. Available: http://arxiv.org/abs/1907.02441
Original
1907
Earlier work this paper cites.
C. Odgen and I. Richards, The Meaning of Meaning A Study of the Influence of Language upon Thought and of the Science of Symbolism . London, UK: Routledge & Kegan Paul Ltd., 1923
1923
Earlier work this paper cites.
C. E. Shannon, “A mathematical theory of communication,” The Bell System Technical Journal , vol. 27, no. 3, pp. 379–423, 1948
1948
Earlier work this paper cites.
C. E. Shannon and W. Weaver, A mathematical theory of communication . The University of Illinois Press, Urbana, 1964
1964
Earlier work this paper cites.
R. Sinkhorn, “A relationship between arbitrary positive matrices and doubly stochastic matrices,” The Annals of Mathematical Statistics , vol. 35, no. 2, pp. 876 – 879, 1964
1964
Earlier work this paper cites.
P. Knopp and R. Sinkhorn, “Concerning nonnegative matrices and doubly stochastic matrices.” Pacific Journal of Mathematics , vol. 21, no. 2, pp. 343 – 348, 1967
1967
Earlier work this paper cites.
H. P. Grice, “Logic and conversation,” in The Semantics-Pragmatics Boundary in Philosophy , M. Ezcurdia and R. J. Stainton, Eds. Broadview Press, 1975
1975
Earlier work this paper cites.
S. Vembu, S. Verdu, and Y. Steinberg, “When does the source-channel separation theorem hold?” in Proceedings of 1994 IEEE International Symposium on Information Theory , 1994
1994
Earlier work this paper cites.
J. Bell, Pragmatic Reasoning A model-based theory , M. Masuch and L. Pólos, Eds. Kluwer Academic Publishers, Amsterdam, 1995
1995
Earlier work this paper cites.
——, “Pragmatic reasoning: Inferring contexts,” in Modeling and Using Context , P. Bouquet, M. Benerecetti, L. Serafini, P. Brézillon, and F. Castellani, Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 1999, pp. 42–53
1999
Earlier work this paper cites.
——, “Pragmatic reasoning pragmatic semantics and semantic pragmatics,” in Modeling and Using Context , V. Akman, P. Bouquet, R. Thomason, and R. Young, Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 2001, pp. 45–58
2001
Earlier work this paper cites.
N. Zaslavsky, J. Hu, and R. P. Levy, “A rate-distortion view of human pragmatic reasoning,” CoRR , vol. abs/2005.06641, May 2020. [Online]. Available: http://arxiv.org/abs/2005.06641
Original
2005
Earlier work this paper cites.
A. Lazaridou and M. Baroni, “Emergent multi-agent communication in the deep learning era,” CoRR , vol. abs/2006.02419, 2020. [Online]. Available: https://arxiv.org/abs/2006.02419
Original
2006
Earlier work this paper cites.
M. Kountouris and N. Pappas, “Semantics-empowered communication for networked intelligent systems,” CoRR , vol. abs/2007.11579, 2020. [Online]. Available: https://arxiv.org/abs/2007.11579
Original
2007
Earlier work this paper cites.
D. Kahneman, Thinking, fast and slow . Farrar, Straus and Giroux, 2011
2011
Earlier work this paper cites.

Similar

A. Goyal and Y. Bengio, “Inductive biases for deep learning of higher-level cognition,” CoRR , vol. abs/2011.15091, 2020. [Online]. Available: https://arxiv.org/abs/2011.15091
Original
2011
Cited alongside, same era.
H. Seo, J. Park, S. Oh, M. Bennis, and S. Kim, “Federated knowledge distillation,” CoRR , vol. abs/2011.02367, 2020. [Online]. Available: https://arxiv.org/abs/2011.02367
Original
2011
Cited alongside, same era.
A. Maatouk, M. Assaad, and A. Ephremides, “The age of incorrect information: an enabler of semantics-empowered communication,” CoRR , vol. abs/2012.13214, 2020. [Online]. Available: https://arxiv.org/abs/2012.13214
Original
2012
Cited alongside, same era.
M. C. Frank and N. D. Goodman, “Predicting pragmatic reasoning in language games,” Science , vol. 336, pp. 998 – 998, 2012
2012
Cited alongside, same era.

Then

A. Singh, T. Jain, and S. Sukhbaatar, “Individualized controlled continuous communication model for multiagent cooperative and competitive tasks,” in International Conference on Learning Representations , 2019
2019
Later among the works it cites.
D. Kim et al. , “Learning to schedule communication in multi-agent reinforcement learning,” in International Conference on Learning Representations , 2019
2019
Later among the works it cites.
P. Wang, J. Wang, P. Paranamana, and P. Shafto, “A mathematical theory of cooperative communication,” in Advances in Neural Information Processing Systems , vol. 33, 2020, pp. 17 582–17 593
2020
Later among the works it cites.
Y. Kang, T. Wang, and G. de Melo, “Incorporating pragmatic reasoning communication into emergent language,” CoRR , vol. abs/2006.04109, Jun. 2020
Original
2020
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…

2021

Semantics-Native Communication with Contextual Reasoning

Seo, Hyowoon, Park, Jihong, Bennis, Mehdi et al.

Understand

Spurred by a huge interest in the post-Shannon communication, it has recently been shown that leveraging semantics can significantly improve the communication effectiveness across many tasks.

In this article, inspired by human communication, we propose a novel stochastic model of System 1 semantics-native communication (SNC) for generic tasks, where a speaker has an intention of referring to an entity, extracts the semantics, and communicates its symbolic representation to a target listener.
To further reach its full potential, we additionally infuse contextual reasoning into SNC such that the speaker locally and iteratively self-communicates with a virtual agent built on the physical listener's unique way of coding its semantics, i.e., communication context.
The resultant System 2 SNC allows the speaker to extract the most effective semantics for its listener.

Built on

P. Popovski, O. Simeone, F. Boccardi, D. Gündüz, and O. Sahin, “Semantic-effectiveness filtering and control for post-5g wireless connectivity,” CoRR , vol. abs/1907.02441, 2019. [Online]. Available: http://arxiv.org/abs/1907.02441
Original
1907
Earlier work this paper cites.
C. Odgen and I. Richards, The Meaning of Meaning A Study of the Influence of Language upon Thought and of the Science of Symbolism . London, UK: Routledge & Kegan Paul Ltd., 1923
1923
Earlier work this paper cites.
C. E. Shannon, “A mathematical theory of communication,” The Bell System Technical Journal , vol. 27, no. 3, pp. 379–423, 1948
1948
Earlier work this paper cites.
C. E. Shannon and W. Weaver, A mathematical theory of communication . The University of Illinois Press, Urbana, 1964
1964
Earlier work this paper cites.
R. Sinkhorn, “A relationship between arbitrary positive matrices and doubly stochastic matrices,” The Annals of Mathematical Statistics , vol. 35, no. 2, pp. 876 – 879, 1964
1964
Earlier work this paper cites.
P. Knopp and R. Sinkhorn, “Concerning nonnegative matrices and doubly stochastic matrices.” Pacific Journal of Mathematics , vol. 21, no. 2, pp. 343 – 348, 1967
1967
Earlier work this paper cites.
H. P. Grice, “Logic and conversation,” in The Semantics-Pragmatics Boundary in Philosophy , M. Ezcurdia and R. J. Stainton, Eds. Broadview Press, 1975
1975
Earlier work this paper cites.
S. Vembu, S. Verdu, and Y. Steinberg, “When does the source-channel separation theorem hold?” in Proceedings of 1994 IEEE International Symposium on Information Theory , 1994
1994
Earlier work this paper cites.
J. Bell, Pragmatic Reasoning A model-based theory , M. Masuch and L. Pólos, Eds. Kluwer Academic Publishers, Amsterdam, 1995
1995
Earlier work this paper cites.
——, “Pragmatic reasoning: Inferring contexts,” in Modeling and Using Context , P. Bouquet, M. Benerecetti, L. Serafini, P. Brézillon, and F. Castellani, Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 1999, pp. 42–53
1999
Earlier work this paper cites.
——, “Pragmatic reasoning pragmatic semantics and semantic pragmatics,” in Modeling and Using Context , V. Akman, P. Bouquet, R. Thomason, and R. Young, Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 2001, pp. 45–58
2001
Earlier work this paper cites.
N. Zaslavsky, J. Hu, and R. P. Levy, “A rate-distortion view of human pragmatic reasoning,” CoRR , vol. abs/2005.06641, May 2020. [Online]. Available: http://arxiv.org/abs/2005.06641
Original
2005
Earlier work this paper cites.
A. Lazaridou and M. Baroni, “Emergent multi-agent communication in the deep learning era,” CoRR , vol. abs/2006.02419, 2020. [Online]. Available: https://arxiv.org/abs/2006.02419
Original
2006
Earlier work this paper cites.
M. Kountouris and N. Pappas, “Semantics-empowered communication for networked intelligent systems,” CoRR , vol. abs/2007.11579, 2020. [Online]. Available: https://arxiv.org/abs/2007.11579
Original
2007
Earlier work this paper cites.
D. Kahneman, Thinking, fast and slow . Farrar, Straus and Giroux, 2011
2011
Earlier work this paper cites.

Similar

A. Goyal and Y. Bengio, “Inductive biases for deep learning of higher-level cognition,” CoRR , vol. abs/2011.15091, 2020. [Online]. Available: https://arxiv.org/abs/2011.15091
Original
2011
Cited alongside, same era.
H. Seo, J. Park, S. Oh, M. Bennis, and S. Kim, “Federated knowledge distillation,” CoRR , vol. abs/2011.02367, 2020. [Online]. Available: https://arxiv.org/abs/2011.02367
Original
2011
Cited alongside, same era.
A. Maatouk, M. Assaad, and A. Ephremides, “The age of incorrect information: an enabler of semantics-empowered communication,” CoRR , vol. abs/2012.13214, 2020. [Online]. Available: https://arxiv.org/abs/2012.13214
Original
2012
Cited alongside, same era.
M. C. Frank and N. D. Goodman, “Predicting pragmatic reasoning in language games,” Science , vol. 336, pp. 998 – 998, 2012
2012
Cited alongside, same era.

Then

A. Singh, T. Jain, and S. Sukhbaatar, “Individualized controlled continuous communication model for multiagent cooperative and competitive tasks,” in International Conference on Learning Representations , 2019
2019
Later among the works it cites.
D. Kim et al. , “Learning to schedule communication in multi-agent reinforcement learning,” in International Conference on Learning Representations , 2019
2019
Later among the works it cites.
P. Wang, J. Wang, P. Paranamana, and P. Shafto, “A mathematical theory of cooperative communication,” in Advances in Neural Information Processing Systems , vol. 33, 2020, pp. 17 582–17 593
2020
Later among the works it cites.
Y. Kang, T. Wang, and G. de Melo, “Incorporating pragmatic reasoning communication into emergent language,” CoRR , vol. abs/2006.04109, Jun. 2020
Original
2020
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

N. D. Goodman and A. Stuhlmüller, “Knowledge and implicature: Modeling language understanding as social cognition,” Topics in cognitive science , vol. 5, no. 1, pp. 173–184, 2013

2013

Cited alongside, same era.

M. Cuturi, “Sinkhorn distances: Lightspeed computation of optimal transport,” in Advances in Neural Information Processing Systems , vol. 26, 2013

Original

2013

Cited alongside, same era.

G. Hinton, O. Vinyals, and J. Dean, “Distilling the knowledge in a neural network,” in NIPS Deep Learning and Representation Learning Workshop , 2015. [Online]. Available: http://arxiv.org/abs/1503.02531

Original

2015

Cited alongside, same era.

J. N. Foerster, Y. M. Assael, N. D. Freitas, and S. Whiteson, “Learning to communicate with deep multi-agent reinforcement learning,” in Advances in Neural Information Processing Systems , 2016

2016

Cited alongside, same era.

N. Goodman and M. Frank, “Pragmatic language interpretation as probabilistic inference,” Trends in Cognitive Sciences , vol. 20, no. 11, pp. 818–829, Sep. 2016

2016

Cited alongside, same era.

M. C. Frank, A. G. Emilsson, B. Peloquin, N. D. Goodman, and C. Potts, “Rational speech act models of pragmatic reasoning in reference games,” PsyArXiv , 2016. [Online]. Available: http://psyarxiv.com/f9y6b

2016

Cited alongside, same era.

A. Lazaridou, A. Peysakhovich, and M. Baroni, “Multi-agent cooperation and the emergence of (natural) language,” in International Conference on Learning Representations , 2017

2017

Cited alongside, same era.

R. Lowe et al. , “Multi-agent actor-critic for mixed cooperative-competitive environments,” in Advances in neural information processing systems , 2017

2017

Cited alongside, same era.

W. J. Yun et al. , “Attention-based reinforcement learning for real-time UAV semantic communication,” CoRR , vol. abs/2105.10716, 2021. [Online]. Available: https://arxiv.org/abs/2105.10716

Original

2021

Closest in time.

M. Kalfa et al. , “Towards goal-oriented semantic signal processing: Applications and future challenges,” Digital Signal Processing , vol. 119, p. 103134, 2021. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1051200421001731

2021

Closest in time.

B. Schölkopf et al. , “Toward causal representation learning,” Proceedings of the IEEE , vol. 109, no. 5, pp. 612–634, 2021

2021

Closest in time.

H. Xie, Z. Qin, G. Y. Li, and B.-H. Juang, “Deep learning enabled semantic communication systems,” IEEE Transactions on Signal Processing , vol. 69, pp. 2663–2675, 2021

2021

Closest in time.

H. Xie and Z. Qin, “A lite distributed semantic communication system for internet of things,” IEEE Journal on Selected Areas in Communications , vol. 39, no. 1, pp. 142–153, 2021

2021

Closest in time.

A. M. Girgis, H. Seo, J. Park, M. Bennis, and J. Choi, “Split learning meets koopman theory for wireless remote monitoring and prediction,” CoRR , vol. abs/2104.08109, 2021. [Online]. Available: https://arxiv.org/abs/2104.08109

Original

2021

Closest in time.

E. Calvanese Strinati and S. Barbarossa, “6g networks: Beyond shannon towards semantic and goal-oriented communications,” Computer Networks , vol. 190, p. 107930, 2021

2021

Closest in time.

G. Shi et al. , “A new communication paradigm: from bit accuracy to semantic fidelity,” CoRR , vol. abs/2101.12649, 2021. [Online]. Available: https://arxiv.org/abs/2101.12649

Original

2021

Closest in time.

——, “Predictive closed-loop remote control over wireless two-way split koopman autoencoder,” IEEE Internet of Things Journal , vol. 9, no. 23, pp. 23 285–23 301, 2022

2022

Closest in time.

J. Choi, S. W. Loke, and J. Park, “A unified view on semantic information and communication: A probabilistic logic approach,” arXiv preprint arXiv:2201.05936 , 2022

Original

2022

Closest in time.

J.-H. Lee, H. Seo, J. Park, M. Bennis, and Y.-C. Ko, “Learning emergent random access protocol for leo satellite networks,” IEEE Transactions on Wireless Communications , vol. 22, no. 1, pp. 257–269, 2023

2023

Closest in time.