2024

Process-and-Forward: Deep Joint Source-Channel Coding Over Cooperative Relay Networks

Bian, Chenghong, Shao, Yulin, Wu, Haotian et al.

Understand

We introduce deep joint source-channel coding (DeepJSCC) schemes for image transmission over cooperative relay channels.

The relay either amplifies-and-forwards its received signal, called DeepJSCC-AF, or leverages neural networks to extract relevant features from its received signal, called DeepJSCC-PF (Process-and-Forward).
We consider both half- and full-duplex relays, and propose a novel transformer-based model at the relay.
For a half-duplex relay, it is shown that the proposed scheme learns to generate correlated signals at the relay and source to obtain beamforming gains.

Built on

“The rate-distortion function for source coding with side information at the decoder,”
A. Wyner and J. Ziv, · 1976
Earlier work this paper cites.
“Capacity theorems for the relay channel,”
T. Cover and A.E. Gamal, · 1979
Earlier work this paper cites.
“User cooperation diversity. Part I
A. Sendonaris, E. Erkip, and B. Aazhang, · 2003
Earlier work this paper cites.
“Capacity bounds and power allocation for wireless relay channels,”
A. Host-Madsen and J. Zhang, · 2005
Earlier work this paper cites.
“Cooperative strategies and capacity theorems for relay networks,”
G. Kramer, M. Gastpar, and P. Gupta, · 2005
Earlier work this paper cites.
“Slepian-wolf coded nested lattice quantization for wyner-ziv coding: High-rate performance analysis and code design,”
Z. Liu, S. Cheng, A.D. Liveris, and Z. Xiong, · 2006
Earlier work this paper cites.
“Cooperative source and channel coding for wireless multimedia communications,”
H.-Y. Shutoy, D. Gündüz, E. Erkip, and Y. Wang, · 2007
Earlier work this paper cites.
“Compress-forward coding with BPSK
M. Uppal, Z. Liu, V. Stankovic, and Z. Xiong, · 2009
Earlier work this paper cites.
Network Information Theory
A.E. Gamal and Y.-H. Kim, · 2011
Earlier work this paper cites.
“Reliable joint source-channel cooperative transmission over relay networks,”
D. Gündüz, E. Erkip, A. Goldsmith, and H.-V. Poor, · 2013
Earlier work this paper cites.
“Low-density lattice codes for full-duplex relay channels,”
N. S. Ferdinand, M. Nokleby, and B. Aazhang, · 2015
Earlier work this paper cites.
“Deep learning face attributes in the wild,”
Z. Liu, P. Luo, X. Wang, and X. Tang, · 2015
Earlier work this paper cites.
“Capacity of a class of state-dependent orthogonal relay channels,”
I. Estella Aguerri and D. Gündüz, · 2016
Earlier work this paper cites.

Similar

“Attention is all you need,”
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, · 2017
Cited alongside, same era.
“Deep joint source-channel coding for wireless image transmission,”
E. Bourtsoulatze, D. B. Kurka, and D. Gündüz, · 2019
Cited alongside, same era.
“An image is worth 16x16 words: Transformers for image recognition at scale,”
A. Dosovitskiy et al · 2021
Cited alongside, same era.
“Wireless image transmission using deep source channel coding with attention modules,”
J. Xu, B. Ai, W. Chen, A. Yang, P. Sun, and M. Rodrigues, · 2021
Cited alongside, same era.
“Nonlinear transform source-channel coding for semantic communications,”
J. Dai, S. Wang, K. Tan, Z. Si, X. Qin, K. Niu, and P. Zhang, · 2022
Cited alongside, same era.
“Semantic communications with discrete-time analog transmission: A papr perspective,”
Y. Shao and D. Gündüz, · 2022
Cited alongside, same era.
“ DeepWiVe
T.-Y. Tung and D. Gündüz, · 2022
Cited alongside, same era.
“All you need is feedback: Communication with block attention feedback codes,”
E. Ozfatura, Y. Shao, A. G. Perotti, B. M. Popović, and D. Gündüz, · 2022
Cited alongside, same era.
“ DeepJSCC-Q
T.-Y. Tung, D. B. Kurka, M. Jankowski, and D. Gündüz, · 2022
Cited alongside, same era.
“Twins: Revisiting the design of spatial attention in vision transformers,”
X. Chu, Z. Tian, Y. Wang, B. Zhang, H. Ren, X. Wei, H. Xia, and C. Shen, · 2022
Cited alongside, same era.
“Deep joint source-channel coding for semantic communications,”
J. Xu, T.-Y. Tung, B. Ai, W. Chen, Y. Sun, and D. Gündüz, · 2023
Cited alongside, same era.
“On the role of ViT
H. Yoo, L. Dai, S. Kim, and C.-B. Chae, · 2023
Cited alongside, same era.

Then

“Space-time design for deep joint source channel coding of images over MIMO
C. Bian, Y. Shao, H. Wu, and D. Gündüz, · 2023
Later among the works it cites.
“Wireless deep video semantic transmission,”
S. Wang, J. Dai, Z. Liang, K. Niu, Z. Si, C. Dong, X. Qin, and P. Zhang, · 2023
Later among the works it cites.
“Semantic-preserved communication system for highly efficient speech transmission,”
T. Han, Q. Yang, Z. Shi, S. He, and Z. Zhang, · 2023
Later among the works it cites.
“Distributed deep joint source-channel coding over a multiple access channel,”
S. F. Yilmaz, C. Karamanli, and D. Gündüz, · 2023
Later among the works it cites.
“Fusion-based multi-user semantic communications for wireless image transmission over degraded broadcast channels,”
Original
T. Wu, Z. Chen, M. Tao, B. Xia, and W. Zhang, · 2023
Later among the works it cites.
“Semantic communication on multi-hop concatenated relay networks,”
Y. Yin, L. Huang, Q. Li, B. Tang, A. Pandharipande, and X. Ge, · 2023
Later among the works it cites.
“ DeepJSCC
C. Bian, Y. Shao, and D. Gündüz, · 2023
Later among the works it cites.
“Deep joint source-channel coding over cooperative relay networks,”
C. Bian, Y. Shao, H. Wu, and D. Gündüz, · 2024
Closest in time.
“Deep joint source-channel coding for adaptive image transmission over MIMO
H. Wu, Y. Shao, C. Bian, K. Mikolajczyk, and D. Gündüz, · 2024
Closest in time.
“Wireless point cloud transmission,”
C. Bian, Y. Shao, and D. Gündüz, · 2024
Closest in time.
“A relay system for semantic image transmission based on shared feature extraction and hyperprior entropy compression,”
W. An, Z. Bao, H. Liang, C. Dong, and X. Xu, · 2024
Closest in time.
“A hybrid joint source-channel coding scheme for mobile multi-hop networks,”
C. Bian, Y. Shao, and D. Gündüz, · 2024
Closest in time.
“Cooperative semantic communication with on-demand semantic forwarding,”
B. Tang, L. Huang, Q. Li, A. Pandharipande, and X. Ge, · 2024
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…