Department of Electrical Engineering and Computer Science
Information, Computing, and Intelligence Laboratory
1. Journal Articles
Compression By and For Deep Boltzmann Machines
- Title
- Compression By and For Deep Boltzmann Machines
- Author(s)
- Li, Qing ; Chen, Yang ; Kim, Yongjune
- Issued Date
- 2020-12
- Citation
- IEEE Transactions on Communications, v.68, no.12, pp.7498 - 7510
- Type
- Article
- Author Keywords
- Image coding ; Rate-distortion ; Noise reduction ; Machine learning ; Training ; Distortion ; Source coding ; Rate distortion ; lossy source coding ; deep Boltzmann machines ; deep auto-encoder ; Blahut-Arimoto algorithm ; denoising
- Keywords
- CAPACITY ; CODES ; REPRESENTATIONS ; INFORMATION
- ISSN
- 0090-6778
- Abstract
- We answer two questions in this work: what Deep Boltzmann Machines (DBMs) can do for compression and vise versa. We show that (1) DBMs can be applied to learn the rate distortion approaching posterior as in the Blahut-Arimoto (BA) algorithm, and to construct a lossy source compression scheme based on the Deep AutoEncoder; (2) compression can improve DBMs' training performances via compression-based denoising algorithms. The implementation of the BA algorithm in the form of DBMs is the foundation of the two applications. © 1972-2012 IEEE.
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Files in This Item:
-
There are no files associated with this item.
Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.