Multimedia Signal Processing

Images, video, speech, audio, point clouds, light and sound fields… useful information is buried in these signals. We study and develop methods to efficiently sample and represent these signals, remove noise from them, compress them, and recover their missing pieces.

Selected Publications

X. Fan, J. Lei, J. Liang, Y. Fang, X. Cao, and N. Ling, Unsupervised Stereoscopic Image Retargeting via View Synthesis and Stereo Cycle Consistency Losses, Neurocomputing, Aug. 2021. [ScienceDirect] []
C. Dinesh, G. Cheung, and I. V. Bajić, 3D point cloud denoising via feature graph Laplacian regularization, IEEE Trans. Image Processing, Dec. 2020. [IEEEXplore] []
D. Zhang and J. Liang, Graph-based Transform for 2D Piecewise Smooth Signals with Random Discontinuities, IEEE Trans. Image Processing, Apr. 2017. [IEEEXplore] []

Multimedia Communications

With the likes of Netflix, Spotify, and Skype, multimedia communications have become mainstream. But achieving dependable real-time transfer of multimedia signals is still a challenge, especially in the case of demanding immersive applications. We create techniques for error-resilient coding, power and resource management, and error control, to enable efficient and reliable multimedia communications.

Selected Publications

H. Hadizadeh and I. V. Bajić, Soft video multicasting using adaptive compressed sensing, IEEE Trans. Multimedia, Jan. 2021. [arXiv] []
J. Zhang, A. Wang, J. Liang, H. Wang, S. Li, and X. Zhang, Distortion Estimation-based Adaptive Power Allocation for Hybrid Digital-Analog Video Transmission, IEEE Trans. Circuits and Systems for Video Technology, Jun. 2019. [IEEEXplore] []
G. Javadi, A. Hajshirmohammadi, and J. Liang, Power and Sub-channel Optimization of JPEG 2000 Image Transmission over OFDM-Based Cognitive Radio Networks, Signal Processing: Image Communication, Oct. 2017. [ScienceDirect] []

Multimedia Ergonomics

The word ergonomics probably makes you think about comfortable chairs or pillows. But physical objects are not the only things we interact with. You likely spend a good portion of each day looking at images or video, listening to music, or browsing websites. Are these digital objects comfortable? We want to understand how people interact with digital objects, especially multimedia signals, in order to facilitate better user experience and more seamless interaction with our digital environment.

Selected Publications

X. Shang, G. Wang, J. Liang, X. Zhao, H. Han, and Y. Zuo, Color-Sensitivity-based Rate-Distortion Optimization for H.265/HEVC, IEEE Trans. on Circuits and Systems for Video Technology, Feb. 2021. [IEEEXplore] []
H. Hadizadeh and I. V. Bajić, Full-reference objective quality assessment of tone-mapped images, IEEE Trans. Multimedia, Feb. 2018. [ResearchGate] []
V. A. Mateescu and I. V. Bajić, Visual attention retargeting, IEEE MultiMedia, Mar. 2016. [ResearchGate] []

Deep Learning and Collaborative Intelligence

Deep Learning is revolutionizing the multimedia industry. We employ various forms of machine/deep learning to derive useful information from multimedia signals, even in their compressed form. We also study ways to deploy deep models efficiently, through collaborative intelligence.

Selected Publications

H. Choi and I. V. Bajić, Affine transformation-based deep frame prediction, IEEE Trans. Image Processing, Feb. 2021. [IEEEXplore] [arXiv]
S. R. Alvar and I. V. Bajić, Pareto-optimal bit allocation for collaborative intelligence, IEEE Trans. Image Processing, Feb. 2021. [IEEEXplore] [arXiv]
M. Akbari, J. Liang, J. Han, and C. Tu, Learned Multi-Resolution Variable-Rate Image Compression with Octave-based Residual Blocks, IEEE Trans. Multimedia, Dec. 2020. [IEEEXplore] []