Video saliency incorporating spatiotemporal cues and uncertainty weighting. 2014

Yuming Fang, and Zhou Wang, and Weisi Lin, and Zhijun Fang

We propose a novel algorithm to detect visual saliency from video signals by combining both spatial and temporal information and statistical uncertainty measures. The main novelty of the proposed method is twofold. First, separate spatial and temporal saliency maps are generated, where the computation of temporal saliency incorporates a recent psychological study of human visual speed perception. Second, the spatial and temporal saliency maps are merged into one using a spatiotemporally adaptive entropy-based uncertainty weighting approach. The spatial uncertainty weighing incorporates the characteristics of proximity and continuity of spatial saliency, while the temporal uncertainty weighting takes into account the variations of background motion and local contrast. Experimental results show that the proposed spatiotemporal uncertainty weighting algorithm significantly outperforms state-of-the-art video saliency detection models.

UI MeSH Term Description Entries
D007089 Image Enhancement Improvement of the quality of a picture by various techniques, including computer processing, digital filtering, echocardiographic techniques, light and ultrastructural MICROSCOPY, fluorescence spectrometry and microscopy, scintigraphy, and in vitro image processing at the molecular level. Image Quality Enhancement,Enhancement, Image,Enhancement, Image Quality,Enhancements, Image,Enhancements, Image Quality,Image Enhancements,Image Quality Enhancements,Quality Enhancement, Image,Quality Enhancements, Image
D007090 Image Interpretation, Computer-Assisted Methods developed to aid in the interpretation of ultrasound, radiographic images, etc., for diagnosis of disease. Image Interpretation, Computer Assisted,Computer-Assisted Image Interpretation,Computer-Assisted Image Interpretations,Image Interpretations, Computer-Assisted,Interpretation, Computer-Assisted Image,Interpretations, Computer-Assisted Image
D010363 Pattern Recognition, Automated In INFORMATION RETRIEVAL, machine-sensing or identification of visible patterns (shapes, forms, and configurations). (Harrod's Librarians' Glossary, 7th ed) Automated Pattern Recognition,Pattern Recognition System,Pattern Recognition Systems
D010781 Photography Method of making images on a sensitized surface by exposure to light or other radiant energy. Photographies
D003198 Computer Simulation Computer-based representation of physical systems and phenomena such as chemical processes. Computational Modeling,Computational Modelling,Computer Models,In silico Modeling,In silico Models,In silico Simulation,Models, Computer,Computerized Models,Computer Model,Computer Simulations,Computerized Model,In silico Model,Model, Computer,Model, Computerized,Model, In silico,Modeling, Computational,Modeling, In silico,Modelling, Computational,Simulation, Computer,Simulation, In silico,Simulations, Computer
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000465 Algorithms A procedure consisting of a sequence of algebraic formulas and/or logical steps to calculate or determine a given task. Algorithm
D001185 Artificial Intelligence Theory and development of COMPUTER SYSTEMS which perform tasks that normally require human intelligence. Such tasks may include speech recognition, LEARNING; VISUAL PERCEPTION; MATHEMATICAL COMPUTING; reasoning, PROBLEM SOLVING, DECISION-MAKING, and translation of language. AI (Artificial Intelligence),Computer Reasoning,Computer Vision Systems,Knowledge Acquisition (Computer),Knowledge Representation (Computer),Machine Intelligence,Computational Intelligence,Acquisition, Knowledge (Computer),Computer Vision System,Intelligence, Artificial,Intelligence, Computational,Intelligence, Machine,Knowledge Representations (Computer),Reasoning, Computer,Representation, Knowledge (Computer),System, Computer Vision,Systems, Computer Vision,Vision System, Computer,Vision Systems, Computer
D012680 Sensitivity and Specificity Binary classification measures to assess test results. Sensitivity or recall rate is the proportion of true positives. Specificity is the probability of correctly determining the absence of a condition. (From Last, Dictionary of Epidemiology, 2d ed) Specificity,Sensitivity,Specificity and Sensitivity
D013382 Subtraction Technique Combination or superimposition of two images for demonstrating differences between them (e.g., radiograph with contrast vs. one without, radionuclide images using different radionuclides, radiograph vs. radionuclide image) and in the preparation of audiovisual materials (e.g., offsetting identical images, coloring of vessels in angiograms). Subtraction Technic,Subtraction Technics,Subtraction Techniques,Technic, Subtraction,Technics, Subtraction,Technique, Subtraction,Techniques, Subtraction

Related Publications

Yuming Fang, and Zhou Wang, and Weisi Lin, and Zhijun Fang
June 2018, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Yuming Fang, and Zhou Wang, and Weisi Lin, and Zhijun Fang
August 2019, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Yuming Fang, and Zhou Wang, and Weisi Lin, and Zhijun Fang
November 2021, Sensors (Basel, Switzerland),
Yuming Fang, and Zhou Wang, and Weisi Lin, and Zhijun Fang
October 2019, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Yuming Fang, and Zhou Wang, and Weisi Lin, and Zhijun Fang
April 2021, IEEE transactions on neural networks and learning systems,
Yuming Fang, and Zhou Wang, and Weisi Lin, and Zhijun Fang
August 2015, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Yuming Fang, and Zhou Wang, and Weisi Lin, and Zhijun Fang
January 2010, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Yuming Fang, and Zhou Wang, and Weisi Lin, and Zhijun Fang
January 2010, IEEE transactions on pattern analysis and machine intelligence,
Yuming Fang, and Zhou Wang, and Weisi Lin, and Zhijun Fang
January 2014, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Yuming Fang, and Zhou Wang, and Weisi Lin, and Zhijun Fang
December 2012, Optics letters,
Copied contents to your clipboard!