Rain Removal Based on Superpixel Spatial-Temporal Matching and Filtering

摘要

The present invention relates to an improved system and method for removing rain from still images or video. In the first step, frame geometrical alignment is applied to minimize scene content disparity. SuperPixel (SP) segmentation is then applied to decompose the scene into meaningful and depth consistent units. A spatial-temporal buffer is then created for each SP to compensate the scene content motion and depth variation. A series of matching and filtering operations can then be performed on such buffer for rain removal. The method is capable of rain removal for videos with dynamic scene content and large depth variations, and taken from a moving camera. FIG. 2B accompanies abstract.