Nachrichtenübertragung

Supplementary material for paper:

"Motion-based object segmentation using hysteresis and bidirectional inter-frame change detection in sequences with moving camera"

Marina Georgia Arvanitidou, Michael Tok, Alexander Glantz, Andreas Krutz and Thomas Sikora


Abstract

We present an unsupervised motion-based object segmentation algorithm for video sequences with moving camera, employing bidirectional inter-frame change detection. For every frame, two error frames are generated using motion compensation. They are combined and a segmentation algorithm based on thresholding is applied. We employ a simple and effective error fusion scheme and consider spatial error localization in the thresholding step. We find the optimal weights for the weighted mean thresholding algorithm that enables unsupervised robust moving object segmentation. Further, a post processing step for improving the temporal consistency of the segmentation masks is incorporated and thus we achieve improved performance compared to previously proposed methods. The experimental evaluation and comparison with reference methods demonstrates the validity of the proposed method.

Experimental Evaluation

To demonstrate the segmentation efficiency of our proposed algorithm, we show below the following:

  1. F-Measure (F), Precision (P) and Recall (R) per frame rates (figures) comparing Algorithms 1, 2 and 3
  2. Original, and segmented  video sequences using Algorithms 1, 2 and 3 
  3. P, R and F per frame rates (figures) and average (figures) for different QPs using our proposed Algorithm 3.
  4. Segmented video sequences using Algorithm 3 for QP=38.

Figures may be enlarged upon clicking on the down-right corner of each one.

The original .yuv videos have been compressed to .mp4 files and the segmentated .yuv videos are compressed to .zip files.

.yuv videos can be downloaded and then viewed with an appropriate player such as GLYUVPLAY for mac or YUVPLAYER for windows.

Allstars (352 x 288, 250 frames)

Results
Allstars Sequence
Original
Algorithm 1
Algorithm 2
Algorithm 3

Biathlon (352 x 288, 200 frames)

Results
Biathlon Sequence
Original
Algorithm 1
Algorithm 2
Algorithm 3

Mountain (352 x 192, 100 frames)

Results
Mountain Sequence
Original
Algorithm 1
Algorithm 2
Algorithm 3

Race (544 x 336, 100 frames)

Results
Race Sequence
Original
Algorithm 1
Algorithm 2
Algorithm 3

Stefan (352 x 240, 300 frames)

Results
Stefan Sequence
Original
Algorithm 1
Algorithm 2
Algorithm 3

BBC fish (720 x 576, 120 frames)

Results
BBC fish Sequence
Original
Algorithm 1
Algorithm 2
Algorithm 3

Horse (352 x 288, 120 frames)

Horse (352 x 288, 120 frames)

Results
Horse Sequence
Original
Algorithm 1
Algorithm 2
Algorithm 3
H.264/AVC settings
KTA 2.4 reference software
IPPP ... GOP structure
EPZS motion estimation
32 x 32 search range
4 x 4 smallest block size
Segmentation results when coded wth QP=38
Mountain, Algorithm4, QP=38
Stefan, Algorithm 4, QP=38
Race, Algorithm, 4 QP=38
Biathlon, Algorithm, 4 QP=38
Allstars, Algorithm, 4 QP=38
BBC fish, Algorithm 4, QP=38
Horse, Algorithm 4, QP=38