Image Segmentation 2D/3D

The demo of 2D and 3D image segmentation is shown as follows (YouKu):

The interactive image segmentation algorithm can provide an intelligent ways to understand the intention of user input. Many interactive methods have the problem of that ask for large number of user input. To efficient produce intuitive segmentation under limited user input is important for industrial application.

Illustration of random walks. a) Image represented as graph in random walk; b) background seeds (red line) and foreground seeds (blue line); c) the probability distribution of random walks and distribution of pixel (green point) whose probability range in [0.5 − δ; 0.5 + δ] (δ = 0.1).

In this paper, we reveal a positive feedback system on image segmentation to show the pixels of self-learning. Two approaches, iterative random walks (IRW) and boundary random walks (BRW), are proposed for segmentation potential, which is the key step in feedback system.

Feedback system in random walks. The large number of background or foreground seeds and less number of boundary seeds can reduce the segmentation potential. The small segmentation potential lead to reliably segmentation. We proposed two approach to involve the positive feedback system, including iterative random walks (IRW) and boundary random walks (BRW).

Experiment results on image segmentation indicates that proposed algorithms can obtain more efficient input to random walks. And higher segmentation performance can be obtained by applying the iterative boundary random walks algorithm.

2D segmentation results:

Illustration of 3-step IRW algorithm. (a) the initialization of IRW(basic random walks algorithm); (b) first step of IRW; © second step of IRW; (d) third step of IRW. From top to bottom: input image with background/foreground seeds, the probability maps by each step of IRW, the segmentation results by each step, close-up segmentation results, the histogram. SF and SB are number of new foreground and background seeds. SE is number of boundary seeds. Error is number of misclassified pixels.

More examples for comparison between IBRW algorithm and random walks algorithm. From left to right: a) input images with background and foreground seeds b) the probability maps by random walks c) the segmentation results by random walks d) input images with new background and foreground seeds by IBRW method e) the probability maps by IBRW algorithm f) segmentation results by IBRW algorithm.

Comparing the segmentation results of the GrabCut algorithm, LazySnapping algorithm, constrained random walks algorithm and proposed algorithm. From top to bottom: the results of GrabCut, the results of LazySnapping, the results of constrained random walks, and the results of IBRW. The blue and red line denote foreground and background seeds, especially green line denote soft seeds in constrained random walks.

3D segmentation results:

We expect to segment the tooth from a 3D CT image. The 3D CT image is shown as following figure:

We first use the random walks to segment the 2D tooth from a slice of CT image.

Then, the 2D results are regarded as the seed of the level-set method and we can obtain the 3D segmentation results.

Lastly, we show a related demo to easy understand the proposed works:

The demo of 2D and 3D image segmentation by YouTube: