Ahmed Saad and Ghassan Hamarneh and Torsten Moller.
"Exploration and Visualization of Segmentation Uncertainty using Shape and Appearance Prior Information".
In IEEE Transactions on Visualization and Computer Graphics, vol. 16,no. 6, pp. 1366 - 1375, 2010.

Links:

Abstract:

We develop an interactive analysis and visualization tool for probabilistic segmentation in medical imaging. The originality of our approach is that the data exploration is guided by shape and appearance knowledge learned from expert-segmented images of a training population. We introduce a set of multidimensional transfer function widgets to analyze the multivariate probabilistic field data. These widgets furnish the user with contextual information about conformance or deviation from the population statistics. We demonstrate the user's ability to identify suspicious regions (e.g. tumors) and to correct the misclassification results. We evaluate our system and demonstrate its usefulness in the context of static anatomical and time-varying functional imaging datasets.

Summary:

Keywords:

Uncertainty visualization, Medical imaging, Probabilistic segmentation

Techniques:

Bibtex:

@Article{        saad:2010:EVSU,
  author = 	 {Ahmed Saad and Ghassan Hamarneh and Torsten M{\"o}ller},
  title = 	 {Exploration and Visualization of Segmentation
                  Uncertainty using Shape and Appearance Prior
                  Information},
  journal = 	 {IEEE Transactions on Visualization and Computer
                  Graphics},
  year = 	 {2010},
  volume = 	 {16},
  number = 	 {6},
  pages = 	 {1366 - 1375},
}

Images:

References:


[1] C. Baillard, P. Hellier, and C. Barillot. Segmentation of brain 3D MR images using level sets and dense registration. Medical Image Analysis, 5(3):185-194, 2001.
[2] W. A. Barrett and E. N. Mortensen. Interactive live-wire boundary ex- traction. Medical Image Analysis, 1(4):331-341, 1997.
[3] J. Blaas, C. P. Botha, and F. H. Post. Interactive visualization of multi- field medical data using linked physical and feature-space views. In Proceedings of the joint Eurographics / IEEE VGTC Symposium on Visual- ization, pages 123-130, 2007.
[4] Y.Boykov,O.Veksler,andR.Zabih.Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(11):1222-1239, 2001.
[5] S. K. Card, J. D. Mackinlay, and B. Shneiderman. Readings in Information Visualization: Using Vision to Think. Academic Press, London, 1999.
[6] D. L. Collins and A. C. Evans. ANIMAL: validation and applications of nonlinear registration-based segmentation. International Journal of Pattern Recognition and Artificial Intelligence, 11(8):1271-1294, 1997.
[7] T. Cootes, C. Taylor, D. Cooper, and J. Graham. Active shape models-their training and application. Computer Vision and Image Understanding Journal, 61(1):38-59, 1995.
[8] T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6):681-685, 2001.
[9] C. Correa and K.-L. Ma. The occlusion spectrum for volume classification and visualization. IEEE Transactions on Visualization and Computer Graphics, 15(6):1465-1472, 2009.
[10] D. Cremers, T. Kohlberger, and C. Schnorr. Nonlinear shape statistics in Mumford Shah based segmentation. In Proceedings of the European Conference on Computer Vision, pages 93-108, 2002.
[11] L. R. Dice. Measures of the amount of ecologic association between species. Ecology, 26(3):297-302, 1945. [12] R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification. Wiley-Interscience Publication, 2000.
[13] K. Engel, M. Hadwiger, J. M. Kniss, C. Rezk-Salama, and D. Weiskopf.Real-Time Volume Graphics. A. K. Peters, Natick, MA, USA, 2006.
[14] A. Evans, M. Kamber, D. Collins, and D. MacDonald. Magnetic Resonance Scanning and Epilepsy, chapter An MRI-based probabilistic atlas of neuroanatomy, pages 263-274. Plenum Press, 1994.
[15] Z. Fang, T. Mo ller, G. Hamarneh, and A. Celler. Visualization and exploration of time-varying medical image data sets. In Proceedings of Graphics Interface 2007, pages 281-288, 2007.
[16] T. Finley and T. Joachims. Training structural SVMs when exact inference is intractable. In Proceedings of the 25th International Conference on Machine Learning, pages 304-311, 2008.
[17] L. Grady. Random walks for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(11):1768-1783, 2006.
[18] L. Grady and G. Funka-Lea. An energy minimization approach to the data driven editing of presegmented images/volumes. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 888-895, 2006.
[19] G. Hamarneh and X. Li. Watershed segmentation using prior shape and appearance knowledge. Image and Vision Computing, 27(1):59-68, 2009.
[20] T. Humphries, A. Saad, A. Celler, T. Moller, and M. Trummer. Segmentation-based regularization of dynamic SPECT reconstructions. In IEEE Nuclear Science Symposium Conference Record (NSS/MIC), pages 2849-2852, 2009.
[21] T. Jankun-Kelly and K.-L. Ma. A study of transfer function generation for time-varying volume data. In Proceedings Volume Graphics Workshop, pages 51-65, 2001.
[22] C. Johnson. Top scientific visualization research problems. IEEE Computer Graphics and Applications, 24(4):13-17, 2004.
[23] Y. Kang, K. Engelke, and W. A. Kalender. Interactive 3D editing tools for image segmentation. Medical Image Analysis, 8(1):35-46, 2004.
[24] M. Kass, A. Witkin, and D. Terzopoulos. Snakes: Active contour models. International Journal of Computer Vision, 1(4):321-331, 1988.
[25] G. L. Kindlmann, R. T. Whitaker, T. Tasdizen, and T. Moller. Curvature- based transfer functions for direct volume rendering: Methods and applications. In Proceedings of IEEE Visualization, pages 513-520, 2003.
[26] J. Kniss, G. Kindlmann, and C. Hansen. Multi-dimensional transfer func- tions for interactive volume rendering. IEEE Transactions on Visualization and Computer Graphics, 8(3):270-285, 2002.
[27] J. M. Kniss, R. V. Uitert, A. Stephens, G.-S. Li, T. Tasdizen, and C. Hansen. Statistically quantitative volume visualization. In Proceedings of IEEE Visualization, pages 287-294, 2005.
[28] P. Kohli and P. Torr. Measuring uncertainty in graph cut solutions. Computer Vision and Image Understanding Journal, 112(1):30-38, 2008.
[29] M. E. Leventon, W. Eric, W. E. L. Grimson, and O. Faugeras. Statisti- cal shape influence in geodesic active contours. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 316-323, 2000.
[30] C. Lundstro m, P. Ljung, A. Persson, and A. Ynnerman. Uncertainty visualization in medical volume rendering using probabilistic animation. IEEE Transactions on Visualization and Computer Graphics, 13(6):1648-1655, 2007.
[31] C. Lundstro m, P. Ljung, and A. Ynnerman. Local histograms for design of transfer functions in direct volume rendering. IEEE Transactions on Visualization and Computer Graphics, 12(6):1570-1579, 2006.
[32] J. C. Mazziotta, A. W. Toga, A. Evans, P. Fox, and J. Lancaster. A prob- abilistic atlas of the human brain: Theory and rationale for its development. NeuroImage, 2(2, Part 1):89-101, 1995.
[33] T. McInerney and D. Terzopoulos. Deformable models in medical image analysis: A survey. Medical Image Analysis, 1(2):91-108, 1996.
[34] C. Mcintosh and G. Hamarneh. Optimal weights for convex functionals in medical image segmentation. In Proceedings of the 5th International Symposium on Advances in Visual Computing, pages 1079-1088, 2009.
[35] R. M. Mohamed and A. A. Farag. Mean field theory for density estima- tion using support vector. In Proceedings of the International Conference on Information Fusion, pages 495-501, 2004.
[36] E. N. Mortensen and W. A. Barrett. Interactive segmentation with intelligent scissors. Graphics Models and Image Processing, 60(5):349-384, 1998.
[37] S. Olabarriaga and A. Smeulders. Interaction in the segmentation of medical images: A survey. Medical Image Analysis, 5(2):127-142, 2001.
[38] J. C. Platt. Probabilistic outputs for support vector machines and com- parisons to regularized likelihood methods. In Advances in Large Margin Classifiers, pages 61-74. MIT Press, 1999.
[39] M. Poon, G. Hamarneh, and R. Abugharbieh. Efficient interactive 3D livewire segmentation of objects with arbitrarily topologies. Computer-ized Medical Imaging and Graphics, 32:639-650, 2008.
[40] J.-S. Prassni, T. Ropinski, J. Mensmann, and K. H. Hinrichs. Shape-based transfer functions for volume visualization. In Proceedings of the IEEE Pacific Visualization Symposium, pages 9-16, 2010.
[41] M. Prastawa, E. Bullitt, and G. Gerig. Simulation of brain tumors in MR images for evaluation of segmentation efficacy. Medical Image Analysis, 13(2):297-311, 2009.
[42] J. Rao, R. Abugharbieh, and G. Hamarneh. Adaptive regularization for image segmentation using local image curvature cues. In Proceedings of the European Conference on Computer Vision, in press, 2010.
[43] S. Roettger, M. Bauer, and M. Stamminger. Spatialized transfer functions. In Proceedings of IEEE/Eurographics Symposium on Visualization, pages 271-278, 2005.
[44] T. Rohlfing, R. Brandt, R. Menzel, D. B. Russakoff, and C. R. Maurer. Quo vadis, atlas-based segmentation? In:The Handbook of Medical Im- age Analysis: Segmentation and Registration Models. Kluwer Academic / Plenum Publishers, New York, NY, 2005.
[45] A. Saad, G. Hamarneh, T. Moller, and B. Smith. Kinetic modeling based probabilistic segmentation for molecular images. In Lecture Notes in Computer Science, (MICCAI), pages 244-252, 2008.
[46] A. Saad, T. Moller, and G. Hamarneh. ProbExplorer: Uncertainty- guided exploration and editing of probabilistic medical image segmen- tation. Computer Graphics Forum, 29(3):1113-1120, 2010.
[47] A. Saad, B. Smith, G. Hamarneh, and T. Mo ller. Simultaneous segmen- tation, kinetic parameter estimation, and uncertainty visualization of dy- namic PET images. In Lecture Notes in Computer Science, (MICCAI), pages 726-733, 2007.
[48] J. Talairach and P. Tournoux. Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System : An Approach to Cerebral Imaging. Thieme Medical Publishers, January 1988.
[49] F.-Y. Tzeng, E. Lum, and K.-L. Ma. An intelligent system approach to higher-dimensional classification of volume data. IEEE Transactions on Visualization and Computer Graphics, 11(3):273-284, 2005.
[50] F.-Y. Tzeng and K.-L. Ma. A cluster-space visual interface for ar- bitrary dimensional classification of volume data. In Proceedings of Eurographics-IEEE TVCG Symposium on Visualization, pages 17-24, 2004.
[51] Y. Zhang, M. Brady, and S. Smith. Segmentation of brain MR im- ages through a hidden Markov random field model and the expectation-maximization algorithm. 20(1):45-57, 2001. IEEE Transaction of Medical Imaging, 20(1):45-57, 2001.