Probabilistic and Structural Approaches to Image Understanding, Classification and Retrieval, and Applications to Remote Sensing and Medical Image Analysis (CAREER Award)

Summary:

Increased availability of the internet and advances in computer performance and storage systems improved the feasibility of many scientific applications. Advances in these applications also increased the amount of generated data and the need for its effective processing and storage. Automatic content extraction and efficient access to this content became highly desired goals in intelligent databases.

This project aims to develop automatic techniques for semantic processing of images, extraction of the relationships between them, efficient storage of these relationships in databases, improved access to the stored information, and comparisons between new information and past cases. Semantic processing of images will be done using a hierarchical decomposition. First, clustering and density estimation will be performed on color and texture features of pixels. Pixels will be classified based on the estimated densities. Then, segmentation techniques will be used to group the pixels and divide images into meaningful regions. Even when pixels and regions can be identified correctly, semantic processing requires knowledge about the relationships and relative arrangements of regions. The arrangements will be modeled using attributed relational graphs that encode relationships between regions.

The developed methods will be used to find interesting patterns in image databases, to study change detection using images of the same scene taken at different times, and to perform content-based searches. This work will enable us to analyze large image databases by their high-level semantic content instead of the limited representation supported by low-level feature vectors.

People:

Faculty
- Selim Aksoy (Principal investigator)
Graduate Students
- Hüseyin Gökhan Akçay (Ph.D. student)
- Çağlar Arı (Ph.D. student)
- R. Gökberk Cinbiş (B.S. student)
- Emel Doğrusöz (M.S. student)
- Aslı Kale (M.S. student)
- Bahadır Özdemir (M.S. student)
- Ísmet Zeki Yalnız (Ph.D. student)
- Ahsen Ikbal Yergök(M.S. student)
- Daniya Zamalieva (M.S. student)

Duration:

April 2005 - April 2010

Sponsor:

TUBITAK - Scientific and Technical Research Council of Turkey (Grant no: 104E074)

Budget:

189,360 YTL (~US$126,000)

Publications:

I. Zeki Yalniz, Selim Aksoy, "Unsupervised Detection and Localization of Structural Textures Using Projection Profiles," in Pattern Recognition, 43(10):3324-3337, October 2010.
Caglar Ari, Selim Aksoy, "Maximum Likelihood Estimation of Gaussian Mixture Models Using Particle Swarm Optimization," in 20th IAPR International Conference on Pattern Recognition, Istanbul, Turkey, August 23-26, 2010.
Bahadir Ozdemir, Selim Aksoy, "Image Classification Using Subgraph Histogram Representation," in 20th IAPR International Conference on Pattern Recognition, Istanbul, Turkey, August 23-26, 2010.
Asli Kale, Selim Aksoy, "Segmentation of Cervical Cell Images," in 20th IAPR International Conference on Pattern Recognition, Istanbul, Turkey, August 23-26, 2010.
H. Gokhan Akcay, Selim Aksoy, Pierre Soille, "Hierarchical Segmentation of Complex Structures," in 20th IAPR International Conference on Pattern Recognition, Istanbul, Turkey, August 23-26, 2010.
H. Gokhan Akcay, Selim Aksoy, "Building Detection Using Directional Spatial Constraints," in IEEE International Geoscience and Remote Sensing Symposium, Honolulu, Hawaii, July 25-30, 2010.
Caglar Ari, Selim Aksoy, "Unsupervised Classification of Remotely Sensed Images Using Gaussian Mixture Models and Particle Swarm Optimization," in IEEE International Geoscience and Remote Sensing Symposium, Honolulu, Hawaii, July 25-30, 2010.
Bahadir Ozdemir, Selim Aksoy, Sandra Eckert, Martino Pesaresi, Daniele Ehrlich, "Performance Measures for Object Detection Evaluation," in Pattern Recognition Letters, 31(10):1128-1137, July 15, 2010.
Selim Aksoy, R. Gokberk Cinbis, "Image Mining Using Directional Spatial Constraints," in IEEE Geoscience and Remote Sensing Letters, Special Issue on Image Information Mining: Pursuing Automation of Geospatial Intelligence for Environment and Security, 7(1):33-37, January 2010.
Selim Aksoy, H. Gokhan Akcay, Tom Wassenaar, "Automatic Mapping of Linear Woody Vegetation Features in Agricultural Landscapes Using Very High-Resolution Imagery," in IEEE Transactions on Geoscience and Remote Sensing, 48(1):511-522, January 2010.
Daniya Zamalieva, Selim Aksoy, James C. Tilton, "Finding Compound Structures in Images Using Image Segmentation and Graph-Based Knowledge Discovery," in IEEE International Geoscience and Remote Sensing Symposium, Cape Town, South Africa, July 13-17, 2009.
Selim Aksoy, Krzysztof Koperski, Carsten Tusk, Giovanni Marchisio, "Land Cover Classification with Multi-Sensor Fusion of Partly Missing Data," in Photogrammetric Engineering & Remote Sensing, 75(5):577-593, May 2009.
Ismet Zeki Yalniz, Selim Aksoy, "Uydu Goruntulerinde Duzenli Dikim Alanlarinin Belirlenmesi (in Turkish)," in 17. IEEE Sinyal Isleme ve Iletisim Uygulamalari Kurultayi, Antalya, Turkey, April 9-11, 2009.
Asli Kale, Selim Aksoy, Sevgen Onder, "Pap Smear Test Goruntulerinde Hucre Cekirdeklerinin Bolutlenmesi (in Turkish)," in 17. IEEE Sinyal Isleme ve Iletisim Uygulamalari Kurultayi, Antalya, Turkey, April 9-11, 2009.
H. Gokhan Akcay, Selim Aksoy, "Tarim Alanlarinda Dogrusal Odunsu Bitki Gruplarinin Otomatik Sezimi (in Turkish)," in 17. IEEE Sinyal Isleme ve Iletisim Uygulamalari Kurultayi, Antalya, Turkey, April 9-11, 2009.
Selim Aksoy, Bahadir Ozdemir, Sandra Eckert, Francois Kayitakire, Martino Pesaresi, Orsan Aytekin, Christoph C. Borel, Jan Cech, Emmanuel Christophe, Sebnem Duzgun, Arzu Erener, Kivanc Ertugay, Ejaz Hussain, Jordi Inglada, Sebastien Lefevre, Ozgun Ok, Dilek Koc San, Radim Sara, Jie Shan, Jyothish Soman, Ilkay Ulusoy, Regis Witz, "Performance Evaluation of Building Detection and Digital Surface Model Extraction Algorithms: Outcomes of the PRRS 2008 Algorithm Performance Contest," in 5th IAPR Workshop on Pattern Recognition in Remote Sensing, Tampa, Florida, December 7, 2008.
H. Gokhan Akcay, Selim Aksoy, "Automatic Detection of Geospatial Objects Using Multiple Hierarchical Segmentations," in IEEE Transactions on Geoscience and Remote Sensing, 46(7):2097-2111, July 2008.
Selim Aksoy, H. Gokhan Akcay, R. Gokberk Cinbis, Tom Wassenaar, "Automatic Mapping of Linear Woody Vegetation Features in Agricultural Landscapes," in IEEE International Geoscience and Remote Sensing Symposium, IV:403-406, Boston, Massachusetts, July 6-11, 2008.
Firat Kalaycilar, Asli Kale, Daniya Zamalieva, Selim Aksoy, "Mining of Remote Sensing Image Archives Using Spatial Relationship Histograms," in IEEE International Geoscience and Remote Sensing Symposium, III:589-592, Boston, Massachusetts, July 6-11, 2008.
R. Gokberk Cinbis, Selim Aksoy, "Relative Position-Based Spatial Relationships Using Mathematical Morphology," in IEEE International Conference on Image Processing, San Antonio, Texas, September 16-19, 2007.
H. Gokhan Akcay, Selim Aksoy, "Automated Detection of Objects Using Multiple Hierarchical Segmentations," in IEEE International Geoscience and Remote Sensing Symposium, Barcelona, Spain, July 23-27, 2007.
Emel Dogrusoz, Selim Aksoy, "Modeling Urban Structures Using Graph-Based Spatial Patterns," in IEEE International Geoscience and Remote Sensing Symposium, Barcelona, Spain, July 23-27, 2007.
H. Gokhan Akcay, Selim Aksoy, "Kentsel Yapilarin Bicimbilimsel Bolutlenmesi (in Turkish)," in 15. IEEE Sinyal Isleme ve Iletisim Uygulamalari Kurultayi, Eskisehir, Turkey, June 11-13, 2007.
Emel Dogrusoz, Selim Aksoy, "Bina Oruntuleri Kullanarak Kentlesme Modellemesi (in Turkish)," in 15. IEEE Sinyal Isleme ve Iletisim Uygulamalari Kurultayi, Eskisehir, Turkey, June 11-13, 2007.
R. Gokberk Cinbis, Selim Aksoy, "Konuma Bagli Uzamsal Iliskilerin Bicimbilimsel Modellenmesi (in Turkish)," in 15. IEEE Sinyal Isleme ve Iletisim Uygulamalari Kurultayi, Eskisehir, Turkey, June 11-13, 2007.
H. Gokhan Akcay, Selim Aksoy, "Morphological Segmentation of Urban Structures," in 4th IEEE GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas, Paris, France, April 11-13, 2007.
Selim Aksoy, "Spatial Techniques for Image Classification," in C.H. Chen, ed., Signal and Image Processing for Remote Sensing, Taylor & Francis, 2006.
Selim Aksoy, Emel Dogrusoz, "Modeling Urbanization Using Spatial Building Patterns," in 4th IAPR International Workshop on Pattern Recognition in Remote Sensing, Hong Kong, China, August 20, 2006.
Selim Aksoy, "Modeling of Remote Sensing Image Content using Attributed Relational Graphs," in IAPR International Workshop on Structural and Syntactic Pattern Recognition, (also in Lecture Notes in Computer Science), Hong Kong, China, August 17-19, 2006.
Selim Aksoy, H. Gokhan Akcay, "Multi-resolution Segmentation and Shape Analysis for Remote Sensing Image Classification," in 2nd International Conference on Recent Advances in Space Technologies, Istanbul, Turkey, June 9-11, 2005.