Smart Phone Picture Recognition Algorithm Using Electronic Maps of Architecture Configuration

Jaegeol Yim, Jaehun Joo, Gyeyoung Lee

Abstract


As the techniques of electronic and information are advancing, the computing power of a smart phone is becoming more powerful and the storage capacity of a smart phone is becoming larger. As the result, various new useful services are becoming available on smart phones. The context-aware service and mobile augmented reality have recently been the most popular research topics. For those newly developed services, identifying the object in the picture taken by the camera on the phone performs an extremely important role. 
So, many researches of identifying pictures have been ublished and most of them are based on the time consuming image recognition techniques. On the contrary, this paper introduces a very fast and effective method of identifying the objects on the photo making use of the sensor data obtained from the smart phone and electronic maps. Our method estimates the line of sight of the camera with the location and orientation information provided by the smart phone. Then it finds any element of the map which intersects the line of ight.
By investigating those intersecting elements, our method identifies the objects on the photo.


Full Text:

PDF

References


김경중, 조성배, “상황인지 휴대폰 기술개발 동향”, 정보통신산업진흥원, [IITA] 정보통신연구진흥원 학술정보 주간기술동향1280호, 2007.

주재훈, 임재걸, “개인화 콘텐트 서비스 방법”,특허등록번호 10-1082953, 2011.

Abe, N., Oogami, W., Shimada, A., Nagahara, H., and Taniguchi, R., “Clickable Real World : Interaction with Real-World Landmarks Using Mobile Phone Camera,”IEEE Region 10 Conference, pp. 914-917,2010.

Abe, T., Takada, T., Kawamura, H.,Yasuno, T., and Sonehara, N., “Image-Identification Methods for Camera-Equipped Mobile Phones,” International Conference on Mobile Data Management, pp. 372-376, 2007.

Bruns, E., Brombach, B., and Bimber, O., “Mobile Phone-Enabled Museum Guidance with Adaptive Classification,” IEEE Computer Graphics and Applications, Vol. 28, No. 4, pp. 98-102, 2008.

Bruns, E., Brombach, B. Zeidler, T., and Bimber, O., “Enabling Mobile Phones To Support Large-Scale Museum Guidance,”IEEE Multimedia, Vol. 14, No. 2, pp. 16-25,2007.

Chen, D., Tsai, S., Vedantham, R.,Grzeszczuk, R., and Girod, B., “Streaming Mobile Augmented Reality on Mobile Phones,” IEEE International Symposium on Mixed and Augmented Reality, pp.181-182, 2009.

Cipolla, R., Robertson, D., and Tordoff,B., “Imagebased Localization,” Proceedings of International Conference on Virtual Systems and Multimedia(VSMM), pp.22-29, 2004.

Han, E., Yang, H., and Jung, K., “Mobile Education through Camera-Equipped Mobile Phones,” International Conference on Convergence Information Technology, pp. 1656-1661, 2007.

Hile, H. and Borriello, G., “Positioning and Orientation in Indoor Environments Using Camera Phones,” IEEE Computer Graphics and Applications, Vol. 28, No.4, pp. 32-39, 2008.

Kalkusch, M., Lidy, T., Knapp, M., Reitmayr, G., Kaufmann, H., and Schmalstieg, D., “Structured Visual Markers for Indoor Pathfinding,” Proceedings of the First IEEE International Workshop on ARToolKit, 2002.

Lee, A., Lee, J., Lee, S., and Choi, J., “Real-Time Camera Pose Estimation for Augmented Reality System Using a Square Marker,” International Symposium on Wearable Computers(ISWC), pp. 1-2, 2010.

Li, Y., Lim, J., Lim, K., and You, Y., “Showroom introduction using mobile phone based on scene image recognition,”IEEE International Conference on Multimedia and Expo, pp. 1294-1297, 2009.

Lim, J., Li, Y., You, Y., and Chevallet, J.,“Scene Recognition with Camera Phones for Tourist Information Access,” IEEE International Conference on Multimedia and Expo, pp. 100-103, 2007.

Mitchell, K. and Race, N., “uLearn : Facilitating Ubiquitous Learning Through Camera Equipped Mobile Phones,” IEEE International Workshop on Wireless and Mobile Technologies in Education, 2005.

Mohring, M., Lessig, C., and Bimber, O., “Video See Through Consumer Cell-Phones,” Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR), pp. 252-253, 2004.

Mulloni, A., Wagner, D., Barakonyi, I., and Schmalstieg, D., “Indoor Positioning and Navigation with Camera Phones,” IEEE Pervasive Computing, pp. 22-31, 2009.

Naimark, L. and Foxlin, E., “Circular Data Matrix Fiducial System and Robust Image Processing for a Wearable Vision Inertial Self-Tracker,” Proceedings of the 1st International Symposium on Mixed and Augmented Reality, p. 27, 2002.

Noh, H., Lee, J., Oh, S., Hwang, K., and Cho, D., “Exploiting Indoor Location and Mobile Information for Context-Awareness Service,” Information Processing and Management, In Press, Corrected Proof, Available online 12 March 2011.

Oe, M., Sato, T., and Yokoya, N., “Estimating Camera Position and Posture by Using Feature Landmark Database,” Proceedings of Scandinavian Conference on Image Analysis(SCIA), pp. 171-181, 2005.

Paucher, R. and Turk, M., “Location-Based Augmented Reality on Mobile Phones,” IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops(CVPRW), pp. 9-16, 2010.

Rosten, E. and Drummond, T., “Fusing Points and Lines for High Performance Tracking,” Proceedings of International Conference on Computer Vision(ICCV), Vol. 2, pp. 1508-1515, 2005.

Sato, J., Takahashi, T., Ide, I., and Murase, H., “Change Detection in Streetscapes from GPS Coordinated Omni Directional Image Sequences,” Proceedings of International Conference on Pattern Recognition(ICPR), Vol. 4, pp. 935-938, 2006.

Schmalstieg, D. and Wagner, D., “Experiences with Handheld Augmented Reality,” Proceedings of 6th International Symposium on Mixed and Augmented Reality(ISMAR), pp. 3-8, 2007.

Skrypnyk, I. and Lowe, D. G., “Scene Modelling, Recognition and Tracking with Invariant Image Features,” Proceedings of International Symposium on Mixed and Augmented Reality(ISMAR), pp. 110-119, 2004.

Vacchetti, L., Lepetit, V., and Fua, P., “Combining Edge and Texture Information for Real-Time Accurate 3d Camera Tracking,” Proceedings of International Symposium on Mixed and Augmented Reality(ISMAR), pp. 48-57, 2004.

Vandenhouten, R. and Selz, M., “Identification and tracking of goods with the mobile phone,” International Symposium on Logistics and Industrial Informatics, pp. 25-29, 2007.

Wagner, D. and Schmalstieg, D., “First Steps Towards Handheld Augmented Reality,” Proceedings of International Symposium on Wearable Computers(ISWC), pp. 21-23, 2003.

Yeo, C., Chia, L., Cham, T., and Rajon, D., “Click4BuildingID@NTU : Click for Building Identification with GPS-enabled Camera Cell Phone,” IEEE International Conference on Multimedia and Expo, pp. 1059-1062, 2007.

Yim, J., “Introducing a Decision Treebased Indoor Positioning Technique,”Expert Systems with Applications, Vol. 34, No. 2, pp. 1296-1302, 2008.


Refbacks

  • There are currently no refbacks.