MusicGuide: Album Reviews on the Go

Serdar Sali                sali@soe.ucsc.edu

 

Final Documentation:

 

Presentation (pdf)

 

Final Paper (pdf)

 

 

MusicGuide is an application that can be used to provide the user information on a music album on the go by simply using a photo of the album cover as the input utilizing David Lowe’s SIFT [6]. Relevant data on the album such as reviews and track samples are then collected from various sources on the web and presented to the user.

 

 

The architecture works with a matching accuracy above 90%. The matching process is robust

against various transforms and artifacts in input images.

 

 

 

Previous Files:

Related Work(pdf)

 

Intro Draft(pdf)

 

Figures Draft (pdf)

 

Final Draft (doc)

 

 

References

 

[1] S. Ballard, “Color Indexing”, International Journal of Computer Vision, Vol. 7, No. 1, pp. 11-32, 1991.

[2] G.Pass, and R. Zabith, "Comparing images using joint histograms," Multimedia Systems, Vol.7, pp.234-240, 1999.

[3] G. Pass, and R. Zabith, "Histogram refinement for content-based image retrieval," IEEE Workshop on Applications of Computer Vision, pp. 96-102, 1996.

[4] H. Tamura, S. Mori, and T. Yamawaki, "Texture features corresponding to visual perception", IEEE Trans. On Systems, Man, and Cybernetics, Vol. Smc-8, No. 6, 1978.

[5] C. Harris and M. Stephens, “A combined corner and edge detector”, ALVEY Vision Conference, pages 147-151, 1988.

[6] D. G. Lowe, "Distinctive image features from scale-invariant keypoints", International Journal of Computer Vision, Vol. 60, No. 2, pp. 91-110, 2004.

[7] M. Merler, C. Galleguillos, and S. Belongie. “Recognizing Groceries in situ Using in vitro Training Data”, to appear, SLAM 2007, Minneapolis, MN, retrieved from http://grozi.calit2.net/files/grozi_slam.pdf.

[8] N. Davies, K. Cheverst, A. Dix, and A. Hesse, “Understanding the role of image recognition in mobile tour guides”, Proceedings of the 7th international Conference on Human Computer interaction with Mobile Devices & Services, pp. 191-198, 2005.

[9] T. Yeh, K. Tollmar, and T. Darrell, "Searching the Web with Mobile Images for Location Recognition", 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'04), Vol. 2, pp. 76-81, 2004.

[10] P. Föckler, T. Zeidler, B. Brombach, E. Bruns, and O. Bimber, “PhoneGuide: museum guidance supported by on-device object recognition on mobile phones”, Proceedings of the 4th international Conference on Mobile and Ubiquitous Multimedia, MUM '05, Vol. 154, pp. 3-10, 2005.

[11]  C. Seifert, L. Paletta, A. Jeitler, E. Hödl, J.. Andreu, P. Luley and A. Almer, “Visual Object Detection for Mobile Road Sign Inventory”, Lecture Notes in Computer Science, MobileHCI 2004, pp. 491-495, Springer, 2004.

[12] M. Jia, X. Fan, X. Xie, M. Li, W. Ma, “Photo-to-Search: Using Camera Phones to Inquire of the Surrounding World”, The 7th International Conference on Mobile Data Management (MDM'06), p.46, 2006.

[13] M. Noda, H. Sonobe, S. Takagi, et al., "Cosmos: Convenient Image Retrieval System of Flowers for Mobile Computing Situations", Proceedings of the IASTED Conf. on Information Systems and Databases 2002, pp. 25-30, 2002.

[14] H. Sonobe, S. Takagi, and F. Yoshimoto, "Image Retrieval System of Fishes Using a Mobile Device", Proceedings of International Workshop on Advanced Image Technology 2004, pp. 33-37, 2004.