Visual words, as used in image retrievalsystems, refer to small parts of an image which carry some kind of information related to the features, or changes occurring in the pixels such as the filtering, low-level feature descriptors.
History
The approaches of text retrieval system, which developed over 40 years, are based on keywords or Term. The advantage of these approaches is particularly due to the fact that they are effective and fast. Text-search engines are able quickly to find documents from hundreds or millions. In the same time of that, text retrieval systems have a huge success, the standard image retrieval systems have a large number of limitations. Consequently, researchers try to take advantage from text retrieval techniques to apply them to image retrieval. That can be by a new kind of vision to understand images as textual documents, which is visual words approach.
Analogy text-image
Let’s consider that the pixels of an image, which are the smallest parts in a digital images, are like the letters of an alphabetical language. Then, a set of pixels in an image is a word. Each word can then be re-processed into a morphological system to extract a term related to that word. Then, several words can share a same meaning, each one will refer to the same term. More than one words shared the same meaning and its belong to the same term. By this view, researchers can take advantage from text retrieval techniques to apply them to image retrieval system.
Visual definitions
If we apply this principle to images then we have to find what those words and terms will be in our images. The idea is to try to understand the images like a collection of "visual words". Definition 1: Visual word: it is a small patch on the image which can carry any kind of interesting information in any feature space. In general visual words exist in their feature space of continuous values implying huge number of words and therefore a huge language. Since image retrieval systems need to use text retrieval techniques which are dependent on natural languages and this ones have a limit to the number of terms and words, there are important needs to reduce the number of visual words. A number of solutions exist to solve this problem, one of them is to divide the feature space into ranges, each one having common characteristics, nonetheless this solution carries many issues, like the division strategy, the size of range in the feature space, etc. Another solution proposed by researchers is using a clustering mechanism to classify and merge words carrying common information in a finite number of terms. Definition 2: Visual term: it is the clustering result in the feature space, more than one patch can give nearest information in feature space, so we can consider it in the same term. As the Term in text refer to many common words have same characteristics, the visual term, it will refer to all common words which shared the same information in feature space. And if all images refer to the same set of visual terms then all images can speak the same language. Definition 3: Visual language: it’s a set of visual words & visual terms,. And all images will be represented with this visual language as a collection of visual words or what can call it bag of visual words Definition 4: Bag of visual words: it’s a collection of visual words which together can give information about the meaning of the image at all. Based on this kind of image representation, we can then use text retrieval techniques to design an image retrieval system. However, since all text retrieval systems depend on terms, the user’s query images must be converted into a set of visual terms in the system. Then, it will compare these visual terms with all visual terms in the database.
