Facebook artificial intelligence now allows you search photos, not only by the uploader or its tags and captions but by what’s in these photos.
This AI has been used as a way of making it very easy for visually impaired persons to use the website, but it seems the company is now extending the use of its Lumos computer vision platform to power image content, not only for the visually impaired, but all users. With this unlocked ability, you will be able to search for images on Facebook using keywords describing the contents of the searched photo.
It was revealed that Facebook had to train an ever-fashionable deep neural network (Lumos) to identify millions of photos. This model now matches search descriptors to certain features that have been pulled from photos with some level of probability.
Just as in most searches, the model will be ranking its results based on information from the images and the original search, and to avert the possibility of you getting the same images multiple times in search results, Facebook will be ensuring that photo results are very diverse, which may mean it would be registering each uploaded photo uniquely.