VFYW Dataset

Introduction:

VFYW Dataset is designed for Image localization problem. The dataset currently consists of 73 query images labeling with ground truth location and negative locations. The ground truth location is represented by city and geographic coordinate. Negative locations were collected from wrong guesses and rephrased into city to avoid ambiguity. Other negative locations can be obtained by the results feeding query image into Google Search by Image.

All query images and human responses are collected from VFYW contest and will update weekly with the contest.

The degree of difficulty of query images can be assigned with three levels by the precision of winner's answer:
a. No one Correct
No one answered the correct city. (9/71)
b. Up to a City
The winner answered the correct city but not provide the exact location. (12/71)
c. Exact location
The winner gave exact location of query image. (50/71)

Here are some sample images of different degree of difficulty.
a. No one Correct

b. Up to a City

c. Exact location

Here an example (#71) is shown to illustrate VFYW dataset.

Query image (solved with exact location)

Ground truth location:

'Dhaka, Bangladesh'

'23.754239,90.392075'

Negative location (guesses from human)

'Tripoli, Libya'

'Maputo, Maputo City, Mozambique'

'Kinshasa, Democratic Republic of Congo'

'Dar es Salaam, Tanzania'

'Iquitos, Peru'

'Managua, Nicaragua'

'Cairo, Egypt'

'Beirut, Lebanon'

'Famagusta , Cyprus'

'Bangkok, Thailand'

'Mumbai, India'

Negative location (Google search by image, keyword 'google map panoramio' is added to ensure every retrieved image with geo tag)