The XM2VTS Database of Faces

Changelog

  • Version 4, 30/Jan/2018:
    • Port to beat.backend.python v1.5.0
  • Version 3, 02/Nov/2017:
    • Port to beat.backend.python v1.4.2
  • Version 2, 20/Jan/2016:
    • Port to Bob v2
  • Version 1, 21/Oct/2014:
    • Initial release

Description

The XM2VTS database is a large multi-modal database that was captured onto high quality digital video. It contains four recordings of 295 subjects taken over a period of four months. Each recording contains a speaking head shot and a rotating head shot. Sets of data taken from this database are available including high quality colour images, 32 KHz 16-bit sound files, video sequences and a 3d Model.

The database was aquired within the M2VTS project (Multi Modal Verification for Teleservices and Security applications), a part of the EU ACTS programme, which deals with access control by the use of multimodal identification of human faces. The goal of using a multimodal recognition scheme is to improve the recognition efficiency by combining single modalities, namely face and voice features.

http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/000_1.jpg http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/001_1.jpg http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/002_1.jpg http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/003_1.jpg

http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/000_2.jpg http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/001_2.jpg http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/002_2.jpg http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/003_2.jpg

http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/000_3.jpg http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/001_3.jpg http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/002_3.jpg http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/003_3.jpg

http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/000_4.jpg http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/001_4.jpg http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/002_4.jpg http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/images/003_4.jpg

This deployment of the XM2VTS database only consists of the images.

Search experiments

train

Output name Data format
image: system/array_3d_uint8/1
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)

dev_templates

Output name Data format
image: system/array_3d_uint8/1
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
template_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)

dev_probes

Output name Data format
image: system/array_3d_uint8/1
probe_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
template_ids: system/array_1d_uint64/1 (Basic format containing a one-dimensional array of unsigned integer (64 bits) values)

test_templates

Output name Data format
image: system/array_3d_uint8/1
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
template_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)

test_probes

Output name Data format
image: system/array_3d_uint8/1
probe_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
template_ids: system/array_1d_uint64/1 (Basic format containing a one-dimensional array of unsigned integer (64 bits) values)
Search experiments

train

Output name Data format
image: system/array_3d_uint8/1
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)

dev_templates

Output name Data format
image: system/array_3d_uint8/1
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
template_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)

dev_probes

Output name Data format
image: system/array_3d_uint8/1
probe_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
template_ids: system/array_1d_uint64/1 (Basic format containing a one-dimensional array of unsigned integer (64 bits) values)

test_templates

Output name Data format
image: system/array_3d_uint8/1
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
template_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)

test_probes

Output name Data format
image: system/array_3d_uint8/1
probe_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
template_ids: system/array_1d_uint64/1 (Basic format containing a one-dimensional array of unsigned integer (64 bits) values)
Search experiments

train

Output name Data format
image: system/array_3d_uint8/1
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)

dev_templates

Output name Data format
image: system/array_3d_uint8/1
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
template_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)

dev_probes

Output name Data format
image: system/array_3d_uint8/1
probe_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
template_ids: system/array_1d_uint64/1 (Basic format containing a one-dimensional array of unsigned integer (64 bits) values)

test_templates

Output name Data format
image: system/array_3d_uint8/1
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
template_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)

test_probes

Output name Data format
image: system/array_3d_uint8/1
probe_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
template_ids: system/array_1d_uint64/1 (Basic format containing a one-dimensional array of unsigned integer (64 bits) values)
Search experiments

train

Output name Data format
image: system/array_3d_uint8/1
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)

dev_templates

Output name Data format
image: system/array_3d_uint8/1
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
template_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)

dev_probes

Output name Data format
image: system/array_3d_uint8/1
probe_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
template_ids: system/array_1d_uint64/1 (Basic format containing a one-dimensional array of unsigned integer (64 bits) values)

test_templates

Output name Data format
image: system/array_3d_uint8/1
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
template_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)

test_probes

Output name Data format
image: system/array_3d_uint8/1
probe_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
file_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
client_id: system/uint64/1 (Basic format containing only a single unsigned integer (64 bits) value)
eye_centers: system/eye_positions/1 (The position of the eyes of a person in an image)
template_ids: system/array_1d_uint64/1 (Basic format containing a one-dimensional array of unsigned integer (64 bits) values)

This database is Public

Sharing for databases is controlled exclusively by platform administrators. Get in touch if you'd like to change access control for databases hosted on this platform.

Terms of Service | Contact Information | BEAT platform version 2.1.1b0 | © Idiap Research Institute - 2013-2020