In this work we emphasize the need for and we describe a first- of-its-kind RSVP (Rapid Serial Visual Presentation) - EEG (Elec- troencephalography) dataset to be released as part of the NTCIR-13 NAILS (Neurally Augmented Image Labelling Strategies) task at the NTCIR-13 participation conference. The dataset is used to support a collaborative evaluation task in which participating researchers benchmark machine-learning strategies against each other. The experimental protocol used to capture the dataset is designed to encompass a broad range of image search activities and coincident neural signals. Here, we outline the experimental protocol used to capture the dataset alongside discussing the motivation behind its construction.