Test collections have a long history of supporting repeatable and comparable evaluation in Information Retrieval. In this paper we describe NTCIR12-Lifelog, a first lifelog test collection to support comparative benchmarking of lifelog retrieval systems. We provide an overview summary of the test collection and motivate use-cases of its application. This test collection is being employed at NTCIR-12 to evaluate approaches to Lifelog data search and organisation.