—The accurate identification and recognition of the traffic signs is a challenging problem as the developed systems have to address a large number of imaging problems such as motion artifacts, various weather conditions, shadows and partial occlusion, issues that are often encountered in video traffic sequences that are captured from a moving vehicle. These factors substantially degrade the performance of the existing traffic sign recognition (TSR) systems and in this paper we detail the implementation of a new strategy that entails three distinct computational stages. The first component addresses the robust identification of the candidate traffic signs in each frame of the video sequence. The second component discards the traffic sign candidates that do not comply with stringent shape constraints, and the last component implements the classification of the traffic signs using Support Vector Machines (SVMs). The main novel elements of our TSR algorithm are given by the approach that has been developed for traffic sign classification and by the experimental evaluation that was employed to identify the optimal image attributes that are able to maximize the traffic sign classification performance. The TSR algorithm has been validated using video sequences that include the most important categories of signs that are used to regulate the traffic on the Irish and UK roads, and it achieved 87.6% sign detection, 99.2% traffic sign classification accuracy and 86.7% overall traffic sign recognition.