Click on the Playlist link in the bottom right corner of the video player to view the entire video library.