The Video Annotation and Reference System (VARS) is a software interface and database system that provides tools for describing, cataloging, retrieving, and viewing the visual, descriptive, and quantitative data associated with video.
Emma (Extensible Multi Media Architecture) is an open-source, modular, extensible, dynamic framework for declarative authoring and display of 2D and 3D interactive multimedia. It uses Lua for scripting and Ogre3D for rendering. http://www.emma3d.org