Fish4Knowledge Project

The Fish4knowledge project investigated: information abstraction and storage methods for analyzing undersea video data (from 10E+15 pixels to 10E+12 units of information), machine and human vocabularies for detecting & describing fish, flexible process architectures to process the data and scientific queries and effective specialised user query interfaces. A combination of computer vision, database storage, workflow and human computer interaction methods were used to achieve this.

The project used live video feeds from 10 underwater cameras as a testbed for investigating more generally applicable methods for capture, storage, analysis and querying of multiple video streams. We collated a public database from 3 years containing video summaries of the observed fish and associated descriptors. Expert web-based interfaces were developed for use by marine researchers, allowing unprecedented access to live and previously stored videos, or previously extracted information.