OpenVIDIA : Parallel GPU Computer Vision

i am a good programmer but i am a newbie in the vision filed.
where to start?

my plan is
find the needed libraries.
make stereo images to 3d
find objects and places horizontal - walking plane , and surrounding vertical
unfold the 3d space with gpu
understand what is there:
match walking plane to known patterns of road signs
see if there is there is a red light in the front
and see if there are no obstacles in the surrounding.
detect stairs.

it will be used with a gps and a map.

please suggest me a good plan with more detail then my,
and suggest me what libraries and software i can use.