I think the current design has a problem. Whenever I stop moving my head around, the program sends continuous clicks on a spot.
Can we let users decide on when to click using facial expressions as triggers? For example, an eye blink will trigger a click.
But if you are going to seriously implement facial expressions as triggers for clicks, here are my ideas:
- Normal view:
- Left click:
- Right click:
- Middle click:
- Double click:
- Wheel up:
- Wheel down:
Thanks for your suggestions. Currently you can disable click generation by making click in the click-window's left button (labelled as "No click"). I'm going to add your proposal in the tracker. I hope it can implemented in a (near) future.
First of all let me say AWESOME project. I am setting up a computer for a friend of mine who is a quadrapalegic and I am completely blown away by how well this software works. I second the suggestion that allowing mouse clicking through facial expressions would really improve the project and I think that Duy's suggestions are fantastic. The only suggestion that I would like to add is to allow each eye to be used just like one of the mouse buttons. That way you could click, double click, or click and hold (for dragging) each button simply by closing the appropriate eye. It would also prevent issues with accidental clicking because the mouse is not moved. It would be nice to allow the eye to be assigned to the button so that people that can close one eye easier than the other could assign that eye to the left button. I wouldn't assign any actions to closing both eyes though because it could get confused with blinking.
Duy K. Bui, you can use dwell gesture currently, look at this:
I would suggest a quarter second eye close would make the click more definative and avoid misclicks from blinks.
Left eye closed (more than 1/4 sec) and reopened - Left Click
Right eye closed (more than 1/4 sec) and reopened - Right Click
Left eye held closed (more than 3/4 sec) and head moved - Left Drag (Eye open releases)
Right eye held closed (more than 3/4 sec) and head moved - Right Drag (Eye open releases)
2 Sequential Left Eye Clicks - Double Left Click etc.
I suppose it all comes down to how hard it is to track eye state accurately.
Yes, all comes down to track eyes (state) accurately. There have been some efforts to implement a blink detector. Take a look to branch 'blink_detect' on git.
Log in to post a comment.