The Denise emulator author implemented the binary interface on his emulator and it works peachy. He also suggested three extra methods that would be awesome to have in VICE as well. AFAIK he was in talks with you about this.
The feature request would be three methods, to advance a single frame, advance a single raster line, or advance to a specific raster line. The command does not overlap with any of VICEs, and would look like this. The command is to be used in stopped mode (potentially also in running mode?), once the condition is reached the debugger breaks and any (internal) temporary breakpoint is dismissed (in other words, the command only triggers once)
advance lines (0x74)
body:
AC | LI LI( little endian, like all other multi byte values in other commands)
AC:
0->step to next line, 1->step to a specific line( LI), 2->step to next frame
e.g. to advance a line
0201030000000C00000074000000
02 STX
01 Version
03000000 body length
0C000000 request ID
74 MON_CMD_ADVANCE_FRAME
00 step to next line
0000 not used here
e.g. to advance to a specific line
0201030000000900000074014B00
02 STX
01 Version
03000000 body length
09000000 request ID
74 MON_CMD_ADVANCE_FRAME
01 step to specific line
4B00 raster line 75 ($4b)
e.g. to advance a frame
0201030000000F00000074020000
02 STX
01 Version
03000000 body length
0F000000 request ID
74 MON_CMD_ADVANCE_FRAME
02 step to specific line
0000 not used here