(I suspect this may be a PDF Kit limitation, but reporting in the case that there is something that can be done on Skim's side to fix this.)
When multiple full pages are visible at once (think ~3 beamer slides all fitting in one screen) then the "Next" and "Previous" items in the "Go" menu don't behave properly.
In particular, "Previous" often does nothing. I think this may be because when, for example, three pages (named A, B, C) are all visible, the "active" page is considered to be the middle one, i.e. "B". The Previous command wants to ensure that "A" is visible, which it is, so it does nothing. Better behavior would be to scroll exactly one page height so that A takes the place of B in the middle.
In this situation, the "Next" command ends up jumping more than one page at a time.
This is essentially a duplicate of bug # 1470 and really also # 1478. This is indeed a disconnect in PDFKit. But it is not feasible to work around this for us. (That would more probably create more bugs than it fixes, I know from experience).
As for scrolling one page height, there is the Page Down and Page Up scrolling command (Fn-Up/Down on most laptops).
OK, thanks — I didn't notice those because I'm not using "horizontal continuous", but I agree it seems like it's the same issue.
Page Up and Page Down scrolls by the window height, not the page height (or am I missing something?)
That is correct.