The Makefile tries to install the man page into:
$(INSTALL_DATA) setserial.8 $(DESTDIR)/usr/man/man8
This can be ok if DESTDIR is set to "/", but it's wrong
in other cases.
As a comparison, setserial binary is delivered under:
$(INSTALL_PROGRAM) setserial $(DESTDIR)/bin
I attached a patch with a fix.