Actually, I think that "harbour" is just a mis-hearing of "labour" (by analogy with other songs) somewhere along the line, but it still makes sense.  As you say, royal births had to be more-or-less public to avoid arguments later on, such as the notorious "Warming Pan Affair".

Malcolm