I always thought that the term 'navvies' was from navigation. The people that worked on the inland waterway systems and canals in the UK were known as 'navvies' because they worked on the (inland)'navigations'.