After a bit more experimenting, and finding it will open in XP, the solution may be embarrassingly simple.

For some reason, the downloaded file is called 'viewTaxReturnPdf'. When I renamed it to 'viewTaxReturnPdf.pdf', all was well and it opened in Ubuntu. A dot makes all the difference.