According to Doctor Johnson, dinner is "the chief meal; the meal eaten about the middle of the day".

Nowadays, as I only eat two meals a day. I have a late Breakfast (break my fast), then have my dinner at teatime or later. I don't think I'd use the word dinnertime as it's too ambiguous.