Another beautiful town to check out between Toronto and Montreal, especially if you are going to go towards Ottawa on your way, is Perth. In fact that whole area is really nice. Perth has a wonderful old downtown of stone buildings, lots of fun places to poke around, and there's a pretty lively arts scene in the area.