If you plan on flying, why not directly to Halifax International Airport and rent a car there. You could then visit Citadel Hill which is pretty fantastic then walk down to to Spring garden Road and walk the beautiful Botanical Gardens. You are still about 4 hours from the Fortress of Louisbourg but a little nearer than Brunswick ME.
The music scene someone else will have to suggest.
Adrien