The distance to the sun does not change enough for its diameter to change visibly, but the angle of setting varies with latitude and with season, and that does alter the time taken to cross the horizon.