I'm not sure I understand the problem. Is it not being able to find ANY other musicians...or being excluded when you do?

In the festivals I have been to in the USA, almost any musician is welcome to join a group...unless their 'shtick' is "being the show".

If it is the wandering that is the issue, we now have instant communication with devices that allow planning and arranging meetings.