Yes the auto-timer begins when you have at least 6 players but if anyone leaves the game continues to count down. I just joined a game that not only split my party (need to fix this!) but also only had 3 total players. Love the game but this is beyond frustrating.
That doesn't make it correct. A 6-player minimum by definition needs 6 players. If any of them leave it should stop the countdown.