Cannot start game with 2 Friends only in Lobby

Hey Guys! Two friends of mine and me wanted to start a game, with only us three in the Lobby. Problem: I cannot start the game until the lobby is filled up with strangers. With only 3 people in the Lobby, I can "Leave" but cannot "Ready up". Does anyone have a solution for this? Would be great!

Cannot start game with 2 Friends only in Lobby