Several licensees have reported this issue. It is caused by FSocketSubsystemSteam::UnregisterConnection being called twice - once after the player leaves the game, and once when it is garbage collected. If the player rejoins before garbage collection happens, they will get booted from the session.
There's no existing public thread on this issue, so head over to Questions & Answers just mention UE-24554 in the post.