Make sure all created and modified asset in a re-import are mark dirty. Creating a collision mesh was dirtying the asset, this is why the bug is only when we are not generating collision mesh.
There's no existing public thread on this issue, so head over to Questions & Answers just mention UE-38450 in the post.