When "Show Collections" is disabled in the View Options, the button to save Dynamic Collections based on the current search filter does not react in any way.
There's no existing public thread on this issue, so head over to Questions & Answers just mention UE-36063 in the post.