Save on compile does not work in the level blueprint

Save on compile does not save the level blueprint when compiling the level blueprint.

1. Open the editor
2. Set Save on Compile to Alway
   Editor preferences > Blueprint Editor > Compiler > Save on Compile
3. Open the level blueprint
4. Add a variable
5. Compile
6. Close the level blueprint
7. Click save all
8. Notice that it lists the level blueprint

Expected: The level would be saved on compile
Result: The level is not saved on compile