Using the maximum resolution available on the monitor for windowed mode results in the window overtaking the Windows taskbar.
Result: The game window will cover up the Windows taskbar even though its running in windowed mode.
Expected. The game window will not cover the taskbar as if it was a fullscreen application.
There's no existing public thread on this issue, so head over to Questions & Answers just mention UE-65532 in the post.