Open Task Manager with Ctrl+Shift+Esc.
Find Windows Explorer, select it and click Restart.
The taskbar flashes for a few seconds and returns without a full reboot.
Windows
Restart Explorer without restarting the PC
When the taskbar freezes, restarting Explorer often fixes it without closing everything.