While Playing with my Monitiors...

Right click the folder on the taskbar, choose "move". Now you can use the arrow keys to move it around, and then move the mouse and it follows that (click to make it unstick). Exact behaviour varies between Windows versions though.

What? Maybe I'm tired, but I read that and had no idea what you just said.
Did manage to solve it after screwing around with my monitors' resolutions. Right lowered, left lowered, right raised, right raised worked... or something like that.