if its intermittent like that, its probably the switch or the regulator motor or some loose/frayed/burned wiring. I'd swap the switches from side to side and see if the passenger side switch works when the drivers side doesnt. I know it wont fit in there, but it should plug up and you just let it hang there, y'know for testing purposes only.
__________________
image courtesy of wnracing
/\/\FOR SALE/\/\
|