All of those buttons in these cars are a tiny piece of plastic pushing on a piece of metal, and they can wear out - it's most common to happen with the driver's window control, but all of them are susceptible to it. (That said, I think I've only ever replaced one in mine, and it was the passenger window switch.) Usually the only solution is to replace the switch.
But given it stopped working when you removed it, I'd think something like wiring, or something like that. Is it possible you just didn't get the wiring harness reconnected when you reinstalled it, something simple like that?
I'd pull the switch and use a multimeter to see if it's working at all before anything else. I assume clicking it should close the circuit, but I'll admit I've never had reason to check that. It should be pretty easy to figure out how it should work.