I still have to do this job on my car, I've read that you can disconnect the box and pull it far enough away to replace the bushings. Also read that you have to be careful reassembling it, otherwise the turn signals won't cancel properly. You'll be pleasantly surprised when you price the bushings, they're like about $4 or $5 apiece. Of course, not much to them.
I found a few references that said you should also replace some washers, but I was not able to find anything definitive with part numbers.