If the idle changes while pressing the brake pedal you have a booster issue. I've had a rebuilt unit I had to send back a second time.
You can use a handheld vacuum pump with gauge hooked up to the booster, put vacuum on the booster if it holds vacuum booster is good. If it loses vacuum booster has an issue.