Turn the screw all the way out when the car is idling, you should see the piston/diaphram being pulled up from the vacuum source.
Start screwing in the screw until the diaphram shuts, then turn the screw an additonal 1/2 turn. That should do the trick. If not then it might be installed wrong...