Assume that the probability of success is unimodal as function of dose. Take the response to be binary and the possible treatment space to be a lattice. The Optimizing Up-and-Down Design allocates treatments to pairs of subjects in a way that causes the treatment distribution to cluster around the treatment with maximum success probability. This procedure is constructed to use accruing information to limit the number of patients that are exposed to doses with high probabilities of failure.The Optimizing Up-and-Down Design is motivated by Kiefer- Wolfowitz's stochastic approximation procedure. In this paper, we compare iLs performance to stochastic approximation. As an estimator of the best dose, simulation studies demonstrate that the mode of the empirical treatment distribution using the Optimizing Up-and-Down Design converges faster than does the usual estimator using stochastic approximation.