To do something by the numbers means to do it exactly, precisely. The origin of this phrase goes back to the American Revolutionary War where a book containing numbered positions for rifle and bayonette practice was used to train soldiers. In the book, each diagram was numbered.