I've heard it used in conversation in Northeastern United States. A radio etymologist who used to be on National Public Radio ("Good words to you") once aired the origin as blacks working in synagogues overhearing the Hebrew words "kol be sefer" meaning "by the book".