If they're counting by size of audience over their career, there's no doubt Lata Mangeshkar would win by a vast margin (as she would also win by sheer volume of recordings) - as much as the next few contenders put together.
Caruso probably #2.
#3 maybe Oum Kolsoum, Sinatra or Elvis?