If it's varnished there's a good chance that it'll be chipped somewhere and you'll be able to see the depth of the varnish at the edge of the chip. If it's wax polished you'll get scratches but not bits chipped out.

I used brazil nut on polished dark English oak and it looked okay. Test a less visible bit first.