I don't recommend you withdraw cash there at all, unless you're
on Citibank, which has branches there. PLUS won't work there. Japan
is still a strongly cash-based society and even if you have a card,
ATM's do not run 24-hours, usually only when the post office is
open.
In fact, the only ways I use a card overseas is to swipe for
purchases and hotel stays. It's the most fool proof way to leave
your cash for daily usage.
And don't worry, everyone there is used to carrying a few ten
thousands out, but you should worry about your bringing cash out
unless you plan to step into red light districts like Kabukicho.
Otherwise Japan is a very safe country, much like Singapore, just
have the normal precautions and some vigilance.
http://www.japan-guide.com/e/e2208.html
