Stay at the Caesar Park Taipei Hotel. Used to be the Hilton
Taipei.
It's literally right on top of the Taipei Main Railway Station,
with all their MRT lines there.
Lots of food stalls around too. Super convenient, and also
cheap. You can also walk to the CKS Memorial Park and President's
Palace from there, about 15 mins.