Despite sharing the same name, the Taiwanese tempura has nothing to do with the Japanese one. It's made with fish paste, battered and then fried. Very popular in the night markets, where it's sold along with other fried bites such as squid, sweet potatos, tofu, blood pudin and vegetables.
My personal recommendation is Shu Yuen in Shida night market.