Nice pagoda. Thiên Hậu is worshipped in the seafaring Chinese communities of Fujian, Guangzhou, Taiwan, and Southeast Asia. She is not specifically a deity of Taoism or Buddhism,
If you wanna buy some incense for praying, don't buy it in front of the pagoda as it's very expensive. You could get it inside the pagoda at a much cheaper price.