Just as "studenice" could be a cold spring, so "teplice" is the name of warm water in the feminine gender. So it is the hot spring.
If there are several hot springs together, they are TY teplice in the plural. Spas in which Bílinská kyselka a Jaječická bitter the water used is now called Lázně Teplice in Bohemia.