A common mistake is to lump ALL species of goldfish into the same category. Most of the fancy species show their best growth, and color, in tropical temps. Many of the expert champion breeders raise the fancy breeds such as Ranchu, Lionhead, Oranda, etc at approx 78-80F. (at least for the first year)
Most goldfish will tolerate wide ranges in temperature, but any changes, either up or down, should be gradual.