Follow the guidelines for the filter you have, most recommend replacing them every 2 - 6 months. Be sure to check your instruction manual for instructions since incorrectly replacing your filter could result in un-filtered water. If you have a Brita, find out how to recycle your filters here.
Photo Credit: Brita
Source: Greg O'Keefe, co-founder and COO of MyEnergy