Probably the fill valve in the tank has a leak in it. If the fill valve is old, you should replace it. Sometimes the shaft or wire that is used to set the level corrodes off. If the shaft or wire seems to be your problem then by replacing this you should fix your problem. Another possibility, if the fill valve has been replaced recently, is that it could be set too high.