“Get to” has many meanings, but in this case it means a destructive person or animal ruins or uses all of something. When this happens, you feel annoyed or disappointed.
Some mold got to it so I threw it away.
Similarly, we also say “get into (something)” if someone opens and destroys something that was closed or contained.
Spike got into the garbage again.