So I'm replaying Yellow Version and..

I had that problem with my Silver. Just take apart the game, and switch out the battery; it should work.

Ok, due to my lack of knowing how to fix things, my dad switched the battery out in my Crystal version. Works fine and no longer has that issue about resetting when tapped.

Still buying a new GBC, but that's because even if I cleaned the insides, the screen is scratched to hell and back.