Yes. You can get 3-5V mechanical or solid state relays with keyfob remotes. I’ve even wired one into a mando style fob.
You still want to flip a physical power switch, or unplug when not in use. The wireless circuit will drain your battery after a few weeks/months of storage.
Portable USB power packs are what I recommend to folks for power. Easily swappable, rechargeable, pluggable.