A betta and a frog in that small a tank isn't a great idea. It probably holds just over a gallon of actual water.
I've kept a betta alone in a 2.5 gallon for a year. even with a ton of plants, a weekly 50% water change barely kept it healthy.
Try just a betta, weekly water changes, and yes a heater. As mentioned above, temperature stability is important.
Another issue with the small tank: the tiny heaters made for that size don't keep temperature stable, they just keep it 2 degrees or so above room temp. So of the room fluctuates, it's pointless.
I'd suggest a 50w heater with a thermostat. They're bulky but it's distressing and expensive to start treating illnesses.
I ignored all this advice and lost 3 bettas and 4 snails over a period of a few months. Upgrading to a 3 gallon with a good heater and large weekly water changes, and keeping only the betta and one nerite snail, is where things finally got healthy.
Sent from my iPhone with three hands tied behind my back.