Yes, I've done that and it worked out well. Just keep your filter media intact. I float mine in the bucket with the fish to keep the bacteria alive. If you have an established biofilter, that's where most of your beneficial bacteria will be, not in the gravel. Just take care to keep it moist...