I grow my plants in regular gravel also but they will and trust me, are more work to keep them in place. I love live plants and have dealt with my fish pulling them out and having to replant them 2-3 times a week. One tank has botia loaches and african dwarf frogs and the plants need to be replanted almost daily. Even in the tank that doesn't have anything but swords, tertras and 3 cory cats seems to have be replanted twice a week. I keep the plants because I don't mind the extra work keeping them in place.
As for decorations and caves, go to the
DIY section. There is a lot of ways to make fancy decorations. On has pictures of really nice caves he makes from a
PVC pipe fitting. I haven't made one yet but I will be in the future. There is also one I put in there with the same concept but using plastic canvas for the rocks so you can shape the cave any way you want to. Lots of options.
As for starting a planted tank, make sure you get all the advice you can before getting started. I didn't and with what I actually want to create, I have to switch to Eco-Complete or similar substrate. If all you want is a couple plants in the tank then gravel should work if you use the fine stuff and no epoxy coating, it kills my roots before they ever get into the gravel enough to take hold.
Post a discussion that tells exactly what you want to do, that way you will know if it is more than what you want jump into or not. I want a tank that has a plant carpet over the entire bottom of the tank and a plant wall that covers the back of the tank. Can it be done, absolutely, but it will take a lot of work to get it there and will require my using something other than gravel as my substrate, or at least that is what I have been told on here.