Generally decide a tree or plant with regards to the exactly where they ought to keep it.
If left on the ground now, they'll make a wet, slippery mess that's inviting to pests. They have the unusual habit of blooming below the leaves below of the plant.