(Peony) These clump forming herbaceous perennials are grown most often for their colorful blooms that appear beginning in mid to late spring. Peonies prefer soil that is fertile, humus-rich and moist but well drained. Remove flowers when blooming has finished and cut foliage to the ground in fall.