Just don't make the mistake of burying your herbaceous peonies too deep. Going more than an inch or two beneath the surface ...

Be sure not to plant them too deep (no more than two inches between the eyes and the soil surface), or ... planting a bare root peony, you will get a plant with leaves the following season ...