As you remove diseased materials, don't throw them in your compost bin. This will help keep the problem from spreading around your garden next year. If there is no disease problem, leaves and small twigs should be added to your compost. The leaves of perennials are the perfect addition to making some really rich compost for next year's garden.