They shouldn't be most of what you eat, since they have a lot of digestible carbohydrates compared to the amount of fiber, fat, and vitamins, but they are certainly not bad for you.

Your calories (unless you're a genetic outlier) should be relatively evenly split between carbs and fat. If whole grains are where most of the carbs are coming from, that's fine. Science says so.