Do you notice a reaction to grains or dairy? Inflammation? Fatigue?

I have been able to see a big difference when consuming grains. If I eat a sandwich or something for lunch I'll notice that I don't have as much energy compared to when I eat some eggs and sauteed veggies. I feel like I can get away with using cheese and butter, but milk definitely bothers me.