Bras are annoying, period, even the ones that fit properly.
BREASTS are annoying. Unsupported breasts, if they are breasts of any size, are even more annoying. (Mine cause rather a lot of back pain.)
But bras should not hurt, or dig in, though they have to be snug or they don't offer proper support.