It depends entirely on the bug and moreso the seasoning. I've eaten my share of ants and crickets in Mexico and South East Asia and the taste can vary wildly. I recall tasting the seasoning more than any buggy flavor.
On a side note, raw goat blood soup tastes exactly like you think it would... never again.