Wobbly hand grinder

Mine does that too. It's a side effect of how the grind adjustment works.

The bigger issue in my opinion is the side to side slop on the holders for the main shaft. You can "fix" it by thickening the shaft with some electrical or gorilla tape, but that much slop on the fitting tolerances shouldn't exist to begin with.