@Henrik phil,
I don't see it as distracting. The actual number of reputation points is not posted except in your personal profile, and you can't see what other people have accrued.
Look at the member list. There are 498 members. Of these, only 10 have 3 or more little green boxes and 8 of the 10 are current or former moderators, i.e. people who have been involved with the forum most heavily and for the longest. Only an additional 15 people have 2 boxes.
This means that 473 of the 498 registered users have only one box.
Now, you'll disproportionately see posts by people with more boxes, but that's no surprise -- you accrue 'reputation' by making helpful posts and by taking an active part.
I'm not sure the reputation score matters much, but I DO like the "Thank You" function a lot, and that's the main determinant of the reputation score.