You did the right thing. Take the high road and do not let others soil your attitude with their actions!
For myself I generally reward fly casual with fly casual and heavy handed ness with heavy handedness.
For example, at a round 4 game of a hyperspace trial I just went too, I accidentally sent two of my A-Wings banking the wrong direction. My opponent was gracious enough to let me change the dial because it was obvious I intended to go the other way (it was the 2nd turn of the game). Later he made a mistake of the same kind and I graciously let him change the dial to the opposite maneuver. Neither change won either of us the game, but the attitude of how we approached each other in that moment was one of mercy. We both asked the other player permission for the change and humbly accepted their judgement. On the flip side of that I have played plenty of people who have been very angry when they realized they made a mistake or had dice not go their way. One player even threw his dice across the room!
Its OK to call the judge over to settle disputes, there is no shame in it! Especially on players who are not marking tokens correctly. I don't care about missing cards but not remembering sfoils is something that cannot be allowed.
Ultimately in all of these situations it is best to consider the event you are in, the level of that event and the ability of your competitor. If your opponent is some kid and its round 2 in a FLGS store champ, have mercy on the guy. If its the Top 8 cut at a Trial/System Open and some guy forgets to flip his Foils, graciously remind him that he missed his opportunity and if he wants to compete at this level he needs to remember such things.