No, you don't seem to understand what I mean when I say impossible...
When you rate a member, you change the member's score, and YOUR datafile includes that rating... but the end user's file only maintains the running score and the number of votes.
Because of the way the ratings are weighted, in order for your vote to be changed, each and every vote on that user would then need to be recalculated. There's no one place where all the ratings are stored for one particular user. You'd have to go through each and every individual member's voting record....
And even then, the recalc would be wrong because it would be based on the other member's weights from their CURRENT rating rather than the rating they had originally.
Now, as I was saying - this is impossible. You'd have to rewrite the entire rating system.