And Williams, 32, says he is prepared to fight dirty if Skelton provokes him during this Saturday's July 8 showdown.
The Commonwealth heavyweight star says he has not forgotten and remains upset over low blows he argues Skelton dished out during Williams' points win back in February.
Now the bruiser from Brixton warns he may get dirty if the previous Commonwealth and British ruler does anything underhand.
"If Skelton does anything dirty again then I'll give it back - I'm not going to stand for it again," cautioned Williams.
"I can dish it out if he tries any of that business on Saturday. I'm ready for him and I can only see a Danny Williams stoppage.
"It's going to be really hard for Matt Skelton to get past the sixth round."
But Skelton, born in Bedford, has hit back himself, insisting Williams was just as dirty as him and hopes the referee Howard Foster will be tough on both men.
"I don't mind if the referee is tough as long as it's not one sided," said Skelton. "In the first fight Williams kept turning his back on me so much. I thought he was leading me back to his changing room."
Will Williams get his revenge as he hoped or will Skelton put some dirty moves on him? Watch and find out!