The 29-year-old midfielder's former club come to Sixfields for a vital League Two clash.
Holdsworth told BBC Surrey: "When Luke and I shook hands when he left (Aldershot in January before signing for the Cobblers), we had an agreement that whoever he joined, he wouldn't play against us this season.
"In a gentleman's agreement, you hope people stick by it."