We only need one "recent" per set, not NUM_WAYS recents. Slightly faster. Breaks savestate compatibility.