In which Gilmore Girls episode does Logan first realize/acknowledge Rory's family connections?

Does he know all along? When does he put the two together and realize that Rory is Richard's granddaughter? Can't wait to hear your answers because once I hear from you, I'm totally going to watch that episode so I can witness the moment! :)