Prince Harry Stayed at Althorp, Princess Diana’s Childhood Home, During Recent U.K. Visit (Exclusive)

Prince Harry made a poignant visit Althorp House, the ancestral home of his late mother, Princess Diana, during his recent trip to the U.K.

The Duke of Sussex, 39, stayed with his uncle Charles Spencer at Althorp House following his surprise appearance at the memorial service for his late uncle, Lord Robert Fellowes, on August 29, PEOPLE has learned.

Spencer had no comment when reached by PEOPLE.

Fellowes, who was married to Diana’s sister Lady Jane, was remembered at the service, which was also attended by Prince William, 42, and Diana’s other sister, Lady Sarah McCorquodale.

The service was held two days before the 27th anniversary of Diana’s death on Aug. 31. Diana, who was 36 when she died following a car crash in Paris, is buried on the island in the middle of Round Oval Lake at Althorp.

On the anniversary of his sister’s death, Charles, the 9th Earl Spencer, honored Princess Diana on Instagram with a tribute post featuring a collage of photos and newspaper clippings. The collection included images from Diana’s christening and a childhood photo of her playing outside.