Gregory is known for a posthumous photograph that he took of the bushranger Lowry in 1863 that was reproduced in the Illustrated Melbourne Post. He was born in London and lived in Australia for 45 years, 38 of which he spent in Goulburn. On making his home in Goulburn, he first opened a photographic studio which he carried on alongside his fancy goods shop in the 1860s.