Gregory is known for a posthumous photograph that he took of the bushranger Lowy in 1863 that was reproduced in the Illustrated Melbourne Post. He later moved to Auckland where he opened a photographic studio, painted landscapes and still lifes and carved pew ends and altars for New Zealand churches.