Bayliss trained in Melbourne, winning a Gallery Art School Scholarship in 1935. Later training in London, after the 1939-45 War, he became a production assistant at Covent Garden Opera House. He returned to Australia in 1965, teaching art in Croydon, Victoria.