Conducting doesn't make life any easier for an organist. It even makes it more complicated.
There are two types of organists who conduct - the ones that know what they're doing and the ones that only pretend. And I can give you the choir member's point of view on this, which is "we're fine with it."
"You do whatever it is you gotta do."
To a chorister conducting is like observing the process of abstract painting anyway and determining the movements of the conducing organist is like being asked "what did you see when watching Jackson Pollock at work?"
"Well, I remember there were a lot of paint pouring, I saw him paint with his canvases laid out on the studio floor, and in the end he was literally in the painting."