Case in point: my wife can do it.
Well we all know that, I've seen Cpt.Darling land tons of planes!!
Only joking, of course!
On a more serious note, I don't have much useful advice for the controller conflict, but as for flying, it will take time to get used to. I'd say take it as slowly as you need to - get used to using rudder, aileron and elevator first. Then try using them together. After that, try out some manoeuvres!
The learning curve is a little steep, but it's well worth it. RoF has tons to offer once you get the hang of it!