It's not that hard. You must be understanding it wrong. Try to keep your controler stable and then slowly spin the analogs to the given position and hold them there. Then to change positions don't drop them, just spin them again slowly. You don't need to do it very quickly but when you reach it you have to hold still.
Turns out my first controller's left analog doesn't work properly when I'm pointing up. I used my second controller to do it.