Yes. You have to setup the input to be stereo on the track you're armingI just fixed finally. Nope it was not a bad connection I tried every port on my PC including 3.0.
I was disabled the microphone settings early to deny any program to use microphone. I have allowed the microphone usage in privacy settings now. It just works. Now it plays and records beautiful in Reaper.
But same question comes again. When I record my playings in Reaper I can't hear the stereo effects but all the effects comes equally from left and right. Is it because of the single track? I hear the stereo effect while playing, but can't hear the same when I listen my single recorded playings.