I'm using the board left over from a standard usb keyboard, I took it apart and use the controller buttons to simulate keyboard strokes (a,s,d,f / 1,2,3 etc.) I'm probably using the wrong terms

I just do this kind of stuff as a hobby and don't have too much experience.
Thats great to hear you think its possible! How would I know what the "right pot" is? I was hoping to break down an old generic usb ps2 knock-off or (preferably) use a joystick from a wii nunchuck.