It's the adapter, they are shoddy and don't work, your best bet is to buy another brand or get used to the controls untill you have your PS2 back in working condition.
Look at it this way....I did it with the controller...I'm the MASTER with the controller!