Hi,
Are you using same SWPM which you used from Windows server, if yes then it won't work. You need to download AIX specific SWPM.
To trigger the same from your Windows server better you login with <SID>ADM user and switch to SWPM directory through command line and then from there you can fire the command as: sapinst.exe SAPINST_USE_HOSTNAME=<DBHOST>
Better you download AIX specific SWPM and using <SID>ADM user from your DB host machine switch to SWPM directory and use the command:
./sapinst SAPINST_USE_HOSTNAME=<DBHOST>
Regards,
SUJIT