Well, actually the ndiswrapper module isn't in use until you bring up the network interface.
Only once you bring up the interface assigned to ndiswrapper should the "Used by" number of lsmod be higher than 0.

ndiswrapper -m
ifconfig <interface> up

What happens when you do that?