Personally, if I see them on a fish, I'm not keeping... I'm sure there are plenty of other parasites on fish that I don't see and eat. I always cook fresh water fish, and any inshore saltwater fish.
Freezing fish fillets will kill some parasites as well, so does brining.