Let me explain something. That "fish taste" comes from old fish. Fresh fish really has no smell and tastes relatively mild, except for maybe Monk fish. Get yourself some seriously fresh fish and you will avoid that taste.
Honestly, if you don't like fish, don't eat it. Get protein from beef, chicken , eggs and pork. Take fish oils to supplement the fatty acids.