You should add negative keywords to your campaign or ad group to prevent your Shopping ads from appearing for certain search terms.

Explanation: While Shopping campaigns don’t use keywords to target your ads, you can use negative keywords to help prevent your Shopping ads from appearing when you don’t want them to.

Read more here: https://support.google.com/adwords/answer/6275313