According to the logic of the Reward Points extension, the feature of including/excluding products from the rule is available for the Get X Points for Each $Y Spent action.
To achieve the desired results, please select the mentioned action, and navigate to the Earning Configuration tab.
Turn the Grant Points For Specific Products option to Yes, select the Include/Exclude action, and specify the product SKUs and categories according to your requirements:
Once done, the points should not be added for the included/excluded products on the storefront.