No, the price of the products remains the same as before the cashback was activated.
However, there is one case where you may notice a difference in price. This is due to the cookies that are added to your browser when you click on an advertisement or a newsletter of a store. They may change the price of a product to encourage you to buy it.