I assume that some don't care, but those that do might decline (or blacklist) you because of the template/similar design issue.
There's also the problem with downloading the sponsors galleries & putting them on your servers - just make sure they allow that before you do it as they might not have permission to allow affiliates to use the content on their servers.
On the other hand, you're probably always safe building the galleries yourself using the promo materials the sponsor provides
