A quick "thanks, but no thanks" note is considerably better than no reply at each and every one.
If going to the stadium, there'll be still no problem with wearing the youth NFL jerseys at a barbecue picnic, and you will watch with style.