If there is an infinite number of alternate universes, in one of them there is a universe which does not have an infinite number of alternate universes.
This paradox will keep me awake tonight thinking about it. Well, OK, probably not me, personally, but some alternate version of me will be fretting about it somewhere.