I don't think that many people would care if they just stopped the show for awhile.
All these talk shows are not the same without a studio audience.
You can say that about any entertainer, singer, actor, TV personality. One goes away, second comes in place