I switch between default and "more space" at various times on my M3 Pro 14" 12 core / 18GB / 1TB. Haven't noticed much difference in terms of performance.
Gaming and other resource intensive tasks can take a ~5-20% performance hit along with maybe a bit less battery runtime.