You'll usually only get page-outs when your low on main memory (RAM), in those case's you'll be glad you have a fast SSD.
If you were to run out of memory with paging (what your calling "Swap") disabled, the OS would most likely crash.
"Paging is an important part of virtual memory implementation in most contemporary general-purpose operating systems, allowing them to use disk storage for data that does not fit into physical random-access memory (RAM)."