It really depends on how much scratches bother you. I would be super upset to have a visible scratch on my watch. It might never happen, but there is a good chance of it. I have worn watches for most of my life. The cheaper ones with mineral crystals always scratched eventually. All my nicer watches with sapphire never scratched. Same with all my stainless steel Apple Watches. Never a single scratch on the glass of any of them.
For me, that peace of mind is worth it.
Financially, it’s not the best decision. If you try to sell a steel Apple Watch, most people don’t know or care that it’s nicer materials. They just want an Apple Watch for cheap (which is probably why they’re looking at used ones). Therefore, you barely get any more money for the stainless steel watches than you do for the aluminum ones. If you can live with that or plan to use the watch for 2 or more years, I think stainless steel is worth it. It also goes with almost every band.