Ok, in the past there have been other threads for making the installer.app file for various versions of OSX/macOS into a bootable ISO for using with VMWare or VirtualBox such as those for El Capitan then Sierra but of course as times change so does Apple and so does the installer.app which of course for High Sierra is different once again.
Now, before anyone goes off to hit that Post or Submit button and ask "Why not just make a bootable USB stick and be done with it?" I'll say if you read what I just posted above I'm not looking (and neither are other people) for a bootable USB stick or image because virtual machines won't boot those at least not that I'm aware of - that would be AWESOME to have VMware Fusion or VirtualBox or Parallels be able to boot from a USB stick like a traditional PC or Mac is capable of doing but alas, so far that aspect of booting has not been implemented for virtual machine software (again, that I know of, and I test stuff constantly).
The topic at hand is taking the Install macOS High Sierra Beta.app file (and soon enough the final release in a few days as well) that is downloaded from the App Store and then convert that to a bootable ISO file (just like we've done in the past with El Capitan, Sierra, and previous releases as well) successfully and have that work for installing the OS in VMware/VirtualBox/Parallels. So far, in my attempts, what happens by using the older instructions and scripts for Sierra that I've used before (with great success for that version of macOS) end up creating a 9GB+ file that does boot but what happens is that it ends up doing a remote install from Apple's servers and not from the ISO itself which seems a bit stupid to me.
I'm not 100% sure why it's doing that because all the files needed to install the OS are obviously contained in the installer.app file already but no matter what I do, no matter how carefully I examine the script itself, I end up each time with an ISO that does boot (that works every time, thankfully) but it will not install from the ISO and requires network access and a 5GB download every single time. I'm on a fast Internet connection and I'm nowhere near my data cap for September so I don't really care about having "wasted" almost 50GB of bandwidth on multiple attempts and it does the remote install every time, but it is somewhat frustrating to not get this working.
So, if anyone wants to take a shot at this, here's the script I've used to create the bootable ISO (again, it IS bootable) but it then simply reverts to the remote install routine - I'm trying to get things done from the contents of the ISO (which was created from the installer.app so all the files are actually there and should not require nor actually use the remote installer BS. The filename I chose was highsierra_iso.sh and saved to the Desktop then chmod +x for making it executable as usual. Note that when High Sierra is finalized and released the installer will just drop the word "Beta" from the name of the installer.app so, that should be the only change after it's released.
Now, before anyone goes off to hit that Post or Submit button and ask "Why not just make a bootable USB stick and be done with it?" I'll say if you read what I just posted above I'm not looking (and neither are other people) for a bootable USB stick or image because virtual machines won't boot those at least not that I'm aware of - that would be AWESOME to have VMware Fusion or VirtualBox or Parallels be able to boot from a USB stick like a traditional PC or Mac is capable of doing but alas, so far that aspect of booting has not been implemented for virtual machine software (again, that I know of, and I test stuff constantly).
The topic at hand is taking the Install macOS High Sierra Beta.app file (and soon enough the final release in a few days as well) that is downloaded from the App Store and then convert that to a bootable ISO file (just like we've done in the past with El Capitan, Sierra, and previous releases as well) successfully and have that work for installing the OS in VMware/VirtualBox/Parallels. So far, in my attempts, what happens by using the older instructions and scripts for Sierra that I've used before (with great success for that version of macOS) end up creating a 9GB+ file that does boot but what happens is that it ends up doing a remote install from Apple's servers and not from the ISO itself which seems a bit stupid to me.
I'm not 100% sure why it's doing that because all the files needed to install the OS are obviously contained in the installer.app file already but no matter what I do, no matter how carefully I examine the script itself, I end up each time with an ISO that does boot (that works every time, thankfully) but it will not install from the ISO and requires network access and a 5GB download every single time. I'm on a fast Internet connection and I'm nowhere near my data cap for September so I don't really care about having "wasted" almost 50GB of bandwidth on multiple attempts and it does the remote install every time, but it is somewhat frustrating to not get this working.
So, if anyone wants to take a shot at this, here's the script I've used to create the bootable ISO (again, it IS bootable) but it then simply reverts to the remote install routine - I'm trying to get things done from the contents of the ISO (which was created from the installer.app so all the files are actually there and should not require nor actually use the remote installer BS. The filename I chose was highsierra_iso.sh and saved to the Desktop then chmod +x for making it executable as usual. Note that when High Sierra is finalized and released the installer will just drop the word "Beta" from the name of the installer.app so, that should be the only change after it's released.
Code:
# Generate a BaseSystem.dmg with 10.13 Install Packages
hdiutil attach /Applications/Install\ macOS\ High\ Sierra\ Beta.app/Contents/SharedSupport/InstallESD.dmg -noverify -mountpoint /Volumes/highsierra
hdiutil create -o /tmp/HighSierraBase.cdr -size 7316m -layout SPUD -fs HFS+J
hdiutil attach /tmp/HighSierraBase.cdr.dmg -noverify -mountpoint /Volumes/install_build
asr restore -source /Applications/Install\ macOS\ High\ Sierra\ Beta.app/Contents/SharedSupport/BaseSystem.dmg -target /Volumes/install_build -noprompt -noverify -erase
cp -R /Volumes/highsierra/Packages /Volumes/OS\ X\ Base\ System/System/Installation
hdiutil detach /Volumes/OS\ X\ Base\ System/
hdiutil detach /Volumes/highsierra/
mv /tmp/HighSierraBase.cdr.dmg /tmp/BaseSystem.dmg
# Restore the 10.13 Installer's BaseSystem.dmg into file system and place custom BaseSystem.dmg into the root
hdiutil create -o /tmp/HighSierra.cdr -size 8965m -layout SPUD -fs HFS+J
hdiutil attach /tmp/HighSierra.cdr.dmg -noverify -mountpoint /Volumes/install_build
asr restore -source /Applications/Install\ macOS\ High\ Sierra\ Beta.app/Contents/SharedSupport/BaseSystem.dmg -target /Volumes/install_build -noprompt -noverify -erase
cp /tmp/BaseSystem.dmg /Volumes/OS\ X\ Base\ System
hdiutil detach /Volumes/OS\ X\ Base\ System/
hdiutil convert /tmp/HighSierra.cdr.dmg -format UDTO -o /tmp/HighSierra.iso
mv /tmp/HighSierra.iso.cdr ~/Desktop/HighSierra.iso
rm /tmp/HighSierra.cdr.dmg