MP All Models Bootable PCI SSD Cards/Drives for Mac Pro (NVMe M.2, U.2, EDSFF E3.S, etc. (was Micron 9300 Pro 15.36TB U2))

[tsialex]

This is really interesting. So even though their FAQ says it's not bootable, it will be bootable with a single drive? So for example, I could have a single 15TB boot SSD drive, and then use the other 3 ports to do a software raid with 3 additional drives?

That's great news then! I wonder why they don't update their FAQs...

It's bootable, every macOS release has it's quirks and limitations - only High Sierra supports everything.

Since it's a very complex subject, they play safe.
[doublepost=1563021244][/doublepost]

So for example, I could have a single 15TB boot SSD drive, and then use the other 3 ports to do a software raid with 3 additional drives?

Yes, you can. No one tested with drives bigger than 4TB that I know of.

 

[rxs0]

I recently received the SQUID Carrier Board™ PCI Express Gen 3 Carrier Board for 6 M.2 or NGSFF (NF1)
PCIe SSD modules, with x16 PCI Express upstream Adapter.

I am currently running this board in a windows box.

http://amfeltec.com/pci-express-gen-3-carrier-board-for-6-m2-or-ngsff-nf1-pcie-ssd-modules

I intend to test this system (with 6 Samsung 970 EVO 2TB NVMe SSD drives) in the 2019 Mac Pro computer when available. I will order the new Mac Pro as soon as it is available. I don't know if this will be bootable in RAID 0 on the new Mac Pro. I will update you with the results.

Thanks.

 

[Mac_User 0101]

I recently received the SQUID Carrier Board™ PCI Express Gen 3 Carrier Board for 6 M.2 or NGSFF (NF1)
PCIe SSD modules, with x16 PCI Express upstream Adapter.

I am currently running this board in a windows box.

http://amfeltec.com/pci-express-gen-3-carrier-board-for-6-m2-or-ngsff-nf1-pcie-ssd-modules

I intend to test this system (with 6 Samsung 970 EVO 2TB NVMe SSD drives) in the 2019 Mac Pro computer when available. I will order the new Mac Pro as soon as it is available. I don't know if this will be bootable in RAID 0 on the new Mac Pro. I will update you with the results.

Thanks.

That was the carrier I was going to recommend. With it's 6 M.2 slots, PEX8748 switch, adjustable fans and real time monitoring...I think it's one of the best NVMe carriers currently on the market and the OP should check it out. I'm considering purchasing one to use in a 5,1. Obviously, I won't be able to use it to it's full potential being that 3 high quality PCIe gen3x4 NVMe will fully saturate my PCIe 2.0 x16 slot. However, I am in the market to upgrade my gen2 Squid anyway and figure the sheer benefit of fitting up to 6 NVMe in a single PCIe slot is worth the price of admission.

 

[ZombiePhysicist]

Really interesting. But this card seems around the same speed. 13GB/sec but it will take 2.5" form factor NVMe drives:

http://highpoint-tech.com/USA_new/CS-product_nvme.htm#bottom

The 2.5" form factor drives for 15.36TB are going for under $2500 now, so price per gb is really good with 3.4GB/sec transfer speed:

http://www.nextwarehouse.com/item/?...MI_u3SjYSV5AIVxfZRCh0IcgSbEAkYASABEgJFo_D_BwE

I think the biggest NVME sticks are currently 2TB, so it is decently close to max it out to 12TB if you can raid the SQUID card and still boot? 2TB sticks go for about $480 or about $2880. Hmm, it is really interesting trade off. Then again, if the Highpoint lets me raid 4 of the 15TB drives, that would be interesting and crazy absurd with 60TB of SSDs that would theoretically work at around 14GB/sec...

 

[ZombiePhysicist]

I just ordered a 28core, 96GB ram, 256SSD (ergo why I need a PCI solution for storage), 580x, wheels (which annoyingly delay shipping by like 5 weeks, for freek'n wheels) 7,1 Mac Pro.


So for storage I thin I'm going with this:

Option A
Highpoint 7120 U.2 card. $400 bux:
https://www.amazon.com/gp/product/B...c45-cd78f07a84d8&pf_rd_r=Z5FT0J2SWTDZZHJHC1F9

And the 15.36 TB NVMe U.2 Micron 9300 pro drive. $2400bux:
http://www.nextwarehouse.com/item/?...MI_o2ewe6r5gIVxcDACh2KqQ9TEAkYASABEgK3IvD_BwE

The micron reads/writes at around 3500MB/sec. The Highpoint in theory would let you raid up to 4 of those together for 60+TB of SSD at probably over 12GB/sec throughput.

Option B
Another option is this Squid that takes 6 NVMe sticks (so you could fill it with 6 2TB sticks for around 12TB and reportedly around 12-14GB/sec read writes:
https://amfeltec.com/pci-express-gen-3-carrier-board-for-6-m2-or-ngsff-nf1-pcie-ssd-modules

Thoughts
I think I like the U.2 form factor better. Not clear if either of those solutions will let you boot from a RAID, but from another thread, it seems you can at least boot with a single drive on the U.2 solution:
https://forums.macrumors.com/thread...r-2019-ncmp-7-1-mac-pro.2189591/post-27538765


TLDR; Anyway, what was the config you ordered and what do you plan to do with regard to PCI SSD storage for your new 7,1 Mac Pro?

Update 2020-02-02:
Just thought I'd update this thread in that I went with the Highpoint 7120 and Micron 9300 Pro 15.36TB drive option. Lot of details of getting it to work found in this thread:

Mac Pro support for NVMe U2 Micron 9300 Pro 15.36TB U.2 Drive SSD?

Ok so I got the drive. I got a bracket and it all seems to fit in decently tidy. Some pics: So I have the Pegasus J2i in there. Swapped the useless 8TB for a 16TB spinner. I got a 3.5" to 2.5" bracket. One note, the screws in the J2i that hold larger drives, are too big for both the 2.5"/3.5"...

forums.macrumors.com

 

[SecuritySteve]

I'm very interested in this topic too. My work figures we need to use PCI SSDs to install ESXi on the MP 7,1 for our virtualization cluster, given that Apple and VMware are not playing nice with T2 chip support yet.

https://www.amazon.com/gp/product/B...d_p=ab873d20-a0ca-439b-ac45-cd78f07a84d8&th=1

I was looking into suggesting this one since it is bootable from raid.

 

[ZombiePhysicist]

I wonder if the 7120 card is raid bootable. If so, having over 60tb of ssd would be crazy useful.

 

[AidenShaw]

I'm very interested in this topic too. My work figures we need to use PCI SSDs to install ESXi on the MP 7,1 for our virtualization cluster, given that Apple and VMware are not playing nice with T2 chip support yet.

https://www.amazon.com/gp/product/B...d_p=ab873d20-a0ca-439b-ac45-cd78f07a84d8&th=1

I was looking into suggesting this one since it is bootable from raid.

My ESXi servers on ProLiants boot from SD cards - same with Dell. ESXi needs less than 2 GB of disk, and is memory resident for the most part after booting. (A couple of times per hour some logs are flushed.)

You might not need PCIe disks.

 

[SecuritySteve]

My ESXi servers on ProLiants boot from SD cards - same with Dell. ESXi needs less than 2 GB of disk, and is memory resident for the most part after booting. (A couple of times per hour some logs are flushed.)

You might not need PCIe disks.

The trouble is that you can't put ESXi on the stock Apple SSDs. The SSD controllers are actually embedded in the T2 chip, instead of on the SSD proper. This means ESXi cannot access the thunderbolt controller lanes either. It's the same problem the Mac mini has.

https://www.virtuallyghetto.com/2018/11/esxi-on-the-new-2018-apple-mac-mini.html

Essentially you can only install it via third party storage. This isn't a horrible thing either though - keeping the base 256GB drive for firmware updates on the board alone is useful.

As far as SD cards, I imagine we are going to have large storage needs. We are using 10 TB and are planning on using as much as 30 or more in the near future for VM storage alone. We could dangle it off the side as a datastore but then the performance tends to tank on the individual VMs.

So, PCIe storage for high performance and large capacity (even if expensive) is the best option.

 

[ZombiePhysicist]

So good news bad news. Good news is 16TB of super fast (for a spinner) enterprise grade storage is pretty cheap now, at around $420:

https://www.amazon.com/Seagate-256M..._1_2?keywords=16tb+exos&qid=1576020729&sr=8-2

The bad news is you have to pay $400 for a 2 drive bay that comes with completely uselss 8TB spinner drive for $399. It's evil because these drives are a complete waste for anyone in this segment. It's pure gouging and for a decent number of people, that 8TB spinner will end up in the trash heap:
https://www.apple.com/shop/product/...2i-8tb-internal-storage-enclosure-for-mac-pro

 

[H. Flower]

What do you guys think of the sonnet card with (4) 2 tb sabrent rockets , for around $1400? Fast for video editing ? Raid 5 for some protection ?

 

[ZombiePhysicist]

What do you guys think of the sonnet card with (4) 2 tb sabrent rockets , for around $1400? Fast for video editing ? Raid 5 for some protection ?

wouLDnt the squid 6 slot card I posted be better/faster and cheaper? Is there something else special about the 4 slot sonnet?
[automerge]1576079287[/automerge]
One thingo I wonder is anyone making an mpx to 6/8pin power cable adapter? I also want to put an amd 3x 9100 card in my new rig, and it would be cool and tidy to have it take all the power it needs from the mpx part of the pci slot it’s in with some kind of adapter.

 

[H. Flower]

wouLDnt the squid 6 slot card I posted be better/faster and cheaper? Is there something else special about the 4 slot sonnet?
[automerge]1576079287[/automerge]
One thingo I wonder is anyone making an mpx to 6/8pin power cable adapter? I also want to put an amd 3x 9100 card in my new rig, and it would be cool and tidy to have it take all the power it needs from the mpx part of the pci slot it’s in with some kind of adapter.

Well, 12 Gigs is a little too much for me, and 5 gigs just a hair too small. I'm looking for around 6 gigs storage. 4 slots at 2 gigs gives me 6 at Raid 5. Thats why i was thinking sonnet.

I missed the prices on the squids....are those posted anywhere?

 

[ZombiePhysicist]

Well, 12 Gigs is a little too much for me, and 5 gigs just a hair too small. I'm looking for around 6 gigs storage. 4 slots at 2 gigs gives me 6 at Raid 5. Thats why i was thinking sonnet.

I missed the prices on the squids....are those posted anywhere?

mhmm I don’t see the price on the squid. On the other hand, I don’t think you need to fill all 6slots of the squids. I think you can leave 2 slots open for future expansion

 

[H. Flower]

mhmm I don’t see the price on the squid. On the other hand, I don’t think you need to fill all 6slots of the squids. I think you can leave 2 slots open for future expansion

Good point and worth checking into. Also, they seem to have a 4 slot card, although I don't know if it's as fast. Have to do more investigating.

 

[moab1]

And the 15.36 TB NVMe U.2 Micron 9300 pro drive. $2400bux:
http://www.nextwarehouse.com/item/?...MI_o2ewe6r5gIVxcDACh2KqQ9TEAkYASABEgK3IvD_BwE

I just ordered 16-core, 32gb (192gb on the way OWC), 2TB Ssd, Pro Vega II.

Is there a way to install the Micron 9300 Pro drive inside the machine? How does it mount? If not, what's your plan? Same question for 4 drives. I'd like internal Ssd storage but higher capacity than the 8TB Sonnet M.2 solution.

My use: Video production editing (own a RED dragon 6K and direct/DP short form films/commercials) & commercial photography.
Currently, I have 3 x 4 drive RAID 5's Promise Pegasus (Thunderbolt 2) that serve as editing and back-up platforms. I'd like to move my live editing projects to SSD (possibly RAID SSD - either 2 or 4 drives) and that Micron 9300 looks like the ticket. Hoping to find a solution that I can put inside the new Mac Pro via PCI and keep it clean. Let me know your thoughts.

Lastly, is there a reason I should be worried about it not being RAID bootable? Not sure why I would or wouldn't need that. My 2TB Ssd will store OS and all apps.

 

[moab1]

@ZombiePhysicist - what did you decide to do? I'm in the same boat.

 

[AidenShaw]

So I’m looking to use the 15tb micron 9300 pro drive

Why only a 1.92 TB drive?

/pedantic

And that's an NVMe U.2 drive, not an M.2 or SATA drive. The J2I is a SATA bracket, the HPT cards are M.2 - it won't work.

 

[AidenShaw]

Is there a way to install the Micron 9300 Pro drive inside the machine?

Probably not. Those are U.2 form factor 2.5" drives. The J2I is for 3.5" SATA drives (and probably 2.5" with an adapter), the PCIe cards support M.2 drives.

 

[moab1]

Probably not. Those are U.2 form factor 2.5" drives. The J2I is for 3.5" SATA drives (and probably 2.5" with an adapter), the PCIe cards support M.2 drives.

Thanks! So do you have to get a RAID enclosure to run them together? http://highpoint-tech.com/USA_new/series-ssd6540-overview.htm

Or can they just sit on top of each other and the controller does the raid work (http://highpoint-tech.com/USA_new/CS-product_nvme.htm#bottom). Probably need an enclosure I'm assuming...

(Also, the "Nextwarehouse" site has some pretty bad reviews, so buyer beware purchasing the Micron drive there. I'm open to reputable sites to purchase from. There aren't any well known names that I can see.

 

[ZombiePhysicist]

Why only a 1.92 TB drive?

/pedantic

And that's an NVMe U.2 drive, not an M.2 or SATA drive. The J2I is a SATA bracket, the HPT cards are M.2 - it won't work.

Sorry I'm lost Aiden. The drive is a 15.36TB drive (not 1.92TB). The Micron drive, if I understand it correctly, is a U.2 drive, which is basically a 2.5" drive. My understanding is you could use a 2.5" to 3.5" adapter to put it into the J2I. Apologies if I got stuff wrong.

Here is the drive:
http://www.nextwarehouse.com/item/?...MIvr_ihsCx5gIVFuDICh1kRgrqEAkYASABEgLTIvD_BwE

 

[ZombiePhysicist]

Good point and worth checking into. Also, they seem to have a 4 slot card, although I don't know if it's as fast. Have to do more investigating.

Please let us know. I think the 4 port card goes for around

Probably not. Those are U.2 form factor 2.5" drives. The J2I is for 3.5" SATA drives (and probably 2.5" with an adapter), the PCIe cards support M.2 drives.

Oh I think I see. But this card does support U.2 drives:
https://www.amazon.com/gp/product/B...&pf_rd_p=ab873d20-a0ca-439b-ac45-cd78f07a84d8

 

[moab1]

Here's the price I got back on the squid. I confirmed it works both with 4 or 6 drives
SQUID PCIe Carrier Board for up to 6 M.2 or NGSFF(NF1) 1 $ 768.45 USD

I'm still interested in the Micron 15.36TB option, but need to figure out what other hardware is required to make it work. Is it plug and play with that High Point controller?

 

[moab1]

Sorry I'm lost Aiden. The drive is a 15.36TB drive (not 1.92TB). The Micron drive, if I understand it correctly, is a U.2 drive, which is basically a 2.5" drive. My understanding is you could use a 2.5" to 3.5" adapter to put it into the J2I. Apologies if I got stuff wrong.

Will this work in the J2I?? How does it connect then?

 

[ZombiePhysicist]

Here's the price I got back on the squid. I confirmed it works both with 4 or 6 drives
SQUID PCIe Carrier Board for up to 6 M.2 or NGSFF(NF1) 1 $ 768.45 USD

I'm still interested in the Micron 15.36TB option, but need to figure out what other hardware is required to make it work. Is it plug and play with that High Point controller?

So I *think* the Micron 15.36TB U.2 drive should work with the High Point SSD7120 card. BUt I dont know if anyone has actually done it. Here's the card:

https://www.amazon.com/gp/product/B...&pf_rd_p=ab873d20-a0ca-439b-ac45-cd78f07a84d8