Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
This guy beat it into my head that the constant read and write of the media cache files will quickly reduce the lifespan/ tbw of the internal drive...
In the old days. Current SSDs have lifespans of nearly 2 million hours.
The smaller drives will of course have the lower life spans: 800k hours or so, but your 4TB is top notch.

If you run AE 12 hours a day your drive should be safe for a couple hundred years ( theoretically ). Software testing may notice minor slowdowns as cells are killed within 4 - 5 years.
 
Just adding here that @straightryder is not the only one who encounters issues with high ram usage and running After Effects. It *is* a problem in the latest versions, both on Win and Mac. And that's on Adobe. Let's hope that the next release runs more optimized.

Install AE 2020 and compare. But 2020 doesn't run natively on M1/M2, unfortunately.
 
  • Like
Reactions: straightryder
After effects can be fairly demanding, the "disk cache" in AE writes large amounts of data to the HD. In my use case - mostly HD content and using AE 40hrs a week - 2TB of writes a week is not uncommon on my 2019 iMac i9 with 64GB Ram, so around 100TB+/year. A 500GB internal SSD should have a TBW of 300GB, double that to 600TBW for 1TB SSD etc. A 4TB drive would be highly unlikely to go near it's TBW using AE in the useful lifetime of the machine.

Also have an M2 Max with 96GB/2TB waiting to be set up. Anyone using AE regularly should be looking at 1TB and as much ram as possible as a minimum in my opinion.
 
Just adding here that @straightryder is not the only one who encounters issues with high ram usage and running After Effects. It *is* a problem in the latest versions, both on Win and Mac. And that's on Adobe. Let's hope that the next release runs more optimized.

Install AE 2020 and compare. But 2020 doesn't run natively on M1/M2, unfortunately.
The problem part isn’t clear to me… They have a lot of RAM, it uses that RAM. Presumably one buys a lot of RAM so that it can be used. I’d be more likely to call it a problem if I had any free RAM and lost some modicum of performance because of it.
 
Last edited:
I have currently moved over to Mac from PC so I am still fairly green with Apple/ MBP's. I'm really enjoying the new switch with all the work to do date 👍

Today I was working on a project in AE (it's a very simple one at that) not too big and the files are very minimal.... My memory gets jacked up to almost 90% and AE just grinds to a halt. I'll provide screen shots to let some experts checkout the current settings/ preferences.

I'm working in a basic 1920x1080 Comp. No 3D animation going on atm. I'm working off external Samsung 990Pro 2TB nvme and all the Cache files are stored on it as well. My internal HD is 4TB and only 500 GB used on it.

96 Gigs is just getting flushed out within 10min of working on this project in AE - Can someone tell me what I am doing wrong?

Thank you, and everyones help is very much appreciated. This forum has helped out a lot in the past.
This is a known problem with all versions of AE below 23.1. Apparently this update fixed the memory hogging problems with AE. Make sure the current version of AE is 23.1 at least or later. A link to the discussion on the adobe community forum in respect of this issue..... https://helpx.adobe.com/in/after-effects/kb/after-effects-low-memory-warning-mechanism.html
 
  • Like
Reactions: straightryder
This is a known problem with all versions of AE below 23.1. Apparently this update fixed the memory hogging problems with AE. Make sure the current version of AE is 23.1 at least or later. A link to the discussion on the adobe community forum in respect of this issue..... https://helpx.adobe.com/in/after-effects/kb/after-effects-low-memory-warning-mechanism.html
I blame everything on Adobe. (running joke in the office and home).
Don't even have a single Adobe app on my computer and still blame it on them.
 
USB-C vs an actual Thunderbolt enclosure is going to be a massive difference in transfer (*edit) speed. I would transfer your project to the internal drive and see how it behaves.

AfterEffects loves RAM; the more the better; but you also need to leave enough for the rest of the system and the GPU in the case of Apple Silicon. With your config I would give 48-64 to Adobe and leave the rest open. I could be wrong, but I am pretty sure that RAM preference in Adobe does not account for needed GPU memory; I know it does not on Intel systems since the GPU and VRAM are separate pools.
 
Last edited:
  • Like
Reactions: straightryder
Nothing whatsoever wrong with 71%. As long as there is some free space it means that the fast Apple UMA RAM is unconstrained and allowing optimal operation. But IMO intentionally working from an external drive when you have 4 TB fast internal makes no sense. We buy hardware to use it, not to sequester it so it does not wear out.

I do recommend keeping HDDs/SSDs ~ half full for optimal operation long term but not to the extent of moving active work off of internal SSDs.

With modern SSDs, the TBW ratings are so high that even keeping the SSD around 80-90% full won't have a significant impact on the lifespan of the drive. The MTBF for that Samsung external drive is 1.5 million hours. The TBW for that drive (in terms of what the warranty covers) is 600TBW for the 1TB drive and 1200 TBW for the 2TB version, so 600 full rewrites of the drive.
 
  • Like
Reactions: BigMcGuire
USB-C vs an actual Thunderbolt enclosure is going to be a massive difference in drive speed. I would transfer your project to the internal drive and see how it behaves.

AfterEffects loves RAM; the more the better; but you also need to leave enough for the rest of the system and the GPU in the case of Apple Silicon. With your config I would give 48-64 to Adobe and leave the rest open. I could be wrong, but I am pretty sure that RAM preference in Adobe does not account for needed GPU memory; I know it does not on Intel systems since the GPU and VRAM are separate pools.

I'm not an AE user, so there's probably some nuances that I'm missing, but this seems like the wrong idea. A lot of people are able to get by with 8GB for their entire system RAM, so reserving 48GB for background and OS tasks seems wasteful.

Thinking about the Adobe allocation is the backwards way of looking at it. In essence consider your computer to be two computers-- your Adobe computer and your non-Adobe computer. Think about the non-Adobe allocation.

AE will use all the RAM it is given for caching preview frames-- so filling RAM is by design. If you reduce the allocation, you get to cache fewer frames. That's less useful, but not catastrophic.

96 minus the Adobe block is left for everything else. If you don't reserve enough for everything else then the system treats that Adobe allocation just like everyone else and will evict it from RAM into swap which might not be that noticeable with the very, very fast internal SSD, I dunno, but it does undermine the purpose of the RAM cache.

Before it starts going to swap though, it will begin compressing in RAM and with 96GB available, and the frames being cached uncompressed, there's a lot of squishiness before anything starts to swap. You don't need to be overly conservative.

So what you want to assess isn't how much memory you need for Adobe, but how much memory you need for everything else and yes, that sadly means freaking Chrome tabs in this day and age. If you want a bigger preview buffer, don't run with a bunch of tabs or unnecessary applications open.

Adobe makes guessing the right allocation the users problem. Adobe won't shift its allocation dynamically, which seems like bad design to me as it renders the OS's swapping mechanism toxic, but it is what it is. Set the preference and live within your choice or risk swap and stuttering. Having read a bit more about what Adobe is doing, I resonate more strongly with this comment:
Today the Mac OS does a very, very good job memory managing. And most of us have more (fast UMA) RAM available both in real and relative terms. Today's workflows (at least mine) are much more complex but not more demanding. Twenty years ago and also now I prefer not to have (greedy bastards) Adobe doing the RAM management; I always want to clearly be able to intentionally set any scratch disks if and only if it suits some app-specific workflow.

The GPU memory isn't a separate allocation. With a GPU card, the process will likely stage data in application space and then copy it to the GPU card, process it, and then bring it back-- so the GPU memory is in addition to the application memory. With unified memory the GPU can access application space directly without needing needing a copy-- so it's the same application RAM requirement without needing a separate GPU allocation. ie. no extra allocation needed for GPU.

The Adobe RAM pool is shared among Adobe CC apps and Adobe does allocate that pool dynamically-- so if you are using Photoshop, you don't need to account for it separately.

The bottom right pane in this image says everything: the system has more than enough RAM and hasn't swapped anything to disk. The current memory allocation looks just fine. I don't know where this image came from, so I'm not sure how to read the upper right pane, but it looks like there's still some headroom before it would even think about swapping.


screenshot-2023-07-11-at-17-54-27-2-png.2230990
 
Last edited:
  • Like
Reactions: straightryder
"Reducing wear and tear" on the internal drive is a waste. Use it for what it was designed for. What's the point in having the fast-as-hell internal storage if it's going unused? You won't notice the wear & tear compared to the slowness of an external drive, even a "fast" one. GO FOR IT
 
Adobe makes guessing the right allocation the users problem. Adobe won't shift its allocation dynamically, which seems like bad design to me as it renders the OS's swapping mechanism toxic, but it is what it is. Set the preference and live within your choice or risk swap and stuttering.
There was a post on Hacker News earlier this week talking about the problem with browsers taking up available memory for caching of tabs that is related to this. The problem is that the OS virtual memory swap system can't differentiate between allocated pages that contain information that must be retained versus memory that is being used for cache and could theoretically be thrown away instead of paged out to disk. I don't know anything about AE but if the RAM used is like cached browser tabs, it is the same problem.

Should the browser use all available memory?
 
  • Like
Reactions: straightryder
I'm not an AE user, so there's probably some nuances that I'm missing, but this seems like the wrong idea. A lot of people are able to get by with 8GB for their entire system RAM, so reserving 48GB for background and OS tasks seems wasteful.

Thinking about the Adobe allocation is the backwards way of looking at it. In essence consider your computer to be two computers-- your Adobe computer and your non-Adobe computer. Think about the non-Adobe allocation.

AE will use all the RAM it is given for caching preview frames-- so filling RAM is by design. If you reduce the allocation, you get to cache fewer frames. That's less useful, but not catastrophic.

96 minus the Adobe block is left for everything else. If you don't reserve enough for everything else then the system treats that Adobe allocation just like everyone else and will evict it from RAM into swap which might not be that noticeable with the very, very fast internal SSD, I dunno, but it does undermine the purpose of the RAM cache.

Before it starts going to swap though, it will begin compressing in RAM and with 96GB available, and the frames being cached uncompressed, there's a lot of squishiness before anything starts to swap. You don't need to be overly conservative.

So what you want to assess isn't how much memory you need for Adobe, but how much memory you need for everything else and yes, that sadly means freaking Chrome tabs in this day and age. If you want a bigger preview buffer, don't run with a bunch of tabs or unnecessary applications open.

Adobe makes guessing the right allocation the users problem. Adobe won't shift its allocation dynamically, which seems like bad design to me as it renders the OS's swapping mechanism toxic, but it is what it is. Set the preference and live within your choice or risk swap and stuttering. Having read a bit more about what Adobe is doing, I resonate more strongly with this comment:


The GPU memory isn't a separate allocation. With a GPU card, the process will likely stage data in application space and then copy it to the GPU card, process it, and then bring it back-- so the GPU memory is in addition to the application memory. With unified memory the GPU can access application space directly without needing needing a copy-- so it's the same application RAM requirement without needing a separate GPU allocation. ie. no extra allocation needed for GPU.

The Adobe RAM pool is shared among Adobe CC apps and Adobe does allocate that pool dynamically-- so if you are using Photoshop, you don't need to account for it separately.

The bottom right pane in this image says everything: the system has more than enough RAM and hasn't swapped anything to disk. The current memory allocation looks just fine. I don't know where this image came from, so I'm not sure how to read the upper right pane, but it looks like there's still some headroom before it would even think about swapping.


screenshot-2023-07-11-at-17-54-27-2-png.2230990
I think we both agree and just went about saying it in a different manner. 32GB vs 240GB (which is what my upgrade was for my 7,1) completely changed how performant After Effects is. Totally night and day difference. Of course the other problem is that my total VRAM with W6800X Duo was 64GB which was probably not ideal for my workloads only having initially 32GB of system RAM.

I will check when I get home, but I think I have 200GB allocated to Adobe at the moment on the 7,1; but I may have lowered it to 192GB.

Since I have no Apple Silicon machines on hand, I can't comment on the ideal setting based on his machine; but if it was me I would probably leave around 32GB + 16GB (GPU overhead) free for the system. Maybe someone who frequents After Effects and uses Apple silicon can chime in.
 
  • Like
Reactions: straightryder
There was a post on Hacker News earlier this week talking about the problem with browsers taking up available memory for caching of tabs that is related to this. The problem is that the OS virtual memory swap system can't differentiate between allocated pages that contain information that must be retained versus memory that is being used for cache and could theoretically be thrown away instead of paged out to disk. I don't know anything about AE but if the RAM used is like cached browser tabs, it is the same problem.

Should the browser use all available memory?
AE is sorta like that; AE will start rendering frames to RAM so that playback previews can be played in real time. You can of course turn this off.
 
  • Like
Reactions: straightryder
This guy beat it into my head that the constant read and write of the media cache files will quickly reduce the lifespan/ tbw of the internal drive...
Your internal drive is faster and you have a TON of space on it. This generally goes against the common wisdom when getting a machine for video work (wherein you only have software installed on the internal drive and work on projects exclusively on other volumes). That all being said, there's nothing wrong with using your internal drive to work on active projects and then offloading your finished projects onto an external. With a 4TB drive, it almost makes too much sense NOT to do it that way. And no, you won't wear out your 4TB drive to any seriously noticeable faster degree. Just make sure you keep regular Time Machine backups and the odds are that you'll probably need a logic board replacement for something not drive related anyway.
 
  • Like
Reactions: straightryder
I have MBA 2011 and a 2014 MBP, which has been running as file server, streaming. I write Ton in to the drive and reads, never had any problems. Why was the person concerned about wear and tear? These things easily outlive HDD by years.
You know how some people are they just want to overkill on everything including - paranoia lol
 
  • Like
Reactions: smirking
In the old days. Current SSDs have lifespans of nearly 2 million hours.
The smaller drives will of course have the lower life spans: 800k hours or so, but your 4TB is top notch.

If you run AE 12 hours a day your drive should be safe for a couple hundred years ( theoretically ). Software testing may notice minor slowdowns as cells are killed within 4 - 5 years.
Really, that's insane... even with PrePro, Photoshop and Lightroom being used on a daily basis?

Don't the Media Cache Files - provide the most wear and tear on the drives?
 
  • Like
Reactions: 960design
Just adding here that @straightryder is not the only one who encounters issues with high ram usage and running After Effects. It *is* a problem in the latest versions, both on Win and Mac. And that's on Adobe. Let's hope that the next release runs more optimized.

Install AE 2020 and compare. But 2020 doesn't run natively on M1/M2, unfortunately.
I'll give that a shot and see what happens. Thanks for the heads up on that.
 
Just a note... My 16' MBP 64GB Ram ... I've written 54TB to my internal 4TB SSD in about a year and it still shows 100% health/life with Drive DX. Jealous of your ram. :p

You don't need to worry about stuff like ssds wearing out especially now days and especially with your machine.

That's crazy 54TB in almost a year....

Yes - the maxed out Ram helps like crazy. Using other apps and have somethings open - it blows my mind what it blows through without a wimper. Sometimes I just sit there and shake my head wondering how it's able to do it... and that from my current setup using the external nvme.

I think I'll move over to the internal.
 
After effects can be fairly demanding, the "disk cache" in AE writes large amounts of data to the HD. In my use case - mostly HD content and using AE 40hrs a week - 2TB of writes a week is not uncommon on my 2019 iMac i9 with 64GB Ram, so around 100TB+/year. A 500GB internal SSD should have a TBW of 300GB, double that to 600TBW for 1TB SSD etc. A 4TB drive would be highly unlikely to go near it's TBW using AE in the useful lifetime of the machine.

Also have an M2 Max with 96GB/2TB waiting to be set up. Anyone using AE regularly should be looking at 1TB and as much ram as possible as a minimum in my opinion.

So my current setup is silly is what your saying lol ;)
 
This is a known problem with all versions of AE below 23.1. Apparently this update fixed the memory hogging problems with AE. Make sure the current version of AE is 23.1 at least or later. A link to the discussion on the adobe community forum in respect of this issue..... https://helpx.adobe.com/in/after-effects/kb/after-effects-low-memory-warning-mechanism.html
I looked into it and still capping out at 87% :(

ill keep an eye out for any other articles or updates.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.