Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

MacRumors

macrumors bot
Original poster
Apr 12, 2001
63,795
31,272


Apple today released several open source large language models (LLMs) that are designed to run on-device rather than through cloud servers. Called OpenELM (Open-source Efficient Language Models), the LLMs are available on the Hugging Face Hub, a community for sharing AI code.

Apple-Silicon-AI-Optimized-Feature-Siri.jpg

As outlined in a white paper [PDF], there are eight total OpenELM models, four of which were pre-trained using the CoreNet library, and four instruction tuned models. Apple uses a layer-wise scaling strategy that is aimed at improving accuracy and efficiency.

Apple provided code, training logs, and multiple versions rather than just the final trained model, and the researchers behind the project hope that it will lead to faster progress and "more trustworthy results" in the natural language AI field.
OpenELM, a state-of-the-art open language model. OpenELM uses a layer-wise scaling strategy to efficiently allocate parameters within each layer of the transformer model, leading to enhanced accuracy. For example, with a parameter budget of approximately one billion parameters, OpenELM exhibits a 2.36% improvement in accuracy compared to OLMo while requiring 2x fewer pre-training tokens.

Diverging from prior practices that only provide model weights and inference code, and pre-train on private datasets, our release includes the complete framework for training and evaluation of the language model on publicly available datasets, including training logs, multiple checkpoints, and pre-training configurations.
Apple says that it is releasing the OpenELM models to "empower and enrich the open research community" with state-of-the-art language models. Sharing open source models gives researchers a way to investigate risks and data and model biases. Developers and companies are able to use the models as-is or make modifications.

The open sharing of information has become an important tool for Apple to recruit top engineers, scientists, and experts because it provides opportunities for research papers that would not normally have been able to be published under Apple's secretive policies.

Apple has not yet brought these kinds of AI capabilities to its devices, but iOS 18 is expected to include a number of new AI features, and rumors suggest that Apple is planning to run its large language models on-device for privacy purposes.

Article Link: Apple Releases Open Source AI Models That Run On-Device
 
Last edited:

t0rqx

macrumors 68000
Nov 27, 2021
1,617
3,786
Only reason they release this is they need help from the community.

They also need to stop using words like empower and enrich peoples lives.


1. Selling Macbook Pros with scratches in the screen is not empowering nor enriching.

2. Selling Homepods then kill it slowly, only to resurrect it with even lower downgrades is not empowering nor enriching.

3. Still selling accessories with lightning is not empowering nor enriching.

4. Selling Goggles that pose a health risk causing blindness is not empowering nor enriching.

5. Releasing upgrades that cripple performance or introducing hardware glitches to force upgrades is not empowering nor enriching.

6. Need to sum up this and more is not empowering nor enriching.
 
Last edited:

Populus

macrumors 601
Aug 24, 2012
4,863
7,153
Spain, Europe
What? No comments? Hey, ChatGPT, generate me a comment....

[Hey ChatGPT, please generate a comment in the style of a typical MacRumors average user, with a touch of acid humor, regarding this piece of news.]

"Oh great, Apple's finally joining the open-source party—just a decade late and probably still with strings attached somewhere in those 'open' terms. They're throwing us a bone with OpenELM, but let's be real, they’re probably just doing it to lure in some AI hotshots tired of their corporate overlords. Now we just have to sit back and wait for iOS 18, where they'll inevitably limit these models to the latest hardware, forcing us all to upgrade. Because, you know, my current iPhone can't possibly handle a couple more AI tricks without combusting."
 

Attachments

  • IMG_0590.jpeg
    IMG_0590.jpeg
    381.4 KB · Views: 914

JippaLippa

macrumors 65816
Jan 14, 2013
1,484
1,661
[Hey ChatGPT, please generate a comment in the style of a typical MacRumors average user, with a touch of acid humor, regarding this piece of news.]

"Oh great, Apple's finally joining the open-source party—just a decade late and probably still with strings attached somewhere in those 'open' terms. They're throwing us a bone with OpenELM, but let's be real, they’re probably just doing it to lure in some AI hotshots tired of their corporate overlords. Now we just have to sit back and wait for iOS 18, where they'll inevitably limit these models to the latest hardware, forcing us all to upgrade. Because, you know, my current iPhone can't possibly handle a couple more AI tricks without combusting."
Chef's kiss! 😘 🤌
The future is really now.
 

CookItOff

macrumors member
Jun 11, 2023
65
272
[Hey ChatGPT, please generate a comment in the style of a typical MacRumors average user, with a touch of acid humor, regarding this piece of news.]

"Oh great, Apple's finally joining the open-source party—just a decade late and probably still with strings attached somewhere in those 'open' terms. They're throwing us a bone with OpenELM, but let's be real, they’re probably just doing it to lure in some AI hotshots tired of their corporate overlords. Now we just have to sit back and wait for iOS 18, where they'll inevitably limit these models to the latest hardware, forcing us all to upgrade. Because, you know, my current iPhone can't possibly handle a couple more AI tricks without combusting."
***** knew it.
The comment section is dead. Long live the AI comment section. lol
 

NT1440

macrumors G5
May 18, 2008
14,723
21,358
It's clear they are behind and need help. OpenAI's GPT-4 has 1.76 trillion parameters. Apple's OpemELM model has 3 billions parameters.
Does ChatGPT even attempt to run on device? You know, the whole point of this?

The thing I’ve noticed about all these AI hype-people is they certainly know what the “leader” of the pack day to day is, but somehow can’t imagine smaller models being a better solution for a given task. Instead of a one size fits all approach, what’s wrong with invoking a trained AI that is smaller but specifically suited for the task at hand *automatically based on the context of what you’re currently doing*?

Just some food for thought…
 

Boil

macrumors 68040
Oct 23, 2018
3,286
2,900
Stargate Command
Apple says that it is releasing the OpenELM models to "empower and enrich the open research community" with stage-of-the-art language models. Sharing open source models gives researchers a way to investigate risks and data and model biases. Developers and companies are able to use the models as-is or make modifications.

Proof-read much, MacRumors; hey, maybe y'all can get AI to do that for you, or maybe you already tried to get AI to do that for you...? ;^p
 

heretiq

Contributor
Jan 31, 2014
797
1,257
Denver, CO
Does ChatGPT even attempt to run on device? You know, the whole point of this?

The thing I’ve noticed about all these AI hype-people is they certainly know what the “leader” of the pack day to day is, but somehow can’t imagine smaller models being a better solution for a given task. Instead of a one size fits all approach, what’s wrong with invoking a trained AI that is smaller but specifically suited for the task at hand *automatically based on the context of what you’re currently doing*?

Just some food for thought…
Thank you for adding something meaningful to this otherwise nauseatingly cynical thread. 🙏🏽
 

idktbh

macrumors regular
Oct 3, 2018
185
564
Apple finally decides to join the open-source party, huh? Only a decade late and I bet there are still some hidden strings attached to their so-called 'open' terms. They're throwing us a bone with OpenELM, but let's be real, they're probably just trying to lure in some AI hotshots tired of their corporate overlords. And now we have to wait for iOS 18, where they'll undoubtedly limit these models to the latest hardware, forcing us all to upgrade. Because, you know, my current iPhone surely can't handle a few more AI tricks without spontaneously combusting. Classic Apple move.
 

heretiq

Contributor
Jan 31, 2014
797
1,257
Denver, CO
Apple finally decides to join the open-source party, huh? Only a decade late and I bet there are still some hidden strings attached to their so-called 'open' terms. They're throwing us a bone with OpenELM, but let's be real, they're probably just trying to lure in some AI hotshots tired of their corporate overlords. And now we have to wait for iOS 18, where they'll undoubtedly limit these models to the latest hardware, forcing us all to upgrade. Because, you know, my current iPhone surely can't handle a few more AI tricks without spontaneously combusting. Classic Apple move.
Hmmm .. FYI: it seems that @Populus beat you to using ChatGPT to “contribute” to the discussion; only difference is that he acknowledged he was using it .. 😏
 

NT1440

macrumors G5
May 18, 2008
14,723
21,358
Apple finally decides to join the open-source party, huh? Only a decade late and I bet there are still some hidden strings attached to their so-called 'open' terms. They're throwing us a bone with OpenELM, but let's be real, they're probably just trying to lure in some AI hotshots tired of their corporate overlords. And now we have to wait for iOS 18, where they'll undoubtedly limit these models to the latest hardware, forcing us all to upgrade. Because, you know, my current iPhone surely can't handle a few more AI tricks without spontaneously combusting. Classic Apple move.
Hold up. Maybe take a second to do some searching in a search engine of “open source” and “Apple” and take a look at the projects they’ve been contributing to for quite a while.

This is not new. But go off…
 

heretiq

Contributor
Jan 31, 2014
797
1,257
Denver, CO
Hold up. Maybe take a second to do some searching in a search engine of “open source” and “Apple” and take a look at the projects they’ve been contributing to for quite a while.

This is not new. But go off…
The fact that it was created using ChatGPT and presented as original thought .. without noticing the exact comment was contributed a few posts up in jest and acknowledged as the product of ChatGPT is hilarious 😂.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.