Ai2/AllenAI released a FOSS LLM which runs locally on iPhone
Ai2/AllenAI released a FOSS LLM which runs locally on iPhone
allenai.org
OLMoE, meet iOS | Ai2
12 comments
-
-
I wonder how bit it is, normally they call them something with 3B or 7b
-
It’s 7 billion parameters big.
-
Ah, nice, not bad for a iPhone model.
-
-
-
Wanna see how you git clone and compile it on ios
-
Why only iPhone?
12 comments
GitHub here: https://github.com/allenai/OLMoE.swift
Ai2 make as much of their training data available as possible: https://huggingface.co/datasets/allenai/OLMoE-mix-0924