awful.systems
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
@JOMusic@lemmy.ml to Open Source@lemmy.mlEnglish • 4 months ago

Ai2/AllenAI released a FOSS LLM which runs locally on iPhone

allenai.org

external-link
message-square
12
fedilink
44
external-link

Ai2/AllenAI released a FOSS LLM which runs locally on iPhone

allenai.org

@JOMusic@lemmy.ml to Open Source@lemmy.mlEnglish • 4 months ago
message-square
12
fedilink
OLMoE, meet iOS | Ai2
allenai.org
external-link
Our state-of-the-art mixture-of-experts model is now available on the Apple app store! The OLMoE app allows anyone to test the model privately and securely on their devices.
  • dblsaiko
    link
    fedilink
    6•4 months ago

    It probably uses Apple’s CoreML. Not sure if Android has an equivalent API.

    • @fubarx@lemmy.ml
      link
      fedilink
      3•4 months ago

      https://developers.google.com/ml-kit/

    • foremanguy
      link
      fedilink
      1•4 months ago

      Explain it pls

      • dblsaiko
        link
        fedilink
        3•4 months ago

        It’s Apple’s API for hardware-accelerated machine learning. Their new devices have specialized ML hardware so it’s actually feasible to run on mobile devices. Probably what they also use for Apple Intelligence. https://developer.apple.com/documentation/coreml

        • foremanguy
          link
          fedilink
          1•
          edit-2
          4 months ago

          Seems like a good project to implement on the green side (Or pinguin side)

Open Source@lemmy.ml

!opensource@lemmy.ml

remote_follow_modal_title

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !opensource@lemmy.ml

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

  • Open Source Initiative
  • Free Software Foundation
  • Electronic Frontier Foundation
  • Software Freedom Conservancy
  • It’s FOSS
  • Android FOSS Apps Megathread

Rules

  • Posts must be relevant to the open source ideology
  • No NSFW content
  • No hate speech, bigotry, etc

Related Communities

  • !libre_culture@lemmy.ml
  • !libre_software@lemmy.ml
  • !libre_hardware@lemmy.ml
  • !linux@lemmy.ml
  • !technology@lemmy.ml

Community icon from opensource.org, but we are not affiliated with them.

  • 134 users / day
  • 551 users / week
  • 3.31K users / month
  • 9.71K users / 6 months
  • 38.2K subscribers
  • 1.93K Posts
  • 27.2K Comments
  • Modlog
  • mods:
  • Evan
  • @kevincox@lemmy.ml
  • @CrypticCoffee@lemmy.ml
  • Lettuce eat lettuce
  • BE: 0.19.3
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org