• GenderNeutralBro@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    103
    arrow-down
    3
    ·
    3 days ago

    Orbit currently uses a version of Mistral LLM (Mistral 7B) that is locally hosted on Mozilla’s Google Cloud Platform instance.

    Hmm.

    >locally hosted

    >Google Cloud

    Hmmmmmmmmmmmmmmmm.

    • SzethFriendOfNimi@lemmy.world
      link
      fedilink
      arrow-up
      44
      ·
      edit-2
      3 days ago

      Sounds like they’re running their own LLM instance on googles cloud infrastructure vs using something like OpenAI via API.

      As web dev parlance it makes sense but for marketing it is definitely confusing and they should do better.

      • sugar_in_your_tea@sh.itjust.works
        link
        fedilink
        arrow-up
        2
        ·
        1 day ago

        Yeah, we “self-host” our app at AWS at work, which means we configure everything ourselves. I “self-host” a VPS at Hetzner for personal projects, and my actual data is actually self-hosted on a machine on my LAN.