selfhosted
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Dissk@alien.topB to Self-Hosted Main · 3 years ago

Ollama - super easy to host local LLM

github.com

external-link
message-square
6
link
fedilink
6
external-link

Ollama - super easy to host local LLM

github.com

Dissk@alien.topB to Self-Hosted Main · 3 years ago
message-square
6
link
fedilink
GitHub - jmorganca/ollama: Get up and running with Llama 2 and other large language models locally
github.com
external-link
Get up and running with Llama 2 and other large language models locally - GitHub - jmorganca/ollama: Get up and running with Llama 2 and other large language models locally
alert-triangle
You must log in or # to comment.
  • Gamma@beehaw.org
    link
    fedilink
    English
    arrow-up
    3
    ·
    3 years ago

    There’s also an unofficial web frontend https://github.com/ollama-webui/ollama-webui

    Though I can’t get compose to use my gpu

  • getgoingfast@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 years ago

    Thanks for sharing this. Not an expert, so here goes my dumb questions. Can we potentially train these model with local data kinds of like Stable Diffusion checkpoints?

  • Pi_ofthe_Beholder@alien.topB
    link
    fedilink
    arrow-up
    1
    ·
    3 years ago

    Thanks Ollama

  • SnooPets20@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 years ago

    I’m thoroughly disappointed by the lack of Obama memes in this repo.

  • SungrayHo@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 years ago

    Ollama works great with Big-AGI too, look it up on github.

  • graveyard_bloom@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 years ago

    Ollama is pretty sweet, I’m self-hosting it using 3B models on an old X79 server. I created a neat terminal AI client that makes requests to it on the local network - called “Jeeves Assistant”.

Self-Hosted Main

main

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !main@selfhosted.forum

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.

For Example

  • Service: Dropbox - Alternative: Nextcloud
  • Service: Google Reader - Alternative: Tiny Tiny RSS
  • Service: Blogger - Alternative: WordPress

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

  • Awesome-Selfhosted List of Software
  • Awesome-Sysadmin List of Software
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 1 user / week
  • 4 users / month
  • 20 users / 6 months
  • 2 local subscribers
  • 681 subscribers
  • 1.82K Posts
  • 10.6K Comments
  • Modlog
  • mods:
  • communick
  • rglullis@communick.news
  • BE: 0.19.17
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org