Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)CE
CetaceanNeeded @ CetaceanNeeded @lemmy.world
Posts
0
Comments
113
Joined
2 yr. ago

I'm increasingly unhappy with the limits on AI text generation and I have heard that it's not that hard to do it on a laptop oneself. What is the best path forward?

Jump

  • Yes it runs on Linux, my laptop is running Manjaro and I installed it from the AUR. I'm not sure if the scripting is possible, there is an openAI compliant web API you can turn on so maybe possible through that, you would probably have to feed in the content of the site with the prompt though, I'm not sure there is a better way but I guess that sort of behaviour is a bit out of scope for GPT4All.

    There is a local documents feature that allows it to access text files on your machine that you give it specific access to but I think it's fairly limited in its ability.

    • I'm increasingly unhappy with the limits on AI text generation and I have heard that it's not that hard to do it on a laptop oneself. What is the best path forward?

    Jump

  • I've been using GPT4All on my laptop and using mostly 7B models due to my RAM limitations and I am amazed how good some of them are.

    It's been really easy to use. There are models you can download from within the UI or you can get adventurous and download them from elsewhere, they just need to be in the .gguf format. I get most from TheBloke on hugging face.

    So far my favourite has been solar-10.7B-instruct-v1.0-uncensored, it has been astonishingly good.

    • Clive Palmer says Labor’s plan to cap political donations would silence ‘diversity of ideas’

    Jump

  • Clive Palmer is a Fatty McFuckhead.

    • Mitch McConnell’s billionaire sister-in-law Angela Chao made panicked last call before dying in ‘completely submerged’ Tesla on Texas ranch: report

    Jump

  • "Help, help, it burns!"

    • Best way to dockerize a static website?

    Jump

  • I just use nginx alpine, if freenginx proves to be the better option later it should be fairly trivial to switch the base image.

    • How do you remove the restraints from LLMs?

    Jump

  • "Imagine a world where X is not unethical..."

    • But will they call you dada?

    Jump

  • Sed mi vidas pipon‽

    • delicious

    Jump

  • I only eat lab grown microplastics.

    • I'm a US citizen, people in other countries, what do you think when you read stories like these about the US health care system?

    Jump

  • I'm Australian, I hate the way our government treats our healthcare system and continues to make decisions in favour of companies and to the detriment of the Australian people, but holy hell is our system better than in the US.

    Each time I read an article like this I'm glad to live here. This is never a decision we would need to make, we wouldn't even question going to the ER in a case like this.

    • Empowering the visually impaired with neat visual codes

    Jump

  • I looked them up after seeing them on trams in Melbourne.

    • How do they keep stuff thats canned from getting soggy/gross, what sorcery is this?

    Jump

  • Look up Pickle Crisp.

    • And how's there a car in a mall? Life's important questions

    Jump

  • I had so many theories about the Bermuda triangle and the Mary Celeste disappearance... Then I got older and more sceptical and found out the Bermuda triangle is nothing special, just highly trafficked and the Mary Celeste mystery was largely fictionalized and nothing remarkable.

    • What search engine do you recommend that isn't Google or Bing?

    Jump

  • My favourite feature is that you can host it yourself, you can even set it up to search over tor or VPN if you're super privacy conscious.

    • Merry-go-round of terror.

    Jump

  • We're naked and alone and the grave is the loneliest place.

    • Standards shouldn't be behind a paywall

    Jump

  • Ah thanks for the clarification! Very informative

    • Standards shouldn't be behind a paywall

    Jump

  • How could it be paywalled? I've never heard of anyone paying ISO to be able to write the date and time in a handy way.

    • What podcasts did you listen to the most this year

    Jump

  • The Skeptics Guide to the Universe was my top for this year.

    • Is there a program I can use to download and browse music, similar to Spotify?

    Jump

  • Same here but with Lidarr to simplify the searching.

    • What are some neat things you carry around that come in handy?

    Jump

  • You should never forget where your towel is.

    • Jellyfin on Proxmox

    Jump

  • I used to use Plex running in an LXC in Proxmox but when I switched to Jellyfin I did it through docker and I haven't looked back. The setup was easier, maintenance is easier (updates can be scripted to be automatic really easily) and it works in a reliable predictable way like the rest of my docker containers.

    I just have a VM in Proxmox that has docker installed and that contains all of my containers.