Website Github GPG keys

I write code, that’s about all I’m rn

  • 55 Posts
  • 315 Comments
Joined 2 years ago
cake
Cake day: July 3rd, 2023

help-circle
  • I’m working on self-hosting my own LLMs.

    I realized there are things I wanna talk about and research but I don’t want to send it to open AI. Frankly I feel gross about how much I’ve sent to open AI. My desktop is a beefy gaming rig that I don’t use for gaming much. I have a 20thread core, 64gb ram, an Nvidia gtx 3060 and 5 spare TB so why not.

    • I keep a few ollama models downloaded and I’m slowly getting to know them and what they can do. Gemma seems to answer the fastest so I’ve been using that. Deepseek is like the reasoning button on chatgpt.
    • I use openai-whisper to transcribe meetings I record using OBS. It’s really slow so I have a cronjob transcribe all my meetings for that day overnight.
    • Open Web UI is a fantastic LLM frontend. It provides tools, rags, web searching, and model ranking all as a simple to use UI.
    • My desktop has a Wireguard server which makes it easy to use my OpenWebUI on my phone.

    Now I want to work on giving the LLM access to my Google calendar so it can create reminders for me. I’m sick of forgetting to think about remembering to do things so I hope if I can just ramble at the LLM about what I’m doing or what’s on my mind it can organize my thoughts. What else are these LLM actually for?




  • ½TB nvme SSD for the OS and any system/user level binary

    1TB sata SSD for code projects, docker, and videogames

    10tb HDD for just having a massive amount of fairly stable storage space. I gotta tell you I sleep really well knowing that at 4 in the morning a compressed disk image of my work SSD is being written to the hard drive.















  • Whenever I think of the Dylan Roof incident.

    The death penalty isn’t a punishment, who really learns from it, the criminal? It’s a tool for society to remove what amounts to a defective person (not human, person). People are supposed to value the lives of other people by default. Any sustained deviation from this norm is a symptom of a person who cannot value life.

    Dylan Roof was given 1000s of opportunities to demonstrate that he did actually value life but because of his defective nature there was no choose but to remove him.

    “Life in prison” can be canceled/pardoned/changed, death cannot. That is why it’s near impossible to make it happen and even if it does, people spend the rest of their lives waiting for their “execution” (ftr Dylan is still alive at this time source).

    Now in what possible world would you be able to convince a jury of random peers, or judges with their heads actually screwed on tight, that a sample size of one murder proves that a person is defective.

    Genuine responses only: