nagaram

joined 2 years ago
[–] nagaram@startrek.website 2 points 1 day ago (1 children)

I've only seen the episode with Toby Turner in it and it has made me a worse person.

[–] nagaram@startrek.website 7 points 1 day ago

The trick is to talk to real actual human beings and not people terminally online enough to know about Lemmy.

Find a lefty book club and you'll find reasonable people.

[–] nagaram@startrek.website 9 points 1 day ago (6 children)

My favorite lefty take to hit a capitalism/libertarian shill with is that I don't really think a communist/socialist project like the Soviet Union is the future. And honestly, you'd be hard pressed to find someone who does want that.

Its becoming a pretty common take these days that capitalism is fine IF human and environmental needs are met first.

[–] nagaram@startrek.website 4 points 1 day ago

Ollama and all that runs on it its just the firewall rules and opening it up to my network that's the issue.

I cannot get ufw, iptables, or anything like that running on it. So I usually just ssh into the PC and do a CLI only interaction. Which is mostly fine.

I want to use OpenWebUI so I can feed it notes and books as context, but I need the API which isn't open on my network.

[–] nagaram@startrek.website 8 points 1 day ago (4 children)

The put some damn fan service into Law and Order: SVU and I might start watching!

Am I right fellas!?

[–] nagaram@startrek.website 2 points 1 day ago

I was thinking about that now that I have Mac Minis on the mind. I might even just set a mac mini on top next to the modem.

[–] nagaram@startrek.website 3 points 1 day ago* (last edited 1 day ago)

Ollama + Gemma/Deepseek is a great start. I have only ran AI on my AMD 6600XT and that wasn't great and everything that I know is that AMD is fine for gaming AI tasks these days and not really LLM or Gen AI tasks.

A RTX 3060 12gb is the easiest and best self hosted option in my opinion. New for <$300 and used even less. However, I was running with a Geforce 1660 ti for a while and thats <$100

[–] nagaram@startrek.website 3 points 1 day ago

A mac is a very funny and objectively correct option

[–] nagaram@startrek.website 4 points 1 day ago (1 children)

I think I'm going to have a harder time fitting a threadripper in my 10 inch rack than I am getting any GPU in there.

[–] nagaram@startrek.website 2 points 1 day ago

I do already have a NAS. It's in another box in my office.

I was considering replacing the PIs with a BOD and passing that through to one of my boxes via USB and virtualizing something. I compromised by putting 2tb Sata SSDs in each box to use for database stuff and then backing that up to the spinning rust in the other room.

How do I do that? Good question. I take suggestions.

[–] nagaram@startrek.website 4 points 1 day ago (2 children)

With a RTX 3060 12gb, I have been perfectly happy with the quality and speed of the responses. It's much slower than my 5060ti which I think is the sweet spot for text based LLM tasks. A larger context window provided by more vram or a web based AI is cool and useful, but I haven't found the need to do that yet in my use case.

As you may have guessed, I can't fit a 3060 in this rack. That's in a different server that houses my NAS. I have done AI on my 2018 Epyc server CPU and its just not usable. Even with 109gb of ram, not usable. Even clustered, I wouldn't try running anything on these machines. They are for docker containers and minecraft servers. Jeff Geerling probably has a video on trying to run an AI on a bunch of Raspberry Pis. I just saw his video using Ryzen AI Strix boards and that was ass compared to my 3060.

But to my use case, I am just asking AI to generate simple scripts based on manuals I feed it or some sort of writing task. I either get it to take my notes on a topic and make an outline that makes sense and I fill it in or I feed it finished writings and ask for grammatical or tone fixes. Thats fucking it and it boggles my mind that anyone is doing anything more intensive then that. I am not training anything and 12gb VRAM is plenty if I wanna feed like 10-100 pages of context. Would it be better with a 4090? Probably, but for my uses I haven't noticed a difference in quality between my local LLM and the web based stuff.

[–] nagaram@startrek.website 9 points 1 day ago (1 children)

That's fair and justified. I have the label maker right now in my hands. I can fix this at any moment and yet I choose not to.

I'm man feeding orphans to the orphan crushing machine. I can stop this at any moment.

 

My rack is finished for now (because I'm out of money).

Last time I posted I had some jank cables going through the rack and now we're using patch panels with color coordinated cables!

But as is tradition, I'm thinking about upgrades and I'm looking at that 1U filler panel. A mini PC with a 5060ti 16gb or maybe a 5070 12gb would be pretty sick to move my AI slop generating into my tiny rack.

I'm also thinking about the PI cluster at the top. Currently that's running a Kubernetes cluster that I'm trying to learn on. They're all PI4 4GB, so I was going to start replacing them with PI5 8/16GB. Would those be better price/performance for mostly coding tasks? Or maybe a discord bot for shitposting.

Thoughts? MiniPC recs? Wanna bully me for using AI? Please do!

 

So I have rebuilt my Production rack with very little in terms of an actual software plan.

I host mostly docker contained services (Forgejo, Ghost Blog, OpenWebUI, Outline) and I was previously hosting each one in their own Ubuntu Server VM on Proxmox thus defeating the purpose.

So I was going to run a VM on each of these Thinkcentres that worked as a Kubernetes Cluster and then ran everything on that. But that also feels silly since these PCs are already Clustered through Proxmox 9.

I was thinking about using LXC but part of the point of the Kubernetes cluster was to learn a new skill that might be useful in my career and I don't know how this will work with Cloudflared Tunnels which is my preferred means of exposing services to the internet.

I'm willing to take a class or follow a whole bunch of "how-to" videos, but I'm a little frazzled on my options. Any suggestions are welcome.

 

Okay Kubernetes people. I am about to build my first cluster with 4 Raspberry Pi 4B 4gb models powered over POE.

I was going to host just some basic stuff on it (forgejo, a couple Ghost Blogs) and try hosting a Mastodon instance.

The documentation mentioned that I should not use the SD cards for database stuff. So I was going to get some super short thumb drives.

What is everyone else's set up look like with raspberry pis? And how important is matching hardware?

I'm sure I'll learn more from reading the documents but this is my concern right now.

(I was also required to upload a photo so have my Latitude D630)

 

Anyone have any recommendations for Blog software?

I was considering for a while just using a mastodon instance as my blog because I just kinda wanna sign in and upload my papers that I've written. I was pretty close with Hugo. I'd rather not have to build the site everytime I upload and I want to self host and not use Github actions. I think I still could do it since I like using Cloudflared tunnels.

What is all out there?

 

I run my production Jellyfin server and a few other services on a Optiplex sff computer with a thicc hard drive and a low profile GPU.

I want to build two more of these with thicc Hard drives so that my parents and my in-laws can have a local Jellyfin instance that I manage remotely and they just need a box plugged in somewhere at their homes.

Is it possible to make Proxmox build a VPN tunnel on boot so I can just have it in my cluster dash. Like using tailscale or openvpn.

Or am I going to have to go with my original plan and put that on the same box as the Jellyfin server and then just VNC in?

Any tips or ideas?

 

So I'm trying to get Jellyfin accessible on the open web through a cloudflared tunnel

I have a default install of Jellyfin running that is still accessible locally.

I'm able to ping TV.myblogdomain.com

And the Cloudflared dashboard says the connection is up.

I have implemented page rules and caching rules to turn CDN off.

I have set the DNS server on the Jellyfin VM to be the Cloudflared DNS server.

It's pointed to https://jellyfin:8096/

And it wasn't working with or without a CIDR in the tunnel configuration.

Should I try uninstalling fail2ban and see if that helps? I thought I configured it right pointing it to the 8096 port but maybe I need to do 80/443?

Any tips or guides would be appreciated.

 

I have been upset recently by a colleague googling me and found my full name on several 3D Printing sites I used to use. I guess I signed in with my google account and so it just pops up now that I've deleted all my socials.

I have a fairly uncommon first + last combo so the cursory google search and then sending "delete my data" emails from the email they know from the 3 data brokers who popped up seems good and now just my linkedin is showing (this is the ideal state).

Is there more I'm missing? should I go for a deleteme subscription in case I missed anything? Other sources I should go to?

I really don't mind sending my own emails to these pests, but is that really all the services are doing? Or is there a backend I'm missing?

 

I've been wearing Xero shoes as my preferred every day shoe and my hiking shoe of choice for a while. I got a few pairs on a steep sale and now my last pair is starting to die.

I don't mind getting more, but I'd like to see what else is out there. I used to wear Altra and I've gotten Hobbart shoes, but those were weird shaped and rubbed on my pinky toes.

Any suggestions for foot shaped shoes? I'd prefer some cushion like Altras and bonus if there's a business casual looking variety

 
34
SIEM (startrek.website)
submitted 5 months ago* (last edited 5 months ago) by nagaram@startrek.website to c/selfhosted@lemmy.world
 

I am studying for my Network+ and my Sec+ hoping to shadow our Cyber Sec guy at work.

I want to set up a SIEM on my home network so I can be used to it's operations and how it works by the time I start messing with Pentesting stuff. Then I'm going to use it to try and track myself when I pentest myself.

I was looking into Graylog or Security Onion since they seem to have decent documentation (and I can find videos on how to set them up which is nice).

I was recommended building my own ELK stack and doing everything manually for maximum learning potential. Which I understand why this is a good idea, but I think I'd rather be as close to "baby's first SIEM" as possible or at least have a robust how-to guide.

What do you suggest?

 

Hello comrades! Friendly reminder that American leftists continue to be threatened by gun loving conservatives. You should know how to defend yourself and you should probably own a gun. Find an active SRA, John Brown Gun Club, or (if things are dire) pink pistols or other "apolitical" gun club.

I've been in the SRA for 4 years, it's not great, but I met comrades local to me. I've learned a lot from them and fash who post good firearms advice and I love to share that when I can.

Open for questions and I'll post more getting started stuff if this doesn't get banned.

view more: next ›