I keep deploying computing projects to mini-pc's and raspberry-pi's. Things like my local weather station and hive witness server and sometimes I feel like it should all be centralized on one server. It would make backups easy and having snapshots would be really nice. Also easy to monitor their resource usage and easily add more or less when needed.
Being able to spin up instances instead of deploying hardware for every environment is something I want to have. I think I will keep it simple at first, but if I could do GPU and high CPU projects like BOINC with Einstein@home and CUDA projects that is something to work toward. Though I may need to save those things for bare metal.. we shall see.. I could at least benchmark them on this and then try again on slightly older hardware but at least it would run without virtualization if that is an issue.
Maybe even building a Hive API server, I can make use of all the NVME drives on this build.
Build list:
AMD Ryzen 9 7950X 16 core / 32 Thread Processor 5.7GHz Max Boost / 4.5 GHz Base
Gigabyte B650 AM5 motherboard
Crucial 2x 64GB Kit (4x 32GB) DDR5-5600 128GB total
Corsair RM850x fully modular power supply
Cooler Master N400 mid tower case
Peerless Assassin 120 SE CPU cooler
2x 4TB SSDs 870EVO
1x 2TB WD Black SN770
2x 512GB NVME
2x 6TB HDD
Since I am using a new CPU architecture (AM5) it requires DDR5 memory.
Not the newest CPU but pretty close, with all its cores it should make some good virtual environments.
We can see on the case where everything can be placed.
Since the CPU does not come with a cooler, I had to buy one.
The power supply should handle whatever I throw at it.. When I start doing more CPU and GPU intensive projects it should be ready. Though I may need bare metal for those projects.. but worth a try.
Getting the PSU mounted and the modular connections made to the power supply.
Time to place the processor into the motherboard.
That CPU heatsink barely fits in the care.. Had to move the fans upwards a little just to fit by the mosfet coolers.
Maybe I should have gone with a full tower case, my video card will not fit in the upper primary PCI-E slot due to my 3.5" hard drives where they are currently. I may need to relocate them to the bottom of the case to fit. Otherwise I cannot fit a CUDA compatible video card inside.
Just to get it running I popped in one of my smaller video cards. But I should go back and rearrange the case fan and drives to fit at the bottom of the case. So the video card as full clearance to fit in the main PCI-E slot.
When I bought this motherboard I did not know it has three NVME m.2 slots.. very cool! I expected just one. So I opened up one of my mini computers that used to run an enviroment and took out the two 512GB drives.. should be useful in this server.
There we go.. got 2TB+512GB+512GB setup. Plus I have 2x 4TB SSD and 2x 6TB HDDs.
All put together ready to use.
One of the memory sticks is defective, so unfortunately I will not get the full speed or power out of the memory in the system. Now I have 96GB of RAM running at DDR5-3600 which is not ideal. Compared to the 128GB DDR5-5600 it should be.
memtesting the remaining three sticks for a short time.. Should probably let it run over 24h to really make sure the RAM is good.
Once the memory tests fine, I will start sending operating system ISOs over there and start the process of importing VMs and building new ones. Using Promox all of that will be possible. Now I just need to take the time to get it all setup.
Oof sad to see you got a duff memory stick, I've never in my life had one DoA yet.
I've got proxmox running on my server, it's a lovely piece of software. Would love to utilize more of it's fancy features but generally they are beyond what I really need.
I have literally 0 backup or redundancy data wise on my server, simply because it's expensive to allocate drive space just for redundancy, so much so I run most of my drives in raid 0 xD
I'd love to have a modern cpu like yours haha, I'm running dual Intel Xeon CPUs E5-2690 v2, Server is OLD but it's still chugging along.
I'm not sure 1TB of total NVME space would be enough for a HIVE API node, Last I had one running it took a whopping 3.8TB of space, Granted the new setup method uses ZFS and filesystem compression which helps, blocklogs are also compressed now and they have also shaved a lot space usage off of the API suite itself when fully synced.
So you might actually squeeze it on there.
I'm a hive witness supporting the blockchain please consider voting for me! - Find out more here!
Yeah was pretty lame.. I do not usually buy Crucial memory.. I stick to Corsair.. maybe that was a mistake.
Nice, good to hear others are using the app too. Hah oh boy yeah well hope nothing happens bad to your setup.. Maybe one day you can upgrade to a RAID-1 or 5/6.
Well as long as its working for you... at least when you upgrade you should really notice a difference.
Yeah I would not be running the API node on that small of a drive. I do have 2x 4TB drives that may work. Indeed I need to look into ZFS. I was reading the Hive api guide and saw its used in there.
Nice, I run a proxmox cluster on some AMD Ryzen Mini PCs with fail over. Works amazingly well. Make sure you look into Proxmox Backup Server, it is really nice.
I largely run docker containers, so I use a lot of Restic (w/ Restic Profile) -> S3 with Healthchecks monitoring Backup, Checks, and Pruning jobs.
Proxmox is so easy to setup a cluster but you will need three devices, but one of them can be a Raspberry Pi Zero just to maintain voting quorum (so they don't fight to be in control).
Also check out Proxmox Helper Scripts to get starting up popular apps stupid easy. Although I generally recommend Docker.
My only complaint about Proxmox is the lack of an option for full disk encryption.
Oh cool.. Okay sounds like I have lots to look into. Yeah backups will be important.
I will be using some tools like Prometheus and Grafana for monitoring VMs and containers. But I need to look into those solutions as well.
Did not know about the helper scripts.. okay cool. I will keep that in mind.
Hah yeah I can see how that would be a negative. Hopefully they implement that in the future.
This is a great project.
I've been testing it for some time now and it seems to work without any problems.
Even Docker runs without problems in an LXC. Besides a few other services, I run a SPS node which has been running for 77 days.
I use Wiregard, which also runs in an LXC on the same computer, so that I can control and interrupt the communication between the respective containers.
I hope you enjoy your new achievement ;)
Nice.. I have not played around with linux containers but looks like it could be useful. That is nice you can probe the network connections to see what is going on.
Thank you, should be cool.
🎉🎉🥳 Congratulations 🥳🎊🎊
Your post has just been curated and upvoted by Ecency
keep up the good work
Nice you should be able to run opnsense or pfsense on proxmox too as a router if you have enough network ports on it ;)
Join us on the Ecency Discord
Ah good idea.. I need to look into software router solutions.
and a docker server for all the other fun stuff radarr sonarr SABnzb plex jellyfin calibre addguard or pi-hole 😎
Uffff God that's quite a machine, what a joy, excellent, I'm very happy for you my friend, that idea of taking advantage of NVMe drives for a Hive API seems great to me! Go for it, you've got a clear vision."
Hah yeah man its a beast.
Yep that should be cool if I can get it all working.
Very cool specs of your computer I really want one day to have a cool computer in my house I only use a few
Ah well hope you get it one day.
What's the good ups is because I want to buy it because here often the lights go out suddenly so I'm looking for references on Google have not found the suitable ones
I like tripp lite products
ProxMox is pretty cool. I had it installed on a BeeLink system that I have here when I was trying to find something to move to after VMWare got bought and jacked up their prices. I ended up going with HyperV since I already own the licenses. I have a 7950X in my desktop here at work and it is really nice. Cool build you have started there!
Really looking forward to toying around with it. Yeah sometimes you have to move when they do that. It looks like Proxmox offers paid versions as well but I think all you get is support for the software.. not sure the free license has any limitations.
Sweet, this is my first Ryzen 9.. should be a beast. Thanks! Will do another post soon when I spin up some VMs.
I'm looking forward to it. Yes, the fee you pay is just for service for ProxMox. If you know what you are doing, you can probably go without it. I think they just added Veeam support for ProxMox a bit ago too, so that is always good for back ups. Virtualization has been a game changer for me in my data environment. Now I just need to start playing with docker containers more.
Interesting project
thanks
Man, that needs a lot of expertise, seems you are pretty experienced ? Do you do any other related job ? How much these cost in total ?
Yes, I have worked many years in the information technology field professionally. I am no longer doing IT support, now focused on decentralized technology.
Cost about $900
Wow, you mounted all of them yourself?
There’s just so much going on and I feel I’d be probably lost in all of it.
Yep sure did. Hah no worries its something I have done many times.. so its easy for me.
Ohhh I see, that makes so much sense.