VirMach
VirMach
Comments
-
04:40:12 up 6 days, 4:12, 1 user, load average: 8.04, 8.25, 7.43
-
We completed PSU swap here, so we have to see what's wrong at this point. It's just shutting off and not throwing out kernel errors so what's left that could be possible I can think of is CPU suddenly overheating or loose cables elsewhere.
-
SEAZ008 finally back up, god that took a long time. DC hands plugged in IPMI to LAN and LAN to IPMI, finally corrected. A lot of others have been fixed as well, all of Atlanta (DC hands gave the port numbers in reverse order) and all of NYC by now except NYCB036., SJCZ004 as well, and looking at the rest now.
-
I'd scream at CC but I've given up on that. They placed a permanent nullroute on the main IP. This is probably the 30th time they've done this, from a single website being malicious. I'm trying to get a server up and just move it at this point. Again I'd usually be freaking out and working on it immediately to get it…
-
Not sure what you mean by that, on my end the /24 is functional and previous issue(s) corrected. I actually fully forgot what happened with this one, my brain can only store so much when it comes to literally everything breaking at some point but I did just check and verify every VM in DALZ009 has a correct IP assigned and…
-
Expected. This is one of the reasons I said IPv6 may break and it's not yet officially delivered and we put it on the backburner for some locations. It was only set up to function on the same VLAN, we have to go through and split it up now, probably re-assigning a lot of them, and we can't focus on that right now. Or we…
-
It's crazy how hard the NIC was trying to keep up with the previous network configuration, this screenshot says it all. I almost had to check and make sure the change didn't just knock everyone offline or crash something.
-
Yep, it's actually crazy how much of a massive improvements it made for Tokyo. Other regions improved maybe 20-30% after the change but Tokyo is probably an easy 70% across the board, that's lower load, CPU usage, improved ping and transfer speeds. It was also the smoothest change by far, xTom is pretty amazing. Meanwhile…
-
All of NYC has also had this applied. DC had wrong ports labeled for about 7 servers so those are currently offline (networking-wise.) Around 6 can be fixed more quickly, one definitely can't because it has to wait on network engineer.
-
Oh by the way, we signed on for Chicago, Tampa, and Los Angeles with Hivelocity. Pretty excited about that. Basically it happened the second QN made me lose my mind over the nullroutes. Not that we're moving all of LA to Hivelocity, it'd just be nice to have since we needed more space anyway. Chicago we're going with QN as…
-
I'm lucky enough to still have my parents around and every time we speak they remind me of this, and even though I'm a grown man now I still get a kick out of their reaction when I say something along the lines of "okay, I'm taking a two month vacation. I'm sure everything will be there when I get back!" This is honestly…
-
This is knowledge from a long time ago and it's based on hearsay from someone who used to work for us, but in the past, we couldn't do static routing with SolusVM. I don't remember the specific nor do I want to dive into it right now to verify. VM-specific configuration, not even going to begin diving into that one with…
-
DALZ007 as well as a few others have been waiting probably nearly 2 weeks for networking to set up the VLAN properly. The way the teams function and how they do networking is not ideal in my opinion and we only have issues with this one partner. Others set it all up at the beginning, but for some reason this one seems to…
-
Tokyo is finally getting its long-overdue network overhaul. We had a good discussion about it and I want to kind of share what we believe is occurring right now and why. Turns out, pretty much every network engineer I've spoken with agrees that large VLANs were not necessarily the issue. I know when previously discussing…
-
All I can immediately tell you is that it's not a node-wide issue and only 1 single person's service is "offline" and many are using networking and racking up bandwidth usage, with their service pinging. You might have to install a new OS if possible for the easiest fix, or make manual modifications and/or try reconfigure…
-
Very vague so I'm unable to even figure out if you're on a location facing problems such as Seattle or if it's unique to your service. We'll allow people to request credits as long as they're very clear about it and basically, concise, when making the request. So basically if you said: We'd probably just have to close the…
-
Seattle finally got the switch configuration changes we requested. SEAZ004 and SEAZ008 having some issues with it (indirectly) so waiting on hands request for that, otherwise Seattle networking is finally decent. ATLZ007 had a disk issue that's been fixed, as well as SEAZ010. Tickets are pretty much unfortunately useless…
-
Some weird DNS issue that just went away. I don't remember who we set up for DNS but it's possible it briefly had a burst of connection issues in that route. Unrelated to SolusVM. It's WHMCS, it couldn't resolve Google either.
-
09:29:04 up 29 days, 20:51
-
I was already expecting their DDoS protection to be pretty bad, as in an attack would leak through. Never would I have guessed that it's so good that it doesn't let ANYTHING through. They've solved the universal problem of denial of service attack by beating the attacker to the punch. Truly remarkable. Honestly my only…
-
SolusVM has migrated to either an Epyc or Ryzen servers, I don't remember. We got it like a year ago probably at this point and never used it until now. Let's see if this improves anything or if we're still stuck with PHP/MySQL bottlenecks.
-
It could be an IP conflict or IP change. If it continues let me know. We've brought people on, we actually have someone helping but unfortunately they're not at the level we need them to be to really make an impact. There's also someone I'm supposed to be hiring for multiple months now from OGF but I basically have no time…
-
Yeah looks like syncs got absolutely gutted by everything I said above as well.
-
The templates were all fixed for all migrations up until yesterday or so, but only on SolusVM. Those aren't tied to their original package anymore. WHMCS is next if I can squeeze it in.
-
This was supposed to be a quick migration but QuadraNet has been nullrouting our IP addresses all day for doing the transfers. I guess their DDoS protection is some script they set up to deny you service, the 14 year old developer must have misheard the objective. I've been going through these more closely and they…
-
Side note on multi-IP, at this point it's going to require a lot of work to sort through all of it and that's after we set up more nodes. Multi-IP will most likely for most people require another migration as well. Originally this wasn't going to be a problem but originally we were also counting on IP subnet overlaps. Now…
-
Bottom of the list at this point to be frank. I understand it's very important to some, we just have to make sure people have a functional service first, a functional IP second, that the networking actually functions well, more builds, coordinating shipments, backups, migrations, and getting through the literal thousands…
-
Template Syncs - Ongoing, many more re-synced. OS installs should work better. QuadraNet's "DDoS Protection" is essentially just hefty false positives though so for Los Angeles I might have to literally drive down a hard drive and load them on at this point since all the tweaks they do still don't allow for it. This also…
-
Networking Update - Just essentially waiting on DC hands at this point for NYC, Dallas, Atlanta, San Jose, Seattle, Phoenix, and Denver. Once these switch over networking should improve drastically and it should also have a positive impact on the CPU steal. We were supposed to have it done today but doesn't look likely…
-
We're ramping up the abuse script. It's what it is called. I didn't say boot loop after migrating is abuse. Abuse script will just power it down, not suspend. I don't see the harm in powering down something stuck in a boot loop. I was just providing this as a PSA for anyone reading who might be doing something else not…
-
Were these always offline after Ryzen Migrate button?
-
This has an issue with a software getting stuck and duplicating its process over and over until it overloads and we have to reboot it. We made some changes, if it happens again we'll try to catch it earlier this time to avoid a reboot.
-
Settings stuck on FFME004 but I'm pretty sure I've said that once before. There's zero information on this but there's been constant kernel bugs regarding these fixes on Linux. I can't rewrite the Linux kernel right now so until Linux figures out how it's going to treat these problems I don't know what else to do about it.…
-
FFME004, we found ECC error, and the settings also dropped off again. Memory swap fixed FFME004, we couldn't send out migration emails in time because xTom worked very quickly to get this replaced. The setting drop-off caused a disk to drop and node was online but VMs were not booting. That has been resolved. I'm checking…
-
I'll make a network status page for it since it seems a lot of the emails failed to send.
-
Well initially the way it's going to work is there will be a period of time where you're allowed to "Ryzen Migrate" to your desired location (without data) as everyone lands in their desired location. It'll be announced here and on OGF, as well as most likely an "Announcement" on our website and probably a 1-2 week period…
-
We're ramping up the abuse script temporarily. If you're at around full CPU usage on your VPS for more than 2 hours, it'll be powered down. We have too many VMs getting stuck on OS boot and negatively affecting others at this time, due to the operating systems getting stuck on boot for some after the Ryzen change. I…
-
I understand, I'm just adding onto it that I agree with you and it's not user friendly and I'm also saying that unfortunately our current situation is similar and also not how we intended for it to be coded by the developer. I did read what @yoursunny suggested and that definitely has its benefits but our ideal version…
-
I agree with you on this. We didn't really have another choice for these. It's painful and bad, for us as well. There are probably 5% of people that have been stuck for 48 hours now and I don't like that but we're doing all we physically can. Everything keeps breaking and I don't just mean on our end. We're using 10 year…
-
Unfortunately there's pretty much nothing we can do about that really. I really think SolusVM did some updates to that tool and broke it for older operating systems recently. They've been breaking a lot of things, like libvirtd incompatibility, the migration tool wasn't working for a while, the operating systems don't…