Hardware upgrades and expected downtime

What’s happening?

We keep running out of disk space, and overall performance is sometimes unsatisfactory. As such, there will be some downtime in the coming days, as services on the vault are migrated piece by piece to newer hardware. The new setup will provide a much more modern CPU, plenty of free disk space on faster disks, a lot more RAM, and the option to add a SSD accelerator, if the need for it arises once everything is said and done.

Process

If you’re seeing “Error 503 (Service is migrating to new hardware)” coming up when visiting any of the vault pages, that’s why. I have to take down each component to ensure data consistency, move said data (quite a bit, in some cases), test on the new setup, and update DNS once it’s back up. This can take many hours for the biggest components, so patience will be needed.

Some of the software can be a bit finicky. I’ll be taking this slow over the coming days, and use the opportunity to improve some aspects of that. I’m still evaluating the new setup, so I don’t expect this to start immediately.

If you see issues on already migrated services, or have questions, please post here!

Status

Service Migrated Caveat/Issues
Main page and big data store 2023-10-08
This forum 2023-10-07
nwn.wiki (+SSO service) 2023-10-04
nwn.ee (+API) 2023-10-06
nwnlexicon 2023-10-04
Discord bot and task runner 2023-10-07
VM for crash dump decoding 2023-10-07
Monitoring yes
Backups yes
Audit/logging yes
11 Likes

@niv

If you are able to allow us to delete “previous revisions” of our own modules, I could probably free up a ton of space for my own module: The Scroll | The Neverwinter Vault

Possibly not a great deal of space in the grand scheme of things, but being able to manage our own content (at least the very old stuff) may go some way of helping reduce some?

Say 1GB a revision, with 35 approx per page and 29 pages of revisions: around 1TB data perhaps?

P.S. I would like the option to keep some of the older revisions (just in case). :wink:

2 Likes

Yes, this would be good. Like ideally I would prefer to keep just the major releases, but until I reach the next release, it would still be good to be able to give people the minor interim releases, without having to feel bad that I’m hogging a bunch of space.

1 Like

Thanks for your concern!

I agree that project and version management also needs quite a bit of love. This current effort is mainly focused on moving everything over safely though, and while doing so, optimising the hosting aspects of the software.

Any procedural changes on the CMS (or even a better replacement for it …?) must follow at a later date.

2 Likes

nwn.wiki was migrated over to start this off. Let’s see how this works out. Please report any issues seen.

1 Like

I do not know if it is related to the migration, but I am geting a consistent ERR_SSL_PROTOCOL trying to connect to the Lexicon now.

Just migrated it over. Give it 30 minutes and try again.

Sure thing, I’ll report back in 30 ish then :slight_smile:

This seems to be working properly now, so it seems it was just the migration :slight_smile:

Not for me … :face_with_diagonal_mouth: But maybe I have the wrong link?

EDIT: Now sorted by niv!

Have I selected the correct page link ref below? (Is the second non-secure link to be ignored?)

Has this …

Alternatively, http://www.nwnlexicon.com/

Has this …

Nothing here

EDIT: Above also fixed.

FYI https://nwn.wiki/ appears fine for me.

P.S. Is it worth supplying the FULL link in your Services for testing above where accessible?

https://nwnlexicon.com works for me.

1 Like

Thanks for picking that up. www should work again now (and redirect to the non-www-site).

2 Likes

Yep! That works now! :+1:

Very helpful for others doing web searches for the page! :slight_smile: (They still reference the www versions, but now go to the correct pages. :+1:)

1 Like

Thanks for the heads-up, but more importantly, thanks for your hard work to keep this place running.

6 Likes

When I login now to the forums, the default redirection page for the login gives me an error that the “payload was not set”

I saw that too. But then opening the forum again logged me in. Overall, SSO with Drupal was a mistake. Now it’ll be hard to get rid of unless we make every single user set a new password here. Still mulling that over - in the interim, will fix the redirect at some point (probably when the rest of Drupal migrates …)

1 Like

Drupal… oh I am so sorry.

2 Likes

One very, very minor thing. New version of Discourse? The only thing is the vertically aligned controls that you get when you click on your avatar appears to have some new controls but not one of the control’s icons has a tooltip. Trying to figure it out, I’m not sure what they’re supposed to do (especially the “Rubik’s cube” at the bottom of new controls).

Thanks.

TR

1 Like

Seems to be Solutions and … edits?

They have tooltips for me, just takes a moment to show. Discourse is rolling out a new main menu/sidebar thing that’s coming with version 3.2. This is part of that already, I think.

  • All
  • Replies
  • Likes
  • Messages
  • Bookmarks
  • Rubiks cube is “Other notifications”
  • Profile
1 Like