Ategon @ Ategon @programming.dev

Indie game developer 🇨🇦

---

Read more

Posts

93

Comments

383

Joined

2 yr. ago

Moderating

---

Should be back, federation might take a bit to catch up though

There seems to be some sort of issue with pictrs atm which is messing everything else up, trying to fix it but I might have to wait for snowe to manage the object storage

Might have something to do with peak activity times affecting it, ill see if I can speed it up more

Yeah we added another admin onto the team

Yeah it uses a system similar to github actions

The forgejo instance here is meant for repositories related to programming.dev and the fediverse

Cleared all the spam repos so you shouldnt see any more, will do a more permanent solution later (will see if I can do an application process using a third party form system since forgejo doesnt have that built in)

Yeah I havent gone through and cleared it in a bit since there isnt much of a point to due to it being mostly used internally only rn (and forgejo makes the process very annoying unless you do it directly through the db)

Ill purge things and adjust settings again soon

I couldnt find anything in the post details from looking at it that would differentiate it from other posts

Cant find anything that would cause this in the db. Thought the dates got messed up in federation but they seem to be perfectly normal. Still pinned even if I manually change the date to a year in the past

Im assuming something got messed up from the nodebb->lemmy federation

Im going to remove the post as thats the only way I see to get rid of it

!emacs@programming.dev exists already

Ill go through and remove the hides from the communities that dont have bot content anymore

Not possible in lemmy atm past just rehiding everything from the instance every so often

edit: just did another round of hiding things from lemmynsfw, should be reflected in the hidden communities doc

Ah yeah I need to refresh the data, ill do that later

Nobody reported it as down to me, I can bring it back up

Been working on some other projects recently so havent really looked at that site much

Sites back. I reindexed every table although the only one that seemed to be affected by the issues was the comment table (it had duplicates I had to remove similar to what I did for the post and community tables before)

Site will slowly catch up in activities over the next couple hours so youll see posts, etc. that were made in the few hours it was down slowly come in

No votes or comments were connected to the duplicates but yeah if there was some you would move it over to the other one

The posts that had comments were the posts that were uniquely on the other community and those moved over with the post when I updated the community of the post

Sites back, communities that previously had their community page not vieweable are now viewable

An example of this is https://programming.dev/c/a11y

Basically what I did was before the maintenance exported every single post in the post table and use a js script to check for duplicate ap_ids (checking using sql itself didnt work due to broken indices so it was always missing some). Then I generated sql statements to remove duplicate posts that had higher ids than the other posts theyre a duplicate of. Ran all those during maintenance and since all duplicate ap_ids were removed I could now reindex the table to fix the broken indices

Did the same for communities after the posts (but also did some statements to move posts from one version of the community to the other)

Site might be slow for a tiny bit as it processes the 2 hour of activities that were generated while it was down

Sites back up

Got a lot of information about what it actually causing the issues which should help me automate some fixes for tomorrow + the weekend

There likely will be some more downtime tomorrow if I have time (if not itll be on saturday)

The issue is essentially a chain of issues with one needing to be fixed before I can fix the others. Some tables have duplicates entries which is preventing reindexing (since the indexes are broken). First one im going to try to fix is the post table.

I did some changes to remove a duplicate community to test which is https://programming.dev/c/photography@lemmy.world and ive managed to make it merged and now comments will show if you sort by comments in the community. Posts however still aren't showing up due to the posts table having the issue with duplicates as well. (fixing posts first so I can set all of the posts to the correct community in an automated way later for the communities)

Was an issue with the upgrade script when upgrading to 0.19.5

Caused by the same db issue thats been causing issues

Yeah they appear in the feeds. So people primarily use it through sub and local sorts atm