2y ago

Are things broken? I know Lemmy 0.19 has some federation problems but it seems like more than that is broken for about the last week.

It seems like just recently, everything broke. Posts from some other instances (Lemmy 0.19 or kbin) aren't showing up here reliably anymore, and then sometimes posts from a few days ago will suddenly show up. kbin.social has a banner talking about unusual "problems" without going into detail.

Does anyone know what's going on or why? I've heard that Lemmy 0.19 has a problem where its outbound federation queue will sometimes die until it's restarted manually, but that doesn't seem like it should affect a lemmy.world <-> kbin interaction. Is it just Lemmy 0.19, or just lemmy.world, or are there multiple issues, or what gives?

22 comments

lemm.ee took a while to upgrade from 0.19 to 0.191 and then had some serious performance degradation before undergoing some backend upgrade which finally completed a few hours ago. This should finally clear up the lag and backlog between lemm.ee and other instances, particularly lemmy.world, with which it had a lot of lag issues.
I believe kbin is updating the API, working on bug fixes and improvements and such, so the site is spotty right now. It said this would be happening for a few days, but that was a few days ago...
- Interesting, thank you... so maybe it's just a combination of 0.19 breakage and kbin.social breakage coming unfortunately at the same time.
  
  Everything seems kinda fucked at the moment. Here's the German community on kbin, fedia.io (mbin) and its original Lemmy instance:
  https://kbin.social/m/dach@feddit.de https://fedia.io/m/dach@feddit.de https://feddit.de/c/dach
  kbin.social really struggled with its issues affecting performance a lot which ernest seems to got a hold of by now. This didn't happen on fedia.io (mbin) but the federation issues seem to persist with being almost 2 weeks behind now. Something is really off but it also seemed to all have kicked off around the same time? Kinda feels like Lemmy pushed something that affected both platforms differently. Either way, kinda makes the Fediverse somewhat unusable and pointless if stuff like this constantly happens.
- Glad to hear that kbin is also updating!
Kbin has separate problems because it is a different software. Cant speak about that as I dont know what their problems exactly are.
As for Lemmy, if posts show up after days it's probably because 0.19 is more resource-hungry than 0.18 which causes some servers/instances to lag behind in outgoing federation.
- 0.19 has functional problems beyond simple resource consumption. It is fine, this is the nature of bleeding-edge software, just curious if anyone knew what was going on or if there were additional problems affecting the system beyond that one that I'm aware of.
  I'm also aware that kbin is different software from Lemmy. Just curious if anyone happened to know what was up with them, or whether the problems were in some way related (e.g. failures to federate out from Lemmy 0.19 instances to kbin leading to some queue filling up so that kbin can't get its usual work done and enters unusual failure states), and this seemed like a decent place to ask since some people on kbin obviously read this community.
  
  Have a look at https://github.com/LemmyNet/lemmy/issues/4288, hopefully the fix is released soon
Granted my instance is tiny, but have had zero noticeable issues with 0.19.1 since updating weeks ago. It had some increase in CPU on deployment due to DB and Pictrs also doing DB upgrades (or upgrade prep - depending if you stayed on 4.7 or went to 5), but has been running fine since.
- Mines also tiny and my timeline is all fucked up since updating.
  Posts I just make are 11 hours old the second I send them and I’m getting about 60% of the content I see when I browse the original instance of a community coming through on my side.
  
  Check this
  https://phiresky.github.io/lemmy-federation-state/site?domain=quokk.au
  AFAIK, in order to fix outgoing federation issue, you need to restart Lemmy and DB every few hours. This is a temporary solution
  
  Weird, did you run any of the alpha/beta/rc builds? I did and maybe that somehow made my upgrade smoother?
Posted with the wrong account below sorry lol I was saying that, without pointing fingers as i think Lemmy is a w e s o m e, this is a major drawback for new users that looks interoperability.
I'd just like my pre-0.19.x Prev button back, please.

22 comments