Skip Navigation

Search

From SDF about the (not only) Lemmy outage

From bboard ANNOUNCE BBOARD: ```<.> TACKER: membership (SDF Membership) SUBJECT: network outage in second cabinet DATE: 16-Apr-24 01:22:19 HOST: mx

It looks that we're experience a network outage to our second cabinet this evening. A ticket has been opened to address the issue.

This affects ryo.sdf.org, lemmy.sdf.org and ma.sdf.org

Thank you for your patience.

<ANNOUNCE.1.0/2>(87)[ <ENTER> follow thread, (R)EPLY, (F)LAG or (Q)UIT ]

TACKER: membership (SDF Membership) SUBJECT: .. network outage in second cabinet DATE: 16-Apr-24 01:59:59 HOST: mx

Confirmed that this is only a network outage to the second cabinet and is currently being worked on by our network service provider. Hopefully it will be resolved soon. Thank you for your patience.

<ANNOUNCE.1.1/2>(6)[ <ENTER> follow thread, (R)EPLY, (F)LAG or (Q)UIT ]

TACKER: membership (SDF Membership) SUBJECT: .. network outage in second cabinet DATE: 16-Apr-24 20:19:30 HOST: mx

our network provider has reassigned our uplink port for the second cabinet and the hosts are once against accessible.

(it even blinks! What!? Why?)

<ANNOUNCE.1> Command: ```

Just relaying it here.

Note: I am not affiliated with SDF

9

Hello. Your server sends out all activity twice

From my nginx access log:

your.ip.address - - [21/Feb/2024:06:50:09 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3; +https://lemmy.sdf.org" your.ip.address - - [21/Feb/2024:06:50:09 +0000] "POST /inbox HTTP/1.1" 400 0 "-" "Lemmy/0.19.3; +https://lemmy.sdf.org" your.ip.address - - [21/Feb/2024:06:50:09 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3; +https://lemmy.sdf.org" your.ip.address - - [21/Feb/2024:06:50:09 +0000] "POST /inbox HTTP/1.1" 400 0 "-" "Lemmy/0.19.3; +https://lemmy.sdf.org"

2 of the entries are "https://lemmy.sdf.org/activities/like/88bc5b6d-f11f-4245-90aa-908e43befe97" being sent twice, the other two are "https://lemmy.sdf.org/activities/like/437327e5-a262-46bc-8ce7-1c2c5bd440b3" being sent twice

I've reported this problem to other affected servers that I've seen: the lemmy.ca post suggests the problem was something to do with running multiple containers with the same index number; the endlesstalk.org post suggests that re-starting the backend containers is a fix (their answers will likely more sense to you than to me, as I don't run lemmy).

Thanks!

11

What's the issue, specifically, with Lemmit federation?

Example: On here vs. on Lemmit itself.

I don't know if this is our end or theirs, but nobody seems to have commented about it on their meta community, which makes me think it's not broken for users on bigger instances.

4

Federation is broken again - in a slightly different, more subtle way this time

I created this post on [email protected]: if you go directly to the instance, it shows twice as many comments, and a lot more upvotes than on the SDF view.

5

Certificate of lemmy.sdf.org is expired

1

Get an RSS feed of any lemmy community:

The url scheme looks like this:

https://INSTANCE.TLD/feeds/c/COMMUNITY.xml

for example:

https://lemmy.sdf.org/feeds/c/sdfpubnix.xml

!

2

SDF federation is on the fritz again (Jan. 5th - Now)

It appears that comments stopped federating to other instances again sometime yesterday morning (January 5th, before 8AM EST). I can verify that the issue is affecting outgoing comments to multiple different instances (incl. lemmy.ml & lemmy.world) and that it remains ongoing as of the time of writing (e.g.: compare this remote post vs. SDF's copy, my comment is missing). I'll do the honors and ping @[email protected] here and now so you guys don't have to.

In the meantime, since we're all marooned here anyway: how's everyone's weekend been going so far? Any exciting plans?

11

Outbound federation is not working

For example this post visible from lemmy.sdf.org is nowhere to be seen on the corresponding thread on lemmy.ml.

5

sdfpubnix is not listed in my community subscriptions sidebar

Edit: I found it, apparently the list isn't ordered line-by-line, and sdfpubnix was just crammed beside another community name!

!

~~~

I'm not sure if that's a bug or not. I'm joined to the community, but for some reason it doesn't show up in the list with the other ones. Has this happened for anyone else?

To get here I currently click on @SDF in the "about us" sidebar, and then click sdfpubnix in that account's moderated communities list...

2

Hit an error when browsing notifications

I had a notification on the bell icon, and when clicking to open context for the item it returns a server error. Just FYI for the SDF crew.

!

!

2

SDF's MLMYM (old reddit view for lemmy) instance appears to be down. What's going on?

A few days ago SDF's lemmy instance went down entirely, taking the MLMYM instance with it. Lemmy's back, but MLMYM isn't. Is something more nefarious afoot?

2

How does @SDF plan on handling the current situation with illegal images being federated/uploaded?

For background, this post on db zero provides background on what is going on.

Lemmy.world had to shutdown a community and temporary restrict signups, other instances have purged image caches, and dbzer0 is using a scanner to prevent images from being uploaded if the get flagged.

3

Can we enable PixelFed Instagram import?

Hey @[email protected] , just tried out the Instagram import feature. Looks like it will ingest the Instagram data but will not process it. Looks like import is only available to admins? Can we all get it? Or make it an ARPA tier or something?

0

Lemmy.sdf.org keeps asking for 1.7GB of local storage

This happens every time I open a thread. This started today. This hasn't happened before now. What's going on?

!

13

Is old.lemmy.sdf.org broken for everyone else or just me? Edit: It Works!

It looks like when logged in, instead of loading comments, it gives a 500 error in the comment box.

Edit: It looks like they fixed it. Thank you @SDF!

2

Is there a "standard" SDF tag on Mastodon?

I wanted to tag SDF today. A #sdf came up, but it seems to refer to something(s) different. I also saw a #sdfdotorg.

Is there a tag that's sort of "standard" to refer to SDF? Standard in the sense that it's typically used by SDF members [Edit:] Mastodon users interested in SDF.

4

Is there any interest in SDF hosting an "old.lemmy.sdf.org" MLMYM Lemmy front-end

I noticed that lemmy.world and slrpnk.net host old.lemmy.world and old.slrpnk.net and I was wondering if there was any interest in doing that here. Personally, I think it meshes with the SDF vibe.

Edit: this would be in addition to regular Lemmy

Edit 2: it looks like they added it at old.lemmy.sdf.org. Thank you @[email protected]!

47

But that's Macross!

I joined SDF very recently, and today I took a closer look at its logo. ...That's Macross! Exciting childhood memories come to mind, with engaging background music. Exhilarating!

Is there somewhere I can read about SDF's logo? I checked the FAQ, maybe not thoroughly enough, but didn't find anything.

While refreshing my memories about Macross I read that it was named Super Dimension Fortress – now I see the connection :)

To whoever designed that logo: you're on my "inspiring people" list now. Genius.

13

Lemmy.world (and some others) were hacked - LemmyWorld

lemmy.world Lemmy.world (and some others) were hacked - LemmyWorld

While I was asleep, apparently the site was hacked. Luckily, (big) part of the lemmy.world team is in US, and some early birds in EU also helped mitigate this. As I am told, this was the issue: - There is an vulnerability which was exploited - Several people had their JWT cookies leaked, including a...

There is some information about a vulnerability in the Lemmy frontend.

So I have questions for the SDF mods and admins.

  • Has this affected our instance in any way?
  • Has the fix been applied to our frontend?

Or is our instance like the Elusive Joe, and we're not so big yet that we're worth hacking?

8

Thanks for the update email the other day

No, really! I appreciate both the informative update and the overall tone of writing which reinforces my gratitude for finding and joining this instance.

>If you would like, could you introduce yourself and share your thoughts in regards to the Reddit migration and the Fediverse in the !sdfpubnix ?

Digging into the Fediverse is my attempt at a return to participating in communities rather than just lurking. In the days of IRC and message boards, I was incredibly active and had ops/mod/admin duties on a few sites. I also started a site which became a community of thousands/tens of thousands. And then the toxicity took off, typical threats of doxxing and worse, the burnout came, and Facebook Groups/Reddit started obliterating forums. I withdrew from the chaos and decided to just watch from the sidelines.

The Reddit and Twitter fiascos were my wake up call to stop doom scrolling and find platforms I'd feel comfortable posting on. I'm a Spoonie (long read, but worth it to understand living with chronic health conditions) so I have very limited energy compared to my younger, healthier days online; hence my responding to an email from Tuesday on a Saturday. Supporting malicious platforms is something I don't want to devote any of my precious spoons to. But, I am trying to set aside time, or spoons, to settling in on Lemmy and Mastodon because I want to see the Fediverse succeed.

As for more personal intro info:

I grew up in the days of Atari and Apple, borrowed friends' computers to use BBSes, scrounged used parts from friends to build and upgrade my PCs and have always been tech-adjacent at the very least, but never got the chance to sink my teeth into programming, tech, etc. as deeply as I wanted. Life, amiright?

I'm a technical writer by training and trade (hey, don't judge my casual writing, okay?), a car dork, music fan, am owned by cats, and have more interests than time. Earlier this year, I completed my first-ever-entirely-from-NEW-parts PC, but I'm going back to my roots and scrounging once more to put together a box to run Ubuntu Server and Pi-hole for use here at home.

Oh, and when I saw that the SDF actually stood for the Super Dimension Fortress that always pops into my head when I see those three letters, that pretty well sealed the deal for me to give THIS particular instance a try.

Thanks for making this instance available and for all the hard work that goes into it!

Now to click the Create button for the first time and hope I didn't screw something up...

0
Could my 10 year old SDF account still exist?
  • @murph It was argued that you need to have a ~/.plan file, but I do not have one.

    I do not recall having had to do anything to enable it.

  • Could my 10 year old SDF account still exist?
  • You know what, I just checked, and account expiry is covered in the FAQ.

    It might well be expired.

    I second emailing membership, they might be able to help you. Or if you trust one of us, we might be able to check, as well.

  • Could my 10 year old SDF account still exist?
  • @siipale For current accounts, yes. I can't answer definitively for legacy ones. I've only been on SDF a couple years now.

  • Could my 10 year old SDF account still exist?
  • For finger to work remotely, you have to have set up a .plan file as well as applied correct permissions to it at the time in your home directory.

    I have a .plan file, I get that response from finger when I'm on SDF but it doesn't work when I do the lookup remotely. I don't recall the needed permissions.

    $ finger chance
    
    Login: chance         			Name: Chance Platt
    
    Directory: /sdf/arpa/af/c/chance    	Shell: /usr/pkg/bin/bash
    
    On since Sun Jun  9 09:56 2024 (UTC) on pts/19 from 99.162.15.208
    
    Mail last read Sun Jun  9 09:48 2024 (UTC)
    
    Plan: I'm friendly-like.
    

    Now, since you know your username, there is a password reset mechanism:

    Password Reset at SDF Wiki

  • lemmy.sdf.org certificate expired
  • Seems right to me. I thought maybe it was fixed in the time since the comment but the cert looks like it was issued at the start of the month.

    my view

  • I'm so interested in SDF
  • Here's the bboard tutorial I was completely lost at first too.

  • I'm so interested in SDF
  • @secret300 bboard and com both take some getting used to, but they're both pretty great once you do.

  • SDF federation with lemmy.world is borked
  • Oh, no, not really. It's been stuck like this. The federation with lemmy.world does work, but there's a 2-3 hour delay from lemmy.world to lemmy.sdf.org.

    They might be using IPoAC for last mile ¯⁠\⁠_⁠(⁠ツ⁠)⁠_⁠/⁠¯

  • Certificate of old.lemmy.sdf.org expired
  • email

    Though it does feel much better to ssh onto SDF pubnix server and post to REQUESTS on their bulletin board.

    In fact, it seems someone did just that

    TACKER:  jdl ()
    SUBJECT: cert for old.lemmy.sdf.org has expired
    DATE:    25-Mar-24 12:19:44
    HOST:    faeroes
    
    The certificate for old.lemmy.sdf.org expired on March 24th 2024.
    
    
    
    <REQUESTS.3.0/1>(9)[ <ENTER> follow thread, (R)EPLY, (F)LAG or (Q)UIT ]
    
    ---------------------
    
    TACKER:  membership (SDF Membership)
    SUBJECT: .. cert for old.lemmy.sdf.org has expired
    DATE:    25-Mar-24 16:13:47
    HOST:    mx
    
    mlmym is now upgraded, please clear your cache and reload the page.
    
    
    (it even blinks! What!? Why?)
    
    <REQUESTS.3> Command:
    
  • lemmy.sdf.org expired certificate
  • Yep.

    It's not limited to donations. I've done payments like this on Discogs.com

  • Lemmy through SDF is basically read-only now. Read interesting stuff, but open an account elsewhere if you want to reply.
  • Oh damn, I didn't even notice that.
    It seems the browser cache is saving me for now:

    Edit: Hmmm, interesting. The buttons are there, but they only show up briefly after refreshing.

    Edit 2: The page with icons returns

    HTTP/2 404 
    server: nginx
    date: Sat, 13 Jan 2024 22:31:19 GMT
    content-type: text/html; charset=utf-8
    vary: Accept-Encoding
    x-powered-by: Express
    content-security-policy: default-src 'self'; manifest-src *; connect-src *; img-src * data: blob:; script-src 'self' 'nonce-a11a1859d413a6f8d1a7e96994bb6ccb'; style-src 'self' 'unsafe-inline'; form-action 'self'; base-uri 'self'; frame-src *; media-src * data:
    cache-control: public, max-age=60
    etag: W/"14aa8-/2gJKxI2YSvDtADj1ANGgw9bOSs"
    content-encoding: gzip
    X-Firefox-Spdy: h2  
    

    https://lemmy.sdf.org/static/9aa19d8b/assets/symbols.svg
    for comparison:
    https://lemmy.ml/static/9aa19d8b/assets/symbols.svg

    It isn't empty if you check the page source, there's SVG icons.
    Example:

    
          
        
    
  • Lemmy through SDF is basically read-only now. Read interesting stuff, but open an account elsewhere if you want to reply.
  • Do you know another instance that is admined similarly? I have accounts on a few servers but I think they have all been involved in various defederation drama in the past.

    Edit: I found this, haven't looked it over yet but hoping to find an alternative to put in my stable of lemmy logins

  • SDF federation is on the fritz again (Jan. 5th - Now)
  • In the meantime, since we're all marooned here anyway: how's everyone's weekend been going so far? Any exciting plans?

  • Threads federation?
  • Erin Kissane has an excellent article on why Meta doesn't deserve the benefit of the doubt. Meta/Facebook has had power over social media before and displayed incredible disregard for human life, much less anything else related to healthy communities.

    To treat Threads the same as a brand new instance and federate with it is a mistake.