?

Log in

No account? Create an account

Previous Entry | Next Entry

Is anyone else experiencing a LiveJournal comment-eating (or post-eating) phenomenon?

I've received at least 100 comments in the last week or so, and posted only a few, yet my net difference between comments posted and received seems to be holding steady or increasing only slightly. Sure enough, I check some of last year's posts and certain of them have comments that, when I click on the link, go away entirely.

I'll be putting up before and after screenshots of the above later.

KDD members: If you or your classmates have any experience of this, please let me know.

--
Banazir

Comments

( 18 comments — Leave a comment )
idigital
Sep. 5th, 2004 05:55 am (UTC)
The stats probably aren't being updated. All it'll require is for them to run ljstats.pl to recount comments since date x, and everyone'll be back to normal.

Nothing major to worry about. Just... annoying if you check the counts often.
banazir
Sep. 5th, 2004 08:45 am (UTC)
Mmm(oo). Soul.
The stats probably aren't being updated. All it'll require is for them to run ljstats.pl to recount comments since date x, and everyone'll be back to normal.
Well, gee, get a cron1, folks. :-P
Whatever happened to cfengine

Nothing major to worry about.
Just... annoying if you check the counts often.

Yep, very. I do it about once or twice daily by hand when I can remember to; sometimes I miss a day. I need to get a script to do it (see above).

Also annoying if you want to keep old comments; I have no idea what OS their servers run on and whether they are RAIDed, backed up, etc.

Great icon, BTW.

1 May I say just how impressed I am that that shows up in a Google for "cron Wikipedia" now? The wikipedians are really making inroads into Unix jargon.

--
Banazir
erebrandir
Sep. 5th, 2004 09:33 am (UTC)
Re: Mmm(oo). Soul.
AFAIK, they all run Debian, and are all RAIDed and backed up regularly. I've only seen them entirely lose data once, and I think then it wasn't so much a question of the data actually being lost, but more of it being unfeasible to recover it without screwing up everything else. I'm not a database person, and I don't understand very much of their setup, but they do have a very complex setup, involving many database servers and clusters. What it sounds like to me is happening here, with posts and comments disappearing and reappearing (and this is only an uneducated guess), is a problem with database replication between the various servers. One server might have a full copy, and another might have an incomplete copy. They ought to sync up eventually.

If you make a support request about it, and tell you want technical details about what's going on, there's probably somebody over there who could give them to you. Or, you could e-mail Brad.
banazir
Sep. 12th, 2004 10:38 am (UTC)
LiveJournal and Debian
AFAIK, they all run Debian, and are all RAIDed and backed up regularly.
Somehow, that's a little disillusioning. :-)
I have nothing against Debian, but it's so... mundane.
When I don't know what a blogging service is running, I tend to imagine it running some exotic OS (a custom BSD, or DeloreanOS 2015). Or else a heavily tricked-out and secured Windows Advanced Server 2003.

I've only seen them entirely lose data once, and I think then it wasn't so much a question of the data actually being lost, but more of it being unfeasible to recover it without screwing up everything else.
Ah, yes.

I'm not a database person, and I don't understand very much of their setup, but they do have a very complex setup, involving many database servers and clusters.
:nod: I know a little, and that's just what it is.
You remember their syncing problem, when the comment count would fluctuate, right? This was around the same time that comments would sometimes not go through unless "flushed" by a follow-up post (I wonder what error was responsible for that).

What it sounds like to me is happening here, with posts and comments disappearing and reappearing (and this is only an uneducated guess), is a problem with database replication between the various servers. One server might have a full copy, and another might have an incomplete copy. They ought to sync up eventually.
I considered that, but my comment loss has persisted for 3 weeks now, far too long to be a mere sync issue.

If you make a support request about it, and tell you want technical details about what's going on, there's probably somebody over there who could give them to you.
Yes, thank you. That's what I'm going to do later today or tomorrow.

Or, you could e-mail Brad.
Heh. While I've seen bradfitz be very good about responding to major issues, I'm not sure how widespread my problem is.

Thanks for the advice, though.

--
Banazir
zaimoni
Sep. 5th, 2004 06:37 am (UTC)
This provokes my considering going through my LJ with Adobe Acrobat in web-slurp mode.

What cluster are you on ("Where am I?" link)? Mad Cow was microwaved earlier this year, and some of the corruption is permanent :(
banazir
Sep. 5th, 2004 02:02 pm (UTC)
Web-slurping and Teleport Pro
This provokes my considering going through my LJ with Adobe Acrobat in web-slurp mode.
One more incident such as this, and it's definitely wget or Teleport Pro time.

What cluster are you on ("Where am I?" link)? Mad Cow was microwaved earlier this year, and some of the corruption is permanent :(
Ew.

--
Banazir
zaimoni
Sep. 13th, 2004 08:34 pm (UTC)
Re: Web-slurping and Teleport Pro
zaimoni
Sep. 13th, 2004 09:43 pm (UTC)
Re: Web-slurping and Teleport Pro
Well, they pulled it out — but it evidently took much longer than the initial 15 minutes they estimated.
celandineb
Sep. 5th, 2004 07:42 am (UTC)
I haven't personally (or at least not that I've noticed), but I've heard rumors of it.

Celandine
banazir
Sep. 5th, 2004 01:55 pm (UTC)
Thanks for the lead
Hi, celandineb!

Do you remember where you heard?

--
Banazir
erebrandir
Sep. 5th, 2004 08:38 am (UTC)
There's a Perl script now, hidden in the LJ CVS tree, that will backup an entire journal, comments and all. Actually, I think somebody over in lj_nifty wrote a more user-friendly app that uses the same API. So assuming that all of the comments will stay put long enough to be backed up, you can obtain assurance that you'll never lose anything. If the comments persist in their wonkiness, you ought to report it to support.
banazir
Sep. 5th, 2004 01:59 pm (UTC)
Complete LJ backup: entries and comments
There's a Perl script now, hidden in the LJ CVS tree, that will backup an entire journal, comments and all.
Ooo, that's very good!
Thanks for bringing this to my attention, Joe.
I've still been following your LJ, but how've you been in general aside from quijillions of tons of homework?

Actually, I think somebody over in lj_nifty wrote a more user-friendly app that uses the same API. So assuming that all of the comments will stay put long enough to be backed up, you can obtain assurance that you'll never lose anything.
Thanks. I'll get off my procrastinating duff and have a look later.

If the comments persist in their wonkiness, you ought to report it to support.
Ah, OK.
I've been checking the support issues to make sure no one else has mentioned it. I've seen the effect with comments in my own LJ and with posts in another, and wasn't sure whether they were related.

Thanks again,
Banazir
anglachel1
Sep. 5th, 2004 11:19 am (UTC)
More info on the mysterious disappearing posts
Banazir,

Somone else I know seems to be having comments disappear. A few questions to see if it is the same phenomenon:

1. Is it random? Do you lose entire threads of comments, or one here, one there?
2. Do you lose the original post as well, or just the comments?
3. Have your comments come back on their own? (i.e., a database synching problem)
4. Anything else odd, unusual, noteworthy about the disappearance?

Thanks in advance for your reply!

Toodles - Ang
zaimoni
Sep. 5th, 2004 07:30 pm (UTC)
Re: More info on the mysterious disappearing posts
What's unusual is that there's nothing on either status or lj_maintenance. My LJ friends list is set to watch both of these.
anglachel1
Sep. 5th, 2004 07:38 pm (UTC)
Re: More info on the mysterious disappearing posts
Exactly! I have lj_maintenance on my friends list and have heard nothing, so I was hoping for some more "man-in-the-street" info from Banazir. Sporadic glitches are a real pain in the butt. :-(
banazir
Sep. 6th, 2004 07:55 am (UTC)
Hobbit-in-the-street report
Will reply more later, but no, it doesn't seem to be random. I don't lost the post, but I've seen friends' LJs who do; I just haven't asked to see whether it could be a related software problem. Posts have come back spontaneously in my friends' LJs, but my own comments seem to be decreasing monotonically, to the tune of about 200 of them.

The weirdest things were that one set of 7 (the whole reply thread from a 2003 post I was looking up) disappeared just after I accessed it (I even have a screenshot of the "7 comments" Day View). This implies a software problem rather than malicious activity to me, unless someone is using a really sophisticated attack.

Also, I've seen no "deleted post" comments or anything untoward at all. In fact, the vanishing posts in my own LJ seem to be from long ago. The problem has at least arrested since 2-3 days ago, but it's been going on for 2 weeks now. It stopped for a couple days after I'd lost maybe 100-150 comments. I haven't bothered to check, though zaimoni's spidering idea is sounding good about now.

--
Banazir
banazir
Sep. 9th, 2004 10:05 am (UTC)
Indeed
I'm going to put in a ticket soon.
My posts are still gradually geting lost - to the tune of about 10 every couple of days.

--
Banazir
anglachel1
Sep. 16th, 2004 09:22 pm (UTC)
Re: Indeed
Sorry to hear that! :-(

Ang
( 18 comments — Leave a comment )

Latest Month

December 2008
S M T W T F S
 123456
78910111213
14151617181920
21222324252627
28293031   

KSU Genetic and Evolutionary Computation (GEC) Lab

Teunciness

Breakfast

Science, Technology, Engineering, Math (STEM) Communities

Fresh Pages

Tags

Powered by LiveJournal.com
Designed by Naoto Kishi