LibraryThing systems under stress
This topic was continued by Resolution of "LibraryThing systems under stress".
TalkTalk about LibraryThing
Join LibraryThing to post.
1timspalding
I wanted you to know that since around 2pm Eastern LibraryThing's systems have been under concerted network attack. From around then until just recently, we have been down or very slow.
The attack is known as a DDoS or Distributed Denial of Service. Basically, a lot of computers have been hitting LibraryThing's systems so hard and so rapidly that our infrastructure has been unable to keep up, causing slowness and downtime. Traffic spikes happen, but unlike unintentional or less sophisticated efforts, the attackers control a large number of machines (a "botnet"), so when we block machines (IPs), new machines start doing it. And as we adopt defensive tactics, they change their tactics.
Our systems administrator, another developer and I have spent much of the evening working the problem.
I don't want to spell out what we're doing here, but most (95%?) members should find things in better shape now. Even so, problems remain, and I wouldn't be surprised if we see new and different attacks.
The attack is known as a DDoS or Distributed Denial of Service. Basically, a lot of computers have been hitting LibraryThing's systems so hard and so rapidly that our infrastructure has been unable to keep up, causing slowness and downtime. Traffic spikes happen, but unlike unintentional or less sophisticated efforts, the attackers control a large number of machines (a "botnet"), so when we block machines (IPs), new machines start doing it. And as we adopt defensive tactics, they change their tactics.
Our systems administrator, another developer and I have spent much of the evening working the problem.
I don't want to spell out what we're doing here, but most (95%?) members should find things in better shape now. Even so, problems remain, and I wouldn't be surprised if we see new and different attacks.
4JMK2020
Thanks Tim for the information.
Perhaps in this case a small, very visual banner could be added to the site (like for treasure hunts but more visible with a big wanrning).
Indeed, some do not understand that the site and its collaborators have nothing to do with it** but that there are very malicious people who attack the site. These are the ones who should be expelled forever from the entire internet
Good luck
Wait and see
** of course there are a thousand parades / solutions and tools / soft ... but then it will no longer be free... with all the consequences imaginable
Perhaps in this case a small, very visual banner could be added to the site (like for treasure hunts but more visible with a big wanrning).
Indeed, some do not understand that the site and its collaborators have nothing to do with it** but that there are very malicious people who attack the site. These are the ones who should be expelled forever from the entire internet
Good luck
Wait and see
** of course there are a thousand parades / solutions and tools / soft ... but then it will no longer be free... with all the consequences imaginable
6MarthaJeanne
>4 JMK2020: Even the biggest sites go down with these attacks.
8timspalding
8:20am Eastern: We're ignoring non-member traffic, so we're up for members, down for most others. The site remains slow because of "network contention"—even if we don't waste resources on bad requests, the traffic is still there, clogging things up like a bad traffic jam.
We are working on options.
We are working on options.
9fuzzi
>8 timspalding: thank you.
10lemontwist
>8 timspalding: I'm glad it's getting better. Sorry you have to deal with this on a holiday. :-(
11libraryperilous
>1 timspalding:, >8 timspalding: I'm sorry LT was hit with this, and thank you for keeping us in the loop. Thanks to you and the staff who are working on this!
12libraryperilous
duplicate post
13susanbooks
Argh! How dare they hit one of the nicest places online! Thank you, Tim & co, for all the hard work.
142wonderY
Are there activities we should refrain from doing just now? I’m not able to upload author pictures for example.
15timspalding
>14 2wonderY:
No. Go ahead. It's all "network contention," happening outside of the systems that do the interesting stuff.
No. Go ahead. It's all "network contention," happening outside of the systems that do the interesting stuff.
16timspalding
Update: 9:30am Eastern: They've stopped for now. They will probably start again.
17MarthaJeanne
There seems to be an image problem, whether related to this or a repeat of a few weeks ago. See https://www.librarything.com/topic/352818
19Karlstar
>16 timspalding: Thanks for all the hard work! Hopefully they won't resume the attack.
20Carmen.et.Error
>1 timspalding: Thanks for letting us know and for everything the team is doing.
21timspalding
Update: Attack not resumed, but our defenses are still up and have costs. Notable, many images are slow for complicated reasons involving our content-delivery networking being blocked by us. We hope to fix this in the coming hours.
22m.belljackson
Why would LT be targeted?
23timspalding
>22 m.belljackson:
We received what amounts to an extortion note—pay or we'll keep doing this. We aren't going to pay. We're not rich, and we're principled. Paying would just encourage more, and fund attacks against other people. So they're wasting their time. Also, while hitting us on Labor Day weekend is bad, we're not helpless; we have smart systems and developer people. We have things we are doing, and more we can do if it persists. They may have realized all this and stopped, or it might just be a paused before another attack.
We received what amounts to an extortion note—pay or we'll keep doing this. We aren't going to pay. We're not rich, and we're principled. Paying would just encourage more, and fund attacks against other people. So they're wasting their time. Also, while hitting us on Labor Day weekend is bad, we're not helpless; we have smart systems and developer people. We have things we are doing, and more we can do if it persists. They may have realized all this and stopped, or it might just be a paused before another attack.
24paradoxosalpha
What are the prospects of law enforcement in this sort of situation?
26rgurskey
>23 timspalding: Good for you.
27gwernin
>23 timspalding: Thanks for the updates! You guys are great.
29LadyoftheLodge
Thanks, Tim and all for your hard work on this problem. My husband (retired law enforcement) says most law enforcement has a department dedicated to cybercrime.
The app is not working for me at all.
The app is not working for me at all.
30BooRadleyZellner
How awful! People can be so malicious! Thanks for all you do, Tim! Hang in there! Hopefully, the perpetrators will be caught and prosecuted!
Please don't lose faith! You provide such an awesome service!
Please don't lose faith! You provide such an awesome service!
31susanbooks
Thank you for all your work & your principled stand, >23 timspalding:
33vancouverdeb
Thanks for the updates, Tim . And thanks to you and all the staff for what you do .
34pejorgkajor
Thanks for the updates!
36bnielsen
Damnit. When I read:
>1 timspalding: ... since around 2pm Eastern LibraryThing's systems have been under concerted network attack
my mind was expecting the next words to be something like:
Since 5:45 a.m. we have been returning the fire, and from now on bombs will be met by bombs.
:-)
>1 timspalding: ... since around 2pm Eastern LibraryThing's systems have been under concerted network attack
my mind was expecting the next words to be something like:
Since 5:45 a.m. we have been returning the fire, and from now on bombs will be met by bombs.
:-)
37reconditereader
Thanks for telling us! This is just a standard thing that happens on the internet sometimes, and it sucks. The LT team is great! I hope you get some time off later.
38timspalding
Update 2pm Eastern. Anyone having problems still? Vote, but reply only if you are. (Don't report anything before 2pm.)
Vote: Anyone still having problems?
Current tally: Yes 15, No 53
40ReshelvingAlexandria
>38 timspalding: just image related issues, and I can be patient.
41ReshelvingAlexandria
>36 bnielsen: That would be awesome. :)
42timspalding
Update 3:19. Yeah, they came back. Mother$!@#.
43Taliesien
at 2:44 pm I tried accessing the site...404 errors galore and then ERR_CONNECTION_REFUSED. If this post goes through it will be a miracle.
44dianeham
>42 timspalding: I’m so sorry you have to deal with this. I was the sys admin at my library years ago and we were hit with DoS and also hacked by Chinese hackers. Just a little library at the seashore.
45CILMAR
Wow - I was wondering why it was down and for so long. This is very upsetting and I am glad you guys are not giving in to the demands.
46Deil
Thanks for what you're doing, Tim.
They should move onto other targets eventually, even their botnets are not endless anyway.
They should move onto other targets eventually, even their botnets are not endless anyway.
47Edward
>38 timspalding: The site is mostly fine for me, but I can't add a book by manual entry: after I select Save, it pauses for a while and then I see a 405 error.
48majkia
>28 timspalding: I can't get to litsy website at all. the app works every once in awhile.
49richardderus
As frustrating as it might feel for me not to be able to use my key to get in my kitchen door, I will happily accept that because you're correct in your assessment of the character of such beings. Fight 'em for all of us, the recurring issue with CONNECTION REFUSED messages twice in the past hour is minor in comparison.
50kjuliff
>1 timspalding: as a retired software engineer I know the dos problem. You are obviously doing a great job. I am sure everyone appreciates your efforts.
52timspalding
Update: Okay, if you're getting the website, the images should now be working.
532wonderY
Still intermittent connection problems in this hour. I’m finding just how little I care for other parts of the internet. I am getting more book reading done though.
54damnnicks
Adding new books (manually) times out (well, 405s), sometimes with a book fragment being incompletely added: https://www.librarything.com/work/30888932/book/248380253
55timspalding
Hmm. There seems to be something special about manual adding. I'll look.
56Peace2
Just wanted to convey my thanks along with those above to timspalding and team for all the hard work and dedication. It's a frustrating inconvenience to those of us who want to use the site as intended and enjoyed by so many, but for you all it's a huge amount of effort and strife to keep this as the place we love when the ill-intentioned folks behind attacks such as this aim their attention this way. Thank you for your work and for not giving into their demands.
57timspalding
>54 damnnicks:
Thanks for this. We figure it out. The measures we're using to block external IPs caught some of our internal ones, and they were used in manual adding. This should be fixed.
Thanks for this. We figure it out. The measures we're using to block external IPs caught some of our internal ones, and they were used in manual adding. This should be fixed.
59Jarandel
I have this one showing as recently added to my catalogue on my homepage. But it has zero owners and just displays an error when I try to load the work page so I can't delete it.
https://www.librarything.com/work/30885667/book/248354390
https://www.librarything.com/work/30885667/book/248354390
60Carmen.et.Error
>59 Jarandel: Same thing's happening to me.
61CurrerBell
Real dumb question, Tim, and I assume with a "mere" DDoS attack the answer is "NO" -- but.... is there any danger that user cataloging data has been compromised? Again, my assumption is that the DDoS has merely impaired network access and that there's no compromise of user data.
63timspalding
>59 Jarandel: >60 Carmen.et.Error:
Is it possible you added it manually?
>61 CurrerBell:
If you're referring to the problem in 59 and 60, I think I know what happened. Indeed, I think it would happen for any absolutely new work or edition. Basically, the add-books process for a new book involves LibraryThing hitting LibraryThing as a service. This wasn't something we realized could a problem, but after a few mentions, it dawned on me that it might be. During much of the day, LT hitting LT would have been impossible. It is possible now. I'll be looking into what to do with cases like that, but it's not my priority, as people can just delete and re-add, and there's a lot going on.
More generally, no, not only is there zero evidence of anything like that, there's good evidence of what is going on, and what they're trying to do. They are DDoSing us. It's a standard attack, and simple and easy, if you have a bot net. And it's hard to guard against. They aren't sophisticated. They're not logging in, or even looking around. For example, the DDoS isn't even doing any sort of intelligent scrape—it's just hitting a small number of pages over and over. Because for a DDoS it doesn't matter what you hit—you just hit.
Additional note: Elsewhere someone suggested Cloudfront. We are, of course, looking into that.
Is it possible you added it manually?
>61 CurrerBell:
If you're referring to the problem in 59 and 60, I think I know what happened. Indeed, I think it would happen for any absolutely new work or edition. Basically, the add-books process for a new book involves LibraryThing hitting LibraryThing as a service. This wasn't something we realized could a problem, but after a few mentions, it dawned on me that it might be. During much of the day, LT hitting LT would have been impossible. It is possible now. I'll be looking into what to do with cases like that, but it's not my priority, as people can just delete and re-add, and there's a lot going on.
More generally, no, not only is there zero evidence of anything like that, there's good evidence of what is going on, and what they're trying to do. They are DDoSing us. It's a standard attack, and simple and easy, if you have a bot net. And it's hard to guard against. They aren't sophisticated. They're not logging in, or even looking around. For example, the DDoS isn't even doing any sort of intelligent scrape—it's just hitting a small number of pages over and over. Because for a DDoS it doesn't matter what you hit—you just hit.
Additional note: Elsewhere someone suggested Cloudfront. We are, of course, looking into that.
64clamairy
Sorry you're(we're) going through this, and thank you for manning the forts on a holiday weekend.
65Carmen.et.Error
>63 timspalding: It wasn't a manual add for me. However, it DID show up after I tried to add a book normally and got an error. It shows up under "Recently Added" on my homepage but not in my Library. It acts exactly like Jarandel's.
Here's the link: https://www.librarything.com/work/30886788/book/248362179
Here's the link: https://www.librarything.com/work/30886788/book/248362179
66cindydavid4
dont these people have anything better to do with their lives? thank you for standing on principle and thank you for your hard work in getting us up and running. I did wonder after I heard the orginal post on FB, If we are adding to problems by continuing to see if you are up. Let us know pls. And bless you for all you do for us
67ReshelvingAlexandria
Thank you for everything you're doing!
68timspalding
Update: We're totally open right now. They haven't started up again, but I expect they will, so I'm likely to restrict access somewhat overnight while I'm asleep.
Tomorrow we'll have the whole dev staff, and more systems administration help.
Tomorrow we'll have the whole dev staff, and more systems administration help.
70kgodey
Tim, I'm sorry to hear about the DDoS attack (on a holiday, too!) If there's anything useful that outside devs like myself can do to help, let us know.
My only suggestion is an external DDoS mitigation service like Cloudflare, but I'm sure you're already looking into that.
My only suggestion is an external DDoS mitigation service like Cloudflare, but I'm sure you're already looking into that.
72Jarandel
>63 timspalding: Yeah, might have attempted to add a book manually during that time.
73Edward
>57 timspalding: Thanks to you and the LT team for all your work! Manual entry worked correctly for me just now.
74haydninvienna
Tim: Thanks for everything. Don't give in to those bastards — we can wait if we have to.
75karenmarie
Thanks to you and the team for your hard work over what should have been a nice holiday weekend.
I'm glad you're not giving into them.
I'm glad you're not giving into them.
76JHemlock
I want to thank the LT team for all they do. I have not had any problems with the site. It is quite evident how much time and effort go into keeping the ship afloat. It is all appreciated to no end.
77timspalding
Update: We are open now and have been for various periods in the last day. The attack isn't happening right now. It may or may not come back. If it does, we'll become partially accessible, partially inaccessible again.
79cvioleta
Thank you thank you to all the staff for their hard work on getting the site back up and running. Sending a curse to the hackers, may their socks slip into their shoes for the rest of their days, and may karmic justice take place sooner rather than later.
80Storeetllr
Thanks for the updates and for all the hard work you all have been doing to get the site back up and to keep it up.
82laytonwoman3rd
Keeping the ommmm machine crankin'...
83timspalding
We're still in the soup. But we're going to go half-up while we try to resolve this on a deeper level.
84gwernin
>83 timspalding: blessings on your fight
85Taphophile13
First time today I have been able to connect. I've missed you LT; feel better soon. Thanks for all the behind the scenes work everyone is doing.
86timspalding
Just now I was able to change a major thing that will help us. I think it won't be implemented until tomorrow. And we may need to shut things off later tonight. But it's light at the end of the tunnel.
87CurrerBell
Tim, are we able to export our catalogs? Or is that one of the items that you've had to disable for the time being? I do a backup every now and then; but after this, I'm concerned that I'm going to have to do a backup every time I do any cataloging update. It looks like the Export screen is just hanging, both on Excel and on tab-delimited text.
89RidgewayGirl
Thanks to all of you for working so hard to get things working, and Tim, thanks for the updates. While I wasn't able to add a book tonight (tried adding an ER book (isbn: 9781636141343) but kept getting a field with only the word "dog" in the upper left hand corner, it was wonderful to connect with people in Talk again.
90Stevil2001
Maybe LT is a They Might Be Giants fan: https://youtu.be/yc83_gL-LU4?si=szaRM2gFex2ANVW-&t=69
91timspalding
I think we'll be up for the night just fine. And may not go down again.
92vancouverdeb
>91 timspalding: Great News Tim! Fingers crossed.
93lindapanzo
Thanks for the updates and for all the hard work involved in getting things safe.
Currently, my only LT problem is that I can't add a book I finished yesterday. When I click on the book to add it, it just says dog in a large white box.
>89 RidgewayGirl: That's exactly what I'm getting.
Currently, my only LT problem is that I can't add a book I finished yesterday. When I click on the book to add it, it just says dog in a large white box.
>89 RidgewayGirl: That's exactly what I'm getting.
94tardis
>93 lindapanzo: Yeah, I'm having the same problem with Add books.
96timspalding
Fixed. Thanks. Sorry about that.
97lindapanzo
>96 timspalding: Thanks, Tim!!
98JudithElaine
I was not able to get in using Firefox, but I did get in using Edge
100vancouverdeb
I can’t get onto the site using my desktop computer with Firefox just now , but I can get using my IPhone 14 safari browser. Using my desktop computer I get an host error message and I can see you are now using cloud flare .
101vancouverdeb
Okay, just got in using my desk top and google chrome. All Good.
102Maddz
I too am getting 522 errors when I try and log in using my desktop machine, but logging in fine on the iPad. Both use Chrome.
104ColinMcLean
What a drag; thank you for dealing with it
105connie53
Thanks for keeping us updated, Tim & co.
Today it's working for me again. I sometimes need to refresh but I can work with that for now.
Today it's working for me again. I sometimes need to refresh but I can work with that for now.
108AntonioGallo
Thank you all for your hard work. I cannot live on without LT.
109Halamish21
Be strong and don't give up! We're all with you on this!
111bnielsen
>110 thefringthing: I thought the dog bug had fled? You still seeing it?
117Taliesien
Some thumbnails on my home page of recently added books are broken with the following errors:
7616fe8726e0867597641323541414141473441_v5.jpg:1 Failed to load resource: net::ERR_SSL_VERSION_OR_CIPHER_MISMATCH
But I believe they will resolve within 24 hours or less, depending on when you activated. I also got stuck in the "checking site connection" infinite loop on Chrome & Brave and had to tweak some of my browser settings to get through. There will be some bumps in the road as some clients have to adapt to the site on Cloudflare but I think in the end it will be a huge net positive. Hope you didn't have to break your piggy bank to afford it. :D
7616fe8726e0867597641323541414141473441_v5.jpg:1 Failed to load resource: net::ERR_SSL_VERSION_OR_CIPHER_MISMATCH
But I believe they will resolve within 24 hours or less, depending on when you activated. I also got stuck in the "checking site connection" infinite loop on Chrome & Brave and had to tweak some of my browser settings to get through. There will be some bumps in the road as some clients have to adapt to the site on Cloudflare but I think in the end it will be a huge net positive. Hope you didn't have to break your piggy bank to afford it. :D
119timspalding
>117 Taliesien:
Thanks. We're working on that one. There are several problems along these lines.
General update: LibraryThing is up because we put the service "behind" Cloudflare, a much-used service built for just these situations. Basically, when we're under attack Cloudflare screens our traffic and throws out the bad stuff. For various reasons this took longer to implement than we wanted, but it's up now. We'll write about it more soon.
Note that the "interstitial" with the Cloudflare logo is a temporary measure, for when we're under attack. It won't be used often.
Thanks. We're working on that one. There are several problems along these lines.
General update: LibraryThing is up because we put the service "behind" Cloudflare, a much-used service built for just these situations. Basically, when we're under attack Cloudflare screens our traffic and throws out the bad stuff. For various reasons this took longer to implement than we wanted, but it's up now. We'll write about it more soon.
Note that the "interstitial" with the Cloudflare logo is a temporary measure, for when we're under attack. It won't be used often.
121Dotheren
Just want to add "thanks for good work" to you. I knew such events are hard.
Also thx for updates you did/will do :)
Also thx for updates you did/will do :)
122timspalding
>120 2wonderY: Sorry.
123XavierBerry
This user has been removed as spam.
124anglemark
>106 MrAndrew: All pages? I just print the ones translated into Nepalese. If LT goes away, I finally have a reason to learn Nepalese.
125Musereader
I was very worried over the weekend when I couldn't add my new books, I didn't know what was going on and was afraid the site was lost forever, totally in a panic, so I am so happy you came through the fire and so much disbelief that they would attack a site like this, why on earth do they think this is going to get them money? (rhetorical, I know because some people do pay but just gaahh)
Thankyou tim and the team for the hard work to protect this and us.
Thankyou tim and the team for the hard work to protect this and us.
126andyl
>119 timspalding:
Yeah I saw Cloudflare asking if I was human. However I was still getting a 'Too many redirects' error but that seems to have been cured now.
Although I do write web apps I haven't had to deal with a DDOS attack quite like this (I guess my stuff not really being public sites help). I feel your pain but I guess it won't go on much longer. I guess Cloudflare have a lot more knowledge about what is a bot and automatically rewriting rules to knock them on the head for good (so they shouldn't hit the LT servers at all) than either you or I.
I hope you (and the rest of the staff) will soon be able to relax with a glass of (insert favourite beverage here) and a good book.
Yeah I saw Cloudflare asking if I was human. However I was still getting a 'Too many redirects' error but that seems to have been cured now.
Although I do write web apps I haven't had to deal with a DDOS attack quite like this (I guess my stuff not really being public sites help). I feel your pain but I guess it won't go on much longer. I guess Cloudflare have a lot more knowledge about what is a bot and automatically rewriting rules to knock them on the head for good (so they shouldn't hit the LT servers at all) than either you or I.
I hope you (and the rest of the staff) will soon be able to relax with a glass of (insert favourite beverage here) and a good book.
127LucindaLibri
Finally got in . . . after several times over the past few hours of cloudflare showing "too many redirects" error and stopping.
This time it showed that error but then went to the log in page.
Just reporting. Not complaining. Keep up the excellent work.
(But I hope you all are finding ways of sleeping in shifts or something to keep from dropping from exhaustion.)
Sending love and prayers to the LT staff . . . and curses to the piss ant scum of the universe who do things like attack websites.
This time it showed that error but then went to the log in page.
Just reporting. Not complaining. Keep up the excellent work.
(But I hope you all are finding ways of sleeping in shifts or something to keep from dropping from exhaustion.)
Sending love and prayers to the LT staff . . . and curses to the piss ant scum of the universe who do things like attack websites.
128gwernin
>119 timspalding: I couldn't get in most of yesterday; on my desktop Cloudflare got to step three and timed out, which was interesting but frustrating. Glad to see things are back to normal (if only in the Dr Who sense)! Thanks for all your hard work, all of you!!!
129lilithcat
Could not get in at all last night. Cloudflare kept timing out.
So it's nice to be back!
Please stick around. ;-))
So it's nice to be back!
Please stick around. ;-))
130PawsforThought
I also got cloudflare, and after I clicked the box I got a message saying the session had expired. A couple of hours later it worked fine.
131Maddz
I'm back in now after the Cloudflare 522 errors I was getting yesterday evening and this morning.
Thanks for all your hard work! Hopefully we've seen the last of the miscreants.
It really puzzles me why some people are willing to put 40 hours work in for a potential $20,000 return vs 20 hours work for a guaranteed $40,000 return (somebody on another forum describing a relative who does just that).
Thanks for all your hard work! Hopefully we've seen the last of the miscreants.
It really puzzles me why some people are willing to put 40 hours work in for a potential $20,000 return vs 20 hours work for a guaranteed $40,000 return (somebody on another forum describing a relative who does just that).
133ckdstrider
Happy to be back. Thank you.
134cindydavid4
tom, thanks so much for the work your team has done to stop these slimeball from ruining our fun here. Dont know anything about cloudflare, but happy to see it up and running
135Piedmont_Trails
One thing is for certain. We will not forget this LT Birthday any time soon. But that's a good thing. Because, we all pulled together, helped one another, and encouraged everyone. That's the beauty between good versus bad. I don't know about everyone else, but I quickly realized that LT represents much more than books. We are a library family and I think above everything else, that's what we'll remember from all of this. We'll never forget how the LT team put us back together and triumphed over evil.
Happy 2023 Birthday LibraryThing!
Happy 2023 Birthday LibraryThing!
136Frankel_Library
"The libraries of America are and must ever remain the home of free and inquiring minds. To them, our citizens - of all ages and races, of all creeds and persuasions - must be able to turn with clear confidence that there they can freely seek the whole truth, unvarnished by fashion and uncompromised by expediency." - Dwight D. Eisenhower
"I have an unshaken conviction that democracy can never be undermined if we maintain our library resources and a national intelligence capable of utilizing them." - Franklin D. Roosevelt, in a letter to publisher Herbert Putnam
“Libraries were full of ideas—perhaps the most dangerous and powerful of all weapons.” ― Sarah J. Maas, Throne of Glass
If your library is not “unsafe,” it probably isn’t doing its job.” ― John Berry
“You want weapons? We’re in a library! Books! Best weapons in the world! This room’s the greatest arsenal we could have. Arm yourself!”
― The Doctor David Tennant
“When the going gets tough, the tough get a librarian.” ― Joan Bauer
Dear Tim and LibraryThing Team,
Make no mistake you are all on the front line of a war. This is perhaps the most important of all wars ever fought. Here and now is a battle for to access the most precious and the most dangerous of all elements, knowledge. There are elements in our world that fear it and your servers stand in their way to destroy it, to control or to distort it. Fact and truth to disinformation and outright lies.
The fact that these antidemocratic minority elements of tyranny have chosen to battle LibraryThing is evident of your role as a vanguard to free thought. and are viewed as a great threat to these thought despots.
“Men fear thought as they fear nothing else on earth -- more than ruin,
more even than death. Thought is subversive and revolutionary,
destructive and terrible, thought is merciless to privilege, established
institutions, and comfortable habits; thought is anarchic and lawless,
indifferent to authority, careless of the well-tried wisdom of the ages.
Thought looks into the pit of hell and is not afraid ... Thought is great
and swift and free, the light of the world, and the chief glory of man.” ―
Bertrand Russell, Why Men Fight
Fight on! Tim and team.
Tim Frankel Re-Joined (second time) on Sep 7, 2012.
==============================================
"Whereas it is essential, if man is not to be compelled to have recourse, as a last resort, to rebellion against tyranny and oppression, that human rights should be protected by the rule of law, ..." Universal Declaration of Human Rights = Preamble
Everyone has the right to freedom of opinion and expression; this right includes freedom to hold opinions without interference and to seek, receive and impart information and ideas through any media and regardless of frontiers. Universal Declaration of Human Rights - Article 19
References:
Malicious attack on Wikipedia—What we know, and what we’re doing
https://wikimediafoundation.org/news/2019/09/07/malicious-attack-on-wikipedia-wh...
Wikimedia says it ‘will not back down’ after Russia threatens By Adi Robertson, The Verge, Mar 3, 2022 https://www.theverge.com/2022/3/3/22960007/russia-wikipedia-wikimedia-foundation...
Ransomware Attacks at Libraries: How They Happen, What to Do
https://publiclibrariesonline.org/tag/it-security-threats/
The Fight Continues
Posted on March 25, 2023 by Chris Freeland
https://blog.archive.org/2023/03/25/the-fight-continues/
Volunteers Rally to Archive Ukrainian Web Sites
Posted on March 22, 2022 by Caralee Adams
https://blog.archive.org/2022/03/22/volunteers-rally-to-archive-ukrainian-web-si...
Russia won’t go Wayback, blocks the Internet Archive By Gabe Carey, Digital Trends Media Group June 26, 2015 https://www.digitaltrends.com/web/russia-censors-wayback-machines-485-billion-ar...
Lukas Kawerau, Nils B. Weidmann & Alberto Dainotti (2023) Attack or Block? Repertoires of Digital Censorship in Autocracies, Journal of Information Technology & Politics, 20:1, 60-73, DOI: 10.1080/19331681.2022.2037118
CCS '20: Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security October 2020Pages 49–66https://doi.org/10.1145/3372297.3417883
Censored Planet: An Internet-wide, Longitudinal Censorship Observatory | Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security
Copy of CCS2020_fpc387_Ram Sundara Raman - Andrew Diehl.mov
"I have an unshaken conviction that democracy can never be undermined if we maintain our library resources and a national intelligence capable of utilizing them." - Franklin D. Roosevelt, in a letter to publisher Herbert Putnam
“Libraries were full of ideas—perhaps the most dangerous and powerful of all weapons.” ― Sarah J. Maas, Throne of Glass
If your library is not “unsafe,” it probably isn’t doing its job.” ― John Berry
“You want weapons? We’re in a library! Books! Best weapons in the world! This room’s the greatest arsenal we could have. Arm yourself!”
― The Doctor David Tennant
“When the going gets tough, the tough get a librarian.” ― Joan Bauer
Dear Tim and LibraryThing Team,
Make no mistake you are all on the front line of a war. This is perhaps the most important of all wars ever fought. Here and now is a battle for to access the most precious and the most dangerous of all elements, knowledge. There are elements in our world that fear it and your servers stand in their way to destroy it, to control or to distort it. Fact and truth to disinformation and outright lies.
The fact that these antidemocratic minority elements of tyranny have chosen to battle LibraryThing is evident of your role as a vanguard to free thought. and are viewed as a great threat to these thought despots.
“Men fear thought as they fear nothing else on earth -- more than ruin,
more even than death. Thought is subversive and revolutionary,
destructive and terrible, thought is merciless to privilege, established
institutions, and comfortable habits; thought is anarchic and lawless,
indifferent to authority, careless of the well-tried wisdom of the ages.
Thought looks into the pit of hell and is not afraid ... Thought is great
and swift and free, the light of the world, and the chief glory of man.” ―
Bertrand Russell, Why Men Fight
Fight on! Tim and team.
Tim Frankel Re-Joined (second time) on Sep 7, 2012.
==============================================
"Whereas it is essential, if man is not to be compelled to have recourse, as a last resort, to rebellion against tyranny and oppression, that human rights should be protected by the rule of law, ..." Universal Declaration of Human Rights = Preamble
Everyone has the right to freedom of opinion and expression; this right includes freedom to hold opinions without interference and to seek, receive and impart information and ideas through any media and regardless of frontiers. Universal Declaration of Human Rights - Article 19
References:
Malicious attack on Wikipedia—What we know, and what we’re doing
https://wikimediafoundation.org/news/2019/09/07/malicious-attack-on-wikipedia-wh...
Wikimedia says it ‘will not back down’ after Russia threatens By Adi Robertson, The Verge, Mar 3, 2022 https://www.theverge.com/2022/3/3/22960007/russia-wikipedia-wikimedia-foundation...
Ransomware Attacks at Libraries: How They Happen, What to Do
https://publiclibrariesonline.org/tag/it-security-threats/
The Fight Continues
Posted on March 25, 2023 by Chris Freeland
https://blog.archive.org/2023/03/25/the-fight-continues/
Volunteers Rally to Archive Ukrainian Web Sites
Posted on March 22, 2022 by Caralee Adams
https://blog.archive.org/2022/03/22/volunteers-rally-to-archive-ukrainian-web-si...
Russia won’t go Wayback, blocks the Internet Archive By Gabe Carey, Digital Trends Media Group June 26, 2015 https://www.digitaltrends.com/web/russia-censors-wayback-machines-485-billion-ar...
Lukas Kawerau, Nils B. Weidmann & Alberto Dainotti (2023) Attack or Block? Repertoires of Digital Censorship in Autocracies, Journal of Information Technology & Politics, 20:1, 60-73, DOI: 10.1080/19331681.2022.2037118
CCS '20: Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security October 2020Pages 49–66https://doi.org/10.1145/3372297.3417883
Censored Planet: An Internet-wide, Longitudinal Censorship Observatory | Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security
Copy of CCS2020_fpc387_Ram Sundara Raman - Andrew Diehl.mov
137paradoxosalpha
I'd like to offer a little note of relief that the perps in this case seem to be garden-variety Russian cybercriminals rather than US-American anti-library ideological actors. (Although it's not impossible to imagine the latter acting by means of the former.)
138lindapanzo
>137 paradoxosalpha: I was thinking the same. The library in the neighboring town in suburban Chicago has received bomb and other threats and has had to close 3 times in the past 2 or 3 weeks. I know how horrified we all are about that. There’s been a rash of such threats all around the area.
139bnielsen
>125 Musereader: "I am so happy you came through the fire and so much disbelief that they would attack a site like this, why on earth do they think this is going to get them money?"
Maybe they want books rather than money? If so, I'd be glad to throw the book at them.
Maybe they want books rather than money? If so, I'd be glad to throw the book at them.
140cindydavid4
>136 Frankel_Library: bravo! well said
and on that note Yesterday I was at our used book store where they were having a banned 'save this book' sale. Banned books are wrapped, with the reasons for the ban written on the front. The one that caught my eye? "Promoting disobedience, violence,cannibalism (?!), satanism, suicide and supernatural themes. Describes death" The book was one I frequently read to my students the light in the attic which means Im probably going to hell. I am now going through it to find the poem about cannabilsm. No this is not funny but sometimes you gotta just laugh while we fight
and on that note Yesterday I was at our used book store where they were having a banned 'save this book' sale. Banned books are wrapped, with the reasons for the ban written on the front. The one that caught my eye? "Promoting disobedience, violence,cannibalism (?!), satanism, suicide and supernatural themes. Describes death" The book was one I frequently read to my students the light in the attic which means Im probably going to hell. I am now going through it to find the poem about cannabilsm. No this is not funny but sometimes you gotta just laugh while we fight
141gilroy
>140 cindydavid4: I was expecting you to say Lord of the Flies myself.
142RobertDay
Just to say many thanks for all your efforts on this.
Here in the UK, I had been unable to access the site since the attack started until today, but all I was seeing was it timing out, and as my ISP is being a bit flaky at the moment anyway, I blamed them. It was only when I saw your Facebook announcement that I realised what was happening. Moral: always have a secondary line of communication!
Here in the UK, I had been unable to access the site since the attack started until today, but all I was seeing was it timing out, and as my ISP is being a bit flaky at the moment anyway, I blamed them. It was only when I saw your Facebook announcement that I realised what was happening. Moral: always have a secondary line of communication!
1432wonderY
>122 timspalding: No problem. I was adding data to site performance.
For me, it was enlightening that this is the one of two sites where I spend my time. The other is Instagram, and I was grateful that LT posted there a few times notifying of the issues.
Y’all might want to follow them there:
https://instagram.com/librarythingofficial?igshid=MWZjMTM2ODFkZg==
For me, it was enlightening that this is the one of two sites where I spend my time. The other is Instagram, and I was grateful that LT posted there a few times notifying of the issues.
Y’all might want to follow them there:
https://instagram.com/librarythingofficial?igshid=MWZjMTM2ODFkZg==
144cindydavid4
>141 gilroy: Found it "ladies first"
pamela purse screamed Ladies First
when we went off on our jungle trip
pamala purse said her thirst was worse
and guzzled our water every sip
and when we got grabbed by that wild savage band
who tied us together and made us all stand
in a long line in front of the king of the land
a cannibal known as Fry Em Up Dan
who sat on his throne ina bib so grand
with a lick on his lips and a fork in his hand
as he tried to decide whod be first in the pan
from the back of the line, in that shrill voice of hers
pamela purse yelled "ladies first!"
pamela purse screamed Ladies First
when we went off on our jungle trip
pamala purse said her thirst was worse
and guzzled our water every sip
and when we got grabbed by that wild savage band
who tied us together and made us all stand
in a long line in front of the king of the land
a cannibal known as Fry Em Up Dan
who sat on his throne ina bib so grand
with a lick on his lips and a fork in his hand
as he tried to decide whod be first in the pan
from the back of the line, in that shrill voice of hers
pamela purse yelled "ladies first!"
145paradoxosalpha
See, now that's Art.
146perennialreader
>143 2wonderY: Thanks! I didn't know they had Instagram (should have figured it) :)
147clamairy
Thank for all of your hard work and lost sleep, and also for keeping us updated on Facebook, Instagram, Threads and Twitter X. (Some of us were obsessively checking for news.)
148texntim
Thank you for this wonderful site which connects us not only with literature, but with other people! I realized during the time it was not available to us how unique a space this is, and how so many of benefit from this unique nexus of interests.
Your hard work is deeply appreciated.
Your hard work is deeply appreciated.
149ZELIEHISTORY
Thanks for your responsiveness, ongoing communication, and for everyone's hard work - on Labor Day weekend no less! Your efforts are appreciated.
150ArlieS
Thanks for all your work coping with these cybercriminals. I'm very glad you didn't try to pay them off; as well as encouraging them to go after others, that might well cause them to re-attack LibraryThing again and again, with ever escalating demands. ("If you once pay Danegeld, you never get rid of the Dane.")
I now almost regret that I'm not on either FaceBook or Instagram, so had no independent way of learning what was happening. Fortunately I was able to get through once or twice and see the message on the LibraryThing home page.
I don't suppose you'd consider a presence on Dreamwidth, which is the only social media site I use other than LibraryThing itself? No, I'm not serious - there are limits to how many sites you can reasonably be expected to update.
But if your status were available somewhere that offers an RSS feed - and isn't likely to be DDOSd at the same time as LibraryThing - Dreamwidth users and many others would have another way to learn about issues like this.
I now almost regret that I'm not on either FaceBook or Instagram, so had no independent way of learning what was happening. Fortunately I was able to get through once or twice and see the message on the LibraryThing home page.
I don't suppose you'd consider a presence on Dreamwidth, which is the only social media site I use other than LibraryThing itself? No, I'm not serious - there are limits to how many sites you can reasonably be expected to update.
But if your status were available somewhere that offers an RSS feed - and isn't likely to be DDOSd at the same time as LibraryThing - Dreamwidth users and many others would have another way to learn about issues like this.
151lilithcat
>150 ArlieS:
I now almost regret that I'm not on either FaceBook or Instagram,
I discovered that LT's Facebook page is public, so even if you don't have an account there, you can see the posts. https://www.facebook.com/librarything/
I now almost regret that I'm not on either FaceBook or Instagram,
I discovered that LT's Facebook page is public, so even if you don't have an account there, you can see the posts. https://www.facebook.com/librarything/
152eclbates
Thanks for all the hard work, everyone! I shall order some LT merch to celebrate the birthday and honor your valor. :)
153Taphophile13
Tim and co. are our champions. You went above and beyond and on a holiday no less.
As MarthaJeanne said on another thread, I was having withdrawal symptoms. Glad you're back!
As MarthaJeanne said on another thread, I was having withdrawal symptoms. Glad you're back!
155John5918
>151 lilithcat:
Thanks. Like >150 ArlieS: I'm not on any of those social media thingies, so it's good to know that there is an avenue for checking. Mind you, when I couldn't get on to LT after several tries over a few hours I just googled "Is Librarything down?" and got two or three links to sites which told me that it was.
Thanks. Like >150 ArlieS: I'm not on any of those social media thingies, so it's good to know that there is an avenue for checking. Mind you, when I couldn't get on to LT after several tries over a few hours I just googled "Is Librarything down?" and got two or three links to sites which told me that it was.
156DalkeithLibrary
>23 timspalding: Sorry that all of this happened and that you had to spend your Labor Day weekend working on this. Congratulations on your principled stance. And thanks for all of your hard work. I have found LibraryThing is working well today -- a bit slow but not intolerable.
157LadyoftheLodge
Tim and all, Thank you so much for caring enough to fight this fight for us. I missed my LT friends so much and realized how much I rely on this site. I was obsessively checking it to see when I could get back on. As in >150 ArlieS:, I am not on social media either, so I kept checking my phone app and LT online. Glad you are back, and thanks for the many explanations. (I was ready to send a check in the mail if necessary!)
158santafechristian
Thank you so much for all you do!! Your app is phenomenal!!
159curioussquared
Thank you Tim and team for all your hard work to restore the site and confirming that I am, in fact, an LT addict :) I was suffering from withdrawal yesterday!!
160reconditereader
So many thanks to Tim and all employees for working so hard on this!
161timspalding
Okay! Here's our full autopsy of the problem, the steps we tool, and the eventual resolution. This thread is getting long.
https://www.librarything.com/topic/353456
https://www.librarything.com/topic/353456
162RobertForsythe
Hi Thanks for you efforts. Through out today September 7 2023 I have not been able to successfully upload any covers. bye Robert
163Taliesien
>162 RobertForsythe: Please see the following bug report -> https://www.librarything.com/topic/353472#n8225235
164NeilKM
Uploading some covers is an issue and the app and online site don't appear to be linked anymore (I can't see all the books I've entered on the app).
Thanks for your efforts and keeping us up-to-date with the situation
Thanks for your efforts and keeping us up-to-date with the situation
165gilroy
>164 NeilKM: The cover upload issue is a known bug: https://www.librarything.com/topic/353472
166Erna.G.Fenchel
>1 timspalding: I would be so grateful to be able to access our Library Systems account at covpreschurch. Thank you very much.
167MarthaJeanne
>166 Erna.G.Fenchel: I see that account at https://www.librarything.com/profile/covpreschurch. If you are having problems with it, you will need to be more specific.
This topic was continued by Resolution of "LibraryThing systems under stress".