Christopher Bouzy
A
thread 1/8
At approximately 12:30 PM EST, we observed a disruption in the availability of several of our services. Upon conducting a thorough investigation, it became apparent that several of our servers had become unresponsive.
04:35 PM - Nov 13, 2023 (Edited)
Avatar Avatar Avatar
0
55
247
Christopher Bouzy
A
thread 2/8
Subsequently, we promptly contacted our data center provider and were informed that they were experiencing technical difficulties.
04:35 PM - Nov 13, 2023
1
60
Christopher Bouzy
A
thread 3/8
Roughly 30 minutes later, our entire platform experienced an outage due to the failure of the redundant systems we had in place, resulting from the simultaneous shutdown of all our servers.
04:35 PM - Nov 13, 2023
0
65
Christopher Bouzy
A
thread 4/8
At approximately 2:54 PM EST, we received notification that the issues had been resolved, albeit requiring a complete restart of all our servers. This endeavor is significant in scale as it encompasses several dozen servers, a substantial portion of which are part of clustered configurations.
04:35 PM - Nov 13, 2023
0
72
Christopher Bouzy
A
thread 5/8
While network-related challenges are not uncommon, the necessity of restarting all our server instances is an unusual occurrence. We are currently in the process of resynchronizing services such as search, which remains outstanding.
04:35 PM - Nov 13, 2023
0
72
Christopher Bouzy
A
thread 6/8
We sincerely apologize for the extended downtime and any inconvenience this may have caused. We are actively exploring options to mitigate such incidents in the future, including the establishment of a secondary data center.
04:35 PM - Nov 13, 2023
1
106
Christopher Bouzy
A
thread 7/8
Presently, all our servers are housed within a single data center, leaving our services vulnerable to widespread disruption in the event of an issue.
04:35 PM - Nov 13, 2023
0
74
Christopher Bouzy
A
thread 8/8
By implementing a secondary data center, we aim to enhance redundancy and enable traffic rerouting, thereby minimizing the likelihood of similar outages.
04:35 PM - Nov 13, 2023
17
140
Richard Head
A
In response to Christopher Bouzy.
Not that any of us users could have done a thing about it, but it's really nice to have a breakdown of what happened.

Thank you.
09:38 AM - Nov 14, 2023
0
8
Sandy Karosi
A
In response to Christopher Bouzy.
08:34 AM - Nov 14, 2023
0
6
Vaughn Cooper
A
In response to Christopher Bouzy.
Thanks for the updates
06:36 AM - Nov 14, 2023
0
5
MaggieMae
A
In response to Christopher Bouzy.
I didn’t realize how much I care for Spoutible and my podmates thereof until I tried to access the site a few times today and couldn’t engage. Thank you @cbouzy and team for your technical wisdom and keeping us afloat in the friendly waters of our Spoutible home! Full speed ahead! 🐳🌊🩵
02:40 AM - Nov 14, 2023
0
15
Brooksie
A
In response to Christopher Bouzy.
Thank you for keeping us in the loop... or is it the flip side for spouter ... in the pool.
12:42 AM - Nov 14, 2023
0
5
Blair Houghton
A
In response to Christopher Bouzy.
07:50 PM - Nov 13, 2023
1
13
Blair Houghton
A
In response to Blair Houghton.
10:43 PM - Nov 13, 2023
0
1
Indigo
A
In response to Christopher Bouzy.
Appreciate the quick restoration of the platform and the explanation for the unexpected outage. Keep up the great work! 😃👏🏾🙌🏾👍🏾
06:35 PM - Nov 13, 2023
0
10
Thunderschnozzle
A
In response to Christopher Bouzy.
Thank you for the transparency! Regarding the technical issues you mentioned, are they of the malicious attack kind or just improbable, unexpected, unfortunate technical events?
In any case, I've got some room in the attic for a server or two, just saying 😅
06:28 PM - Nov 13, 2023
0
11
Carla Reid + Chilla
A
In response to Christopher Bouzy.
Thank you so much for the explanation.
Things happen. I woke from a nap and Spoutible was back.
06:25 PM - Nov 13, 2023
0
6
Matt Egan he/him/his
A
In response to Christopher Bouzy.
Thank you for keeping us updated and for the way you always keep us apprised of what is going on around here. I don't know if this helps at all, but the desktop version seems to be running fine so far, but the app won't load. Not a big deal, this place isn't even a year old, so these things happen
06:24 PM - Nov 13, 2023
0
6
9Gen
A
In response to Christopher Bouzy.
Colo.
05:50 PM - Nov 13, 2023
0
1
Barbara Reid
A
In response to Christopher Bouzy.
Thanks for the explanation! Spoutible was back up and running quicker than expected! 👏👏👏
05:35 PM - Nov 13, 2023
0
7
Canuck Newf
A
In response to Christopher Bouzy.
Would this also explain why I have to turn off my WiFi and use cellular data to open Spoutible or would that be an ISP issue.

I get a "connection refused" error with both the app and browser when using WiFi at the Air BnB.
05:30 PM - Nov 13, 2023
0
1
Randall Parisy
A
In response to Christopher Bouzy.
This is an A+ example.of transparency and why I love this platform. Do I understand it all? Nope, but I like that I'm at least told what's up.
05:20 PM - Nov 13, 2023
0
20
Eve_Gadgets
A
In response to Christopher Bouzy.
I have room in my closet I promise not to read anyone's spout while they're typing 🙄

We appreciate you #teamspoutible
05:20 PM - Nov 13, 2023
0
10
Innerspacegirl
A
In response to Christopher Bouzy.
thanks for explaining it all. it's still a baby whale, so I think it's pretty amazing how WELL things routinely go!
05:19 PM - Nov 13, 2023
0
9
Lisa W FirstWave
A
In response to Christopher Bouzy.
That shut down was not good! I missed my friends, but We understand. Thanks for all that you do!!!!
05:08 PM - Nov 13, 2023
0
5
⚾️Dane Pereslete⚾️
A
In response to Christopher Bouzy.
05:04 PM - Nov 13, 2023
0
3
Linda Eisenstein
A
In response to Christopher Bouzy.
Your transparency - as always - is stellar and much appreciated.
04:57 PM - Nov 13, 2023
0
20
Elaine Gionet
A
In response to Christopher Bouzy.
This is a one of the many reasons I am appreciative of your leadership. 💕 🐳
04:56 PM - Nov 13, 2023
0
13
Klobby L
A
In response to Christopher Bouzy.
I feel bad for you and the team–it must have been a crazy, scrambling day! Time for a beer!
04:51 PM - Nov 13, 2023
0
13
Mary Becker
A
In response to Christopher Bouzy.
I love the summary
04:51 PM - Nov 13, 2023
0
5
⚾️Dane Pereslete⚾️
A
In response to Christopher Bouzy.
Thanks for the update. I guessed it was a data center issue. If you're going to second source, maybe we better start donating more!
04:50 PM - Nov 13, 2023
0
9
Craig Tyler
A
In response to Christopher Bouzy.
Thank you for telling us. And thank you very much for your diligence in caring for this community.
04:47 PM - Nov 13, 2023 (Edited)
0
9
Phred
A
In response to Christopher Bouzy.
I see people blaming a wayward puppie. And @Phil .
04:44 PM - Nov 13, 2023
1
5
BTSdaily7 (sporadic;)
A
In response to Phred.
👀 Is Phil a raisin-shamer?
04:53 PM - Nov 13, 2023
0
2
BTSdaily7 (sporadic;)
A
In response to Christopher Bouzy.
I get it, but I’m still choosing to blame the raisin-shamers
04:42 PM - Nov 13, 2023
1
10
Vee a lot of everything Happened
A
In response to BTSdaily7 (sporadic;).
😂😂😂😂😂
04:46 PM - Nov 13, 2023
0
0
Doctor Michael
A
In response to Christopher Bouzy.
Thank you for letting us know.
04:41 PM - Nov 13, 2023
0
3
Viviane Elbee
A
In response to Christopher Bouzy.
Thank you for the update
04:40 PM - Nov 13, 2023
0
3
Jonathan Meyers
A
In response to Christopher Bouzy.
Thanks for the detailed explanation... this is the only social media company where we really feel like customers and not just users.
04:40 PM - Nov 13, 2023
0
9
indie perfume lover
A
In response to Christopher Bouzy.
Thanks for letting us know what happened.
04:39 PM - Nov 13, 2023
0
3
{{ notificationModalContent }} {{ promptModalMessage }}