Server Status

[nikhsub1]

10:29 PST, 4/29/08 - First of all, the provider is / was experiencing a ddos attack (distributed denial of service) over the ATT backbone causing the whole server to be either very slow or non existent. Next issue was that I upgraded php and mysql to version 5 from 4 so that Steve can upgrade the forum software. In doing this upgrade, seems the SERVER versions of sql got upgraded but the client remained at 4 so all my sites with php and sql just displayed blank pages. Anyway, i re ran the upgrade so now all should be good.

[JJ Irani]

10:29 PST, 4/29/08 - First of all, the provider is / was experiencing a ddos attack (distributed denial of service) over the ATT backbone causing the whole server to be either very slow or non existent. Next issue was that I upgraded php and mysql to version 5 from 4 so that Steve can upgrade the forum software. In doing this upgrade, seems the SERVER versions of sql got upgraded but the client remained at 4 so all my sites with php and sql just displayed blank pages. Anyway, i re ran the upgrade so now all should be good.

WHOA!! WHOA!! WHOA!! Speak English only please!! :read::rofl::rofl::rofl:

[Baptistman]

Wondered what happened. :cheers:

[JJ Irani]

Wondered what happened. :cheers:

You're wondering? I'm still wondering what the hell that guy's typed out up there!! :thinking::banghead::lol::lol:

[toph]

Thanks for the update- i was almost crying :chuckle::chuckle:

[Incurable]

Yep... been experiencing "Page Not Found" errors for some hours now... :eek: I was in the process of contacting a therapist to handle the withdrawals. Thx for the good work.

BTW...

I've been tracking stalls using the new 'performance' stats @ the bottom of the page. Though infrequent, they can be nasty... Here's a few examples of what I've experienced recently.


Rolex Forums generated this page in 10.50962496 seconds (-38.99% PHP - 138.99% MySQL) with 10 queries
Rolex Forums generated this page in 113.84571099 seconds (0.07% PHP - 99.93% MySQL) with 17 queries
Rolex Forums generated this page in 12.89046788 seconds (15.17% PHP - 84.83% MySQL) with 11 queries
Rolex Forums generated this page in 125.74084496 seconds (0.14% PHP - 99.86% MySQL) with 10 queries
Rolex Forums generated this page in 147.70558000 seconds (0.38% PHP - 99.62% MySQL) with 11 queries
Rolex Forums generated this page in 17.41107988 seconds (-35.71% PHP - 135.71% MySQL) with 10 queries
Rolex Forums generated this page in 20.42607999 seconds (-10.96% PHP - 110.96% MySQL) with 11 queries
Rolex Forums generated this page in 206.63692188 seconds (0.08% PHP - 99.92% MySQL) with 10 queries
Rolex Forums generated this page in 212.87211800 seconds (-84.60% PHP - 184.60% MySQL) with 11 queries
Rolex Forums generated this page in 27.28135896 seconds (4.23% PHP - 95.77% MySQL) with 11 queries
Rolex Forums generated this page in 45.06333208 seconds (0.81% PHP - 99.19% MySQL) with 11 queries
Rolex Forums generated this page in 7.30852699 seconds (0.87% PHP - 99.13% MySQL) with 20 queries
Rolex Forums generated this page in 72.85853791 seconds (0.72% PHP - 99.28% MySQL) with 10 queries
Rolex Forums generated this page in 8.67641997 seconds (-19.68% PHP - 119.68% MySQL) with 10 queries
Rolex Forums generated this page in 9.25816011 seconds (1.56% PHP - 98.44% MySQL) with 13 queries

[mike]

10:29 PST, 4/29/08 - First of all, the provider is / was experiencing a ddos attack (distributed denial of service) over the ATT backbone causing the whole server to be either very slow or non existent. Next issue was that I upgraded php and mysql to version 5 from 4 so that Steve can upgrade the forum software. In doing this upgrade, seems the SERVER versions of sql got upgraded but the client remained at 4 so all my sites with php and sql just displayed blank pages. Anyway, i re ran the upgrade so now all should be good.

Yeah,.......that's what I thought.:twit:

[Terry Newton]

I thought I got kicked out :crying: :crying: :crying:

I went through withdrawals all morning and was thinking, what did I say?

Terry got banned for flaming far too many nasty, fake watches. E-bay complained because they were losing a fortune. Especially that $96,000 watch they lost the profits on yesterday. :lol: :lol: :lol:

Terry Newton

[JJ Irani]

Yeah,.......that's what I thought.:twit:

:dummy::rofl::rofl::rofl::rofl::cheers:

[HDHNTER]

I thought I got kicked out :crying: :crying: :crying:

I went through withdrawals all morning and was thinking, what did I say?

Terry got banned for flaming far too many nasty, fake watches. E-bay complained because they were losing a fortune. Especially that $96,000 watch they lost the profits on yesterday. :lol: :lol: :lol:

Terry Newton

:lol: Good to see the site up & running again. :thumbsup:

[SPACE-DWELLER]

Thanks for the headsup!

Damn! These forums are addictive! :twit:

[Scarface]

Damn! These forums are addictive! :twit:

Say that again Bo :thumbsup:

[JJ Irani]

Say that again Bo :thumbsup:

Damn!! These forums are addictive!! :rofl::rofl:

[Rockrolex]

Damn!! These forums are addictive!! :rofl::rofl:
Are you Bo? :dummy::dummy::dummy::bartmoon::rofl::rofl::rofl:

[Rockrolex]

10:29 PST, 4/29/08 - First of all, the provider is / was experiencing a ddos attack (distributed denial of service) over the ATT backbone causing the whole server to be either very slow or non existent. Next issue was that I upgraded php and mysql to version 5 from 4 so that Steve can upgrade the forum software. In doing this upgrade, seems the SERVER versions of sql got upgraded but the client remained at 4 so all my sites with php and sql just displayed blank pages. Anyway, i re ran the upgrade so now all should be good.
Thanks for the update, Nick. A lot of us were going through withdrawal today. Glad it's all worked out. :thumbsup::thumbsup::clap:

[Attila]

All night I spent getting online with no success!

[oneillba]

Thanks for the update. I just figured it was on my end and made a sandwich.

[kcmo]

Phew, I was worried! Glad to be back online!

[nikhsub1]

Yeah, it was sort of a double whammy. Issue one was the attack. Essentially, script kiddies use bot's (computer programs) to send mass amounts of data to a router or a cluster of servers. This causes whatever is being slammed with data to basically, get overloaded. It wasn't the TRF server that was specifically targeted, it was actually the ATT backbone that was, the host is on the ATT backbone (amongst others) so anyone with ATT or anyone that gets routed through ATT would have been affected. This was an issue out of my control altogether and this was the small issue lol.

The big issue was the upgrade to MySql and php. This bulletin board runs on a MySql database (db) using .php as the 'language' to communicate with the db. Steve asked me to upgrade to version 5 so he can run the mega cool new version of this forum software, version 3.7.0, it has some KILLER new features. Anyway, the upgrade was done yesterday and all seemed fine. Until I tweaked a sever setting and realized that maybe something happend that should not have. Well, as I said before, the SERVER version of MySql upgraded to version 5 but all the client versions, meaning each local account on this server, were NOT upgraded to 5 but remained at version 4. It's sort of like trying to put a square peg in a round hole. Once I noticed this (here is where the ddos attack comes in LOL) I couldn't do anything about it since the attack kept me from getting to the server. Once I could get to the server, a rebuild of Apache (the module on the server that serves web pages like this one) rectified the issue.

I'm sure JJ will still think I'm speaking Greek or something, but I tried to make it as easy to understand as possible. If all that fails the short version is:

I THINK WE ARE GOING TO BE FINE! And thanks for your patience and understanding :cheers:

[2careless]

Thanks for the update. One suggestion though - For our externally hosting Unix web sites, we always put in a dialup modem to the console port for out of band management.
Costs more, but peace of mind.

[nikhsub1]

Thanks for the update. One suggestion though - For our externally hosting Unix web sites, we always put in a dialup modem to the console port for out of band management.
Costs more, but peace of mind.
Not needed as this server is managed and can physically be accessed 24/7 if need be :cheers:

[Lol-x]

That's awesome Scott, I wasn't worried for a minute :thumbsup:

Ddos attack huh, I've never been the victim on that crime before. A Ddos attack is a serious federal offence and I have had personal experience acting on behalf of such an offender in court. They interfere with the use of 100,000's to 1,000,000 of users. I guess I can say I was the victim of crime yesterday :chuckle:

Thanks very much for the upgade Scott that is fantastic. I think it will make the forum run more smoothly, that is for sure.

[Troy]

Went out bought a new computer, digital modem, and wires ............now you tell me...lol

[Lol-x]

Vbulletin 3.7.0 Gold was released 30 minutes ago, so now the batton is handed to me.

I will try to upgrade the forum at some point in the next few days, and so it will be down for several hours whilst the upgrade takes place. My workload until Saturday is quite high so I expect Saturday is most likely to be the day. :cheers:

Perfect timing Scott :thumbsup: :chuckle:

[BiG JeEzY]

Vbulletin 3.7.0 Gold was released 30 minutes ago, so now the batton is handed to me.

I will try to upgrade the forum at some point in the next few days, and so it will be down for several hours whilst the upgrade takes place. My workload until Saturday is quite high so I expect Saturday is most likely to be the day. :cheers:

Perfect timing Scott :thumbsup: :chuckle:


Thank you very much for the upgrades Scott! I really appreciate the work you have done to keep this forum running smooth. I do not know very much about computer programming except for the basics. Glad to have experts like you here in the forums! :cheers:

Steve, thank you for informing us about the upgrade! Just wondering, will we see a cool, new, interface in the forums as a result of the upgrade? I do like the current interface, I was just wondering. :thumbsup:

[unclesallie]

I thought I got kicked out :crying: :crying: :crying:

I went through withdrawals all morning and was thinking, what did I say?

Terry got banned for flaming far too many nasty, fake watches. E-bay complained because they were losing a fortune. Especially that $96,000 watch they lost the profits on yesterday. :lol: :lol: :lol:

Terry Newton

:rofl::rofl::rofl:
too much!!:chuckle::chuckle:
best,
dan

[Oscar]

10:29 PST, 4/29/08 - First of all, the provider is / was experiencing a ddos attack (distributed denial of service) over the ATT backbone causing the whole server to be either very slow or non existent. Next issue was that I upgraded php and mysql to version 5 from 4 so that Steve can upgrade the forum software. In doing this upgrade, seems the SERVER versions of sql got upgraded but the client remained at 4 so all my sites with php and sql just displayed blank pages. Anyway, i re ran the upgrade so now all should be good.


Huh,

what did he say????????? :banghead::banghead::banghead:

[Lol-x]

After the upgrade the forum will pretty much look the same as it is now. :cheers:

[sheldonsmith]

Thanks for the update,but why is Arnold appended to every message. He is raising hell in California by saying that the state has a spending problem and not a revenue problem. I guess that is why I am getting a pay-cut next fiscal year (Uh, we are not in recession, or so they say....)

-Sheldon

BTW, I understood everything in the first post.... Made perfect sense.....

[boa2]

Perhaps you good folks could do some moonlighting for our region's largest ISP. When my connectivity speedtest measured a sloth-like 648kbps yesterday, they suggested I phone back if the problem gets a lot worse. Hmmm, what would that look like? :thinking:

[CoopJr]

10:29 PST, 4/29/08 - First of all, the provider is / was experiencing a ddos attack (distributed denial of service) over the ATT backbone causing the whole server to be either very slow or non existent. Next issue was that I upgraded php and mysql to version 5 from 4 so that Steve can upgrade the forum software. In doing this upgrade, seems the SERVER versions of sql got upgraded but the client remained at 4 so all my sites with php and sql just displayed blank pages. Anyway, i re ran the upgrade so now all should be good.

I would have just tweaked the Flux Capacitor
http://www.cedmagic.com/featured/back-to-the-future/flux-capacitor-real.jpg :rofl: :lol:

[Incurable]

I would have just tweaked the Flux Capacitor
http://www.cedmagic.com/featured/back-to-the-future/flux-capacitor-real.jpg :rofl: :lol:

I'm thinking more along the lines of the Reverberating Carbonizer w/Mutate Capacity...

[2careless]

10:29 PST, 4/29/08 - First of all, the provider is / was experiencing a ddos attack (distributed denial of service) over the ATT backbone causing the whole server to be either very slow or non existent. Next issue was that I upgraded php and mysql to version 5 from 4 so that Steve can upgrade the forum software. In doing this upgrade, seems the SERVER versions of sql got upgraded but the client remained at 4 so all my sites with php and sql just displayed blank pages. Anyway, i re ran the upgrade so now all should be good.

Er, this is a perfectly worded report of the said situation. :thumbsup:
How about the following instead???

Written in technical English with appropriate terms of description about the specific conditions of the computer systems software and hardware, attributable to the various attack vectors pertained during an externally controlled and coordinated extended flood of service requests from the upstream service provider to the said server. Compounded with the impending software upgrade on the database server side whilst the corresponding client side component has been retained, thus creating an incompatibility of the said database client and server software, thus created such outage. Rectification of such outage incurred recompilation of the said database source code and the re-distribution and re-installation of the database server and client end at the server, thus removing the incompatiability issue.

I write these all the time to make people sleep :rofl:
The purpose is to make sure you stated everything as truthfully as possible but make it so boring that nobody can identify and attribute the blame :lol:

[mopsey]

Originally Posted by nikhsub1 View Post
10:29 PST, 4/29/08 - First of all, the provider is / was experiencing a ddos attack (distributed denial of service) over the ATT backbone causing the whole server to be either very slow or non existent. Next issue was that I upgraded php and mysql to version 5 from 4 so that Steve can upgrade the forum software. In doing this upgrade, seems the SERVER versions of sql got upgraded but the client remained at 4 so all my sites with php and sql just displayed blank pages. Anyway, i re ran the upgrade so now all should be good.


Well, thats cleared that up then!!!!!! :dummy::dummy::dummy:

[Oscar]

Er, this is a perfectly worded report of the said situation. :thumbsup:
How about the following instead???

Written in technical English with appropriate terms of description about the specific conditions of the computer systems software and hardware, attributable to the various attack vectors pertained during an externally controlled and coordinated extended flood of service requests from the upstream service provider to the said server. Compounded with the impending software upgrade on the database server side whilst the corresponding client side component has been retained, thus creating an incompatibility of the said database client and server software, thus created such outage. Rectification of such outage incurred recompilation of the said database source code and the re-distribution and re-installation of the database server and client end at the server, thus removing the incompatiability issue.

I write these all the time to make people sleep :rofl:
The purpose is to make sure you stated everything as truthfully as possible but make it so boring that nobody can identify and attribute the blame :lol:


Kai,

Having read your comments it seems quite clear to me that you may also be the Speech Writer for the Australian Prime Minister, Kevin Rudd.

Am I right???

Mods, please dont' penalise me. These are not designed to be political comments. I am just trying to take the you know what out of Kev's Speech Writer.

I am merely stating that Big Kev should sack his current Speech Writer and employ someone that writes plain english speeches.

:cheers:
Michael

[2careless]

Kai,

Having read your comments it seems quite clear to me that you may also be the Speech Writer for the Australian Prime Minister, Kevin Rudd.

Am I right???

Mods, please dont' penalise me. These are not designed to be political comments. I am just trying to take the you know what out of Kev's Speech Writer.

I am merely stating that Big Kev should sack his current Speech Writer and employ someone that writes plain english speeches.

:cheers:
Michael


:lol: If I got the pink envelope, I'll shout beer for every TRF member in Melbourne :cheers:

Seriously, I deal with service providers, lawyers, contract managers daily and these are the stuff they send me to review and accordingly I'll have to reply in kind :lol:

I suppose I should be doing a Juris Doctor degree so that I can bore people officially, except that it costs $90k :thumbsdow

[vh_bu98]

Do you guys have a daily backup of the board in case of a major crash?

[Oscar]

:lol: If I got the pink envelope, I'll shout beer for every TRF member in Melbourne :cheers:

Seriously, I deal with service providers, lawyers, contract managers daily and these are the stuff they send me to review and accordingly I'll have to reply in kind :lol:

I suppose I should be doing a Juris Doctor degree so that I can bore people officially, except that it costs $90k :thumbsdow


Kai,

I have no problem with interpreting all manner of contracts, Acts of Parliament, Regulations and so forth, but your comments really flipped me out. I have a pretty good brain with most legal matters, but with your words I was scratching the grey matter between my ears thinking, what the???

:thumbsup::thumbsup:

[2careless]

Errr...
1. Some external people tried to flood the AT&T network backbone with packets. Since the server resides within the confinements of AT&T network backbone, the server performance was affected to the point that it was very unresponsive.
2. In the meantime, the client/server database software was being upgraded. Unfortunately, only the server part of the database software was upgraded successfully, leaving the client part on the old version of the database software. This created a compatiability issue resulting the server displaying blank pages. In order to fix the problem, the database software was recompiled (re-created) from scratch and the upgrade re-applied. This fixed the problem.
This is as plain english as I can make it. Scott did a good job in explaining the situation with far fewer words :thumbsup:

[vh_bu98]

Errr...
1. Some external people tried to flood the AT&T network backbone with packets. Since the server resides within the confinements of AT&T network backbone, the server performance was affected to the point that it was very unresponsive.
2. In the meantime, the client/server database software was being upgraded. Unfortunately, only the server part of the database software was upgraded successfully, leaving the client part on the old version of the database software. This created a compatiability issue resulting the server displaying blank pages. In order to fix the problem, the database software was recompiled (re-created) from scratch and the upgrade re-applied. This fixed the problem.
This is as plain english as I can make it. Scott did a good job in explaining the situation with far fewer words :thumbsup:

How about this?

1) Bad people sent a lot of useless data to the AT&T network slowing it down.

2) A software upgrade broke the machine that the site is on.

Plain enough English? :lol:

[nikhsub1]

Do you guys have a daily backup of the board in case of a major crash?
Yes, daily, weekly and monthy backups are performed however, it would be very prudent for Steve to automate (or do it manually) a MySql dump every day or so.

[Lol-x]

The database is backed up daily :cheers:

[Earl]

Thanks Scott for your hands on!!