Forums
First  << 1  2  3  4  5 >>  Last
Forum Main>>Announcements>> Lag Spikes #2
Chedburn

ID: 1
Level: 35
Posts: 7240
Score: 12651
Chedburn [1]Reply | Quote | Report

Last replied to on Wed Feb 21, 2007 03:45:28
I thought I would go in to a little more detail and try to explain exactly what is happening. All of the admins agree that whats happening is very odd indeed. In fact the whole staff team and many others are completely stumped. I know for certain there are a few experts on database management here on the site and we would like to hear some other opinions on what could be causing these strange spikes. We are pretty sure it is to do with innoDB deadlocks and killing connections seems to fix it for a while. Below is an image of the lag spikes taking place. If you would like to give your input you can mail me in game, please only if you have a good experience with this kind of thing. Currently this problem is the ONLY thing causing any lag at all. Finding the source and fixing it means no lag. And there is a source somewhere.

Many thanks.

systemload.gif

Ched.jpg
Super secret reinforced spam barrier 2.0
SoulRanger
ID: 297786
Level: 52
Posts: 11393
Score: 5
SoulRanger [297786]Reply | Quote | Report

Posted on Sat Feb 10, 2007 05:45:58
Erm, sorry but i don't understand:(


Edited by: SoulRanger on 10/02/07 at 5:48:28 AM

starsigdm0.png
Super secret reinforced spam barrier 2.0
notacreativeone
ID: 274359
Level: 43
Posts: 616
Score: 4
notacreativeone [274359]Reply | Quote | Report

Posted on Sat Feb 10, 2007 05:46:08
for working on it


mfnerdbar1or7.png
Super secret reinforced spam barrier 2.0
Stoned420

ID: 238933
Level: 53
Posts: 92
Score: 4
Stoned420 [238933]Reply | Quote | Report

Posted on Sat Feb 10, 2007 05:46:31
Dang crazy all this lag an stuff well just keep up the good work

Super secret reinforced spam barrier 2.0
Lord_Thomas

ID: 377584
Level: 61
Posts: 1705
Score: 165
CsiLord_Thomas [377584]Reply | Quote | Report

Posted on Sat Feb 10, 2007 05:47:18
nice to see you got it down to a specific problem, I hope there are people that can help you solve the problem.

I must say that since I started, things are much smoother now


Edited by: SrThomasJN on 10/02/07 at 5:47:44 AM

Super secret reinforced spam barrier 2.0
WinterX

ID: 232500
Level: 36
Posts: 641
Score: 154
~TH~WinterX [232500]Reply | Quote | Report

Posted on Sat Feb 10, 2007 05:48:10
gambadeh, i know you can solve it

db5c224e-8a3a-a99e-232500.jpg
^^click to mail^^
Super secret reinforced spam barrier 2.0
Hanoverfist
ID: 12665
Level: 48
Posts: 144
Score: 38
Hanoverfist [12665]Reply | Quote | Report

Posted on Sat Feb 10, 2007 05:50:50
nice tech work

hanoverfisthy1.jpg
Super secret reinforced spam barrier 2.0
thiagorip

ID: 119080
Level: 68
Posts: 17416
Score: 36
~WP~thiagorip [119080]Reply | Quote | Report

Posted on Sat Feb 10, 2007 05:54:39
i would help if i knew something about DBs and stuff



Super secret reinforced spam barrier 2.0

ID:
Level:
Posts:
Score:
 []Edit | Reply | Quote | Report

Posted on Sat Feb 10, 2007 06:00:48
I dont know but ill show it to my coworkers

Super secret reinforced spam barrier 2.0
Megadeth

ID: 24557
Level: 79
Posts: 9592
Score: 1526
JFKMegadeth [24557]Reply | Quote | Report

Posted on Sat Feb 10, 2007 06:03:27
If I knew, I would love to give you ideas and find the problem, I don't know. If there other pro php coders might know in the game.

Super secret reinforced spam barrier 2.0
Tupac
ID: 41674
Level: 56
Posts: 427
Score: -3
Tupac [41674]Reply | Quote | Report

Posted on Sat Feb 10, 2007 06:23:06
i hope you will foind somoene to work on this probleme thx again ched;)

Untitled-2.gif
TC4-468x60.gif
Super secret reinforced spam barrier 2.0
Reject
ID: 304767
Level: 32
Posts: 1054
Score: -50
Reject [304767]Reply | Quote | Report

Posted on Sat Feb 10, 2007 06:24:19
Keep working at it.. =D

rejectsig2fr0.gif
Super secret reinforced spam barrier 2.0

ID:
Level:
Posts:
Score:
 []Edit | Reply | Quote | Report

Posted on Sat Feb 10, 2007 06:28:40
Erm, sorry but i don't understand:(


Edited by: SoulRanger on 10/02/07 at 5:48:28 AM


took the words out of my mouth

Super secret reinforced spam barrier 2.0
ToughGuy

ID: 35316
Level: 62
Posts: 1341
Score: 331
NOVAToughGuy [35316]Reply | Quote | Report

Posted on Sat Feb 10, 2007 06:34:51
i just sent Ched an in game e-mail. i am a graduate student and currently am working on information systems and focusing mainly on databases and SQL. also my job is as an auditor for a major corporation and audit databases on a regular basis. i think i might be able to help. let me know if you think i can be of service

JohnandClint1.jpg

MrSands will always be remembered.
Super secret reinforced spam barrier 2.0
LordFate
ID: 368716
Level: 23
Posts: 1059
Score: 0
LordFate [368716]Reply | Quote | Report

Posted on Sat Feb 10, 2007 06:35:38
oh ye, seriously keep on that!
its somewhere there...:|

kino2oh4.gif
kinofanfd8.gif
69138398-130919.jpg
Super secret reinforced spam barrier 2.0
Krazy_Kris
ID: 285679
Level: 61
Posts: 244
Score: 13
Krazy_Kris [285679]Reply | Quote | Report

Posted on Sat Feb 10, 2007 06:40:41
It sounds like a Bottleneck problem

A bottleneck is exactly what the name implies. It is the point in the system that limits the data throughput, which is the amount of data that can flow through the network

I have a few answers that might fix the problem but i would rather not post onto here as for fear of being criticised but if you do want to hear my suggestions... mail me

P.S. keep up the good work Ched.. this game will always remain the best text based RPG online game EVER.. thanks


Edited by: Mushie-Man on 10/02/07 at 6:49:40 AM

mushieproto2.jpg
Super secret reinforced spam barrier 2.0
-Mayhem-
ID: 171030
Level: 63
Posts: 1298
Score: 120
-Mayhem- [171030]Reply | Quote | Report

Posted on Sat Feb 10, 2007 07:01:09
In stead of replying with things like "I don't know what you're talking about" or "you'll fix it", don't reply at all. Ched is looking for useful replies here that can help him and the other staff members figure out what's causing these lag spikes. Reading all these pointless replies (including mine, eventually) is just a big waste of time for them.
So do us all a favour and be quiet if you have no useful input on the topic or if you have no idea what this is about.

100% pure sisu!
Super secret reinforced spam barrier 2.0

ID:
Level:
Posts:
Score:
 []Edit | Reply | Quote | Report

Posted on Sat Feb 10, 2007 07:10:14
:(

Super secret reinforced spam barrier 2.0
Pigsa

ID: 187724
Level: 65
Posts: 2331
Score: 794
TNBPigsa [187724]Reply | Quote | Report

Posted on Sat Feb 10, 2007 07:17:06
whatever it is, hope it gets fixed soon!

nywewx.png
Super secret reinforced spam barrier 2.0
Hischar

ID: 294754
Level: 50
Posts: 370
Score: 9
Hischar [294754]Reply | Quote | Report

Posted on Sat Feb 10, 2007 07:22:00
awesome job

Super secret reinforced spam barrier 2.0
MrPink
ID: 95850
Level: 40
Posts: 1276
Score: -16
MrPink [95850]Reply | Quote | Report

Posted on Sat Feb 10, 2007 07:40:24
Ched, I'm not saying I'm an expert, but I know my share of databases and such.

I think that if you want a decent advice, we need more info then just the lag peaks.

If one wants to find out what's causing these peaks, one needs to know what happens in the databases at that moment, to find the relations between them.

For example user-counts? Is there a sudden increase of people logging in? (Maybe the West Coast of the USA gets up at that time for instance)

Certain crons running at that moment (Job payouts, city stats gathering)?

Actually, in short: One should be able to see where all these connections are going to.

I would love to get more in-depth in the problem, but I think one needs more information for that.



Super secret reinforced spam barrier 2.0
I3rickI3built
ID: 15243
Level: 35
Posts: 810
Score: 45
I3rickI3built [15243]Reply | Quote | Report

Posted on Sat Feb 10, 2007 07:42:32
Good luck on finding the sources...

;)

Super secret reinforced spam barrier 2.0

ID:
Level:
Posts:
Score:
 []Edit | Reply | Quote | Report

Posted on Sat Feb 10, 2007 08:00:15
i hope i cud have been o' any assistance but that's not my field.....xD

Super secret reinforced spam barrier 2.0
adderas
ID: 191010
Level: 20
Posts: 6490
Score: -489
adderas [191010]Reply | Quote | Report

Posted on Sat Feb 10, 2007 08:17:55
:S

Oh hai I iz r jus heer to hav sum me fun in and japlish kthnxbai
Super secret reinforced spam barrier 2.0

ID:
Level:
Posts:
Score:
 []Edit | Reply | Quote | Report

Posted on Sat Feb 10, 2007 08:40:14
i'll do a research about your database.
;)

Super secret reinforced spam barrier 2.0
MrPink
ID: 95850
Level: 40
Posts: 1276
Score: -16
MrPink [95850]Reply | Quote | Report

Posted on Sat Feb 10, 2007 08:56:34
Okay, not trying to insult, flame, or attack any individuals, I'm just gonna try and set up a discussion with people who might have some knowledge about the matter.
And maybe that indeed for once....replies such as ":S" could be held on a low?

Mushieman: If it would be a bottleneck problem, that would imply that when there's no lag, the number of connections would be low enough to pass through this bottleneck.

So, the moment the lag occurs, for some reason there is an extreme increase of connections going to the Dbases.

I think one needs to look at that increase. Is it possible that some connections stay open longer then needed? As Ched says, killing all the connections fixes it....for another 24 hours. Are the connections not closed automatically properly, causing a "traffic-jam" of ever increasing number of connections?

If they do shut down correctly automatically, then if it were a bottleneck problem, there has to be some reason to an extreme sudden increase of connections, right?
What happens at that time? Thousands of people logging in at once ( <- doubtful)? Crons running at that time? ( <- doubtful aswell, since all crons have been taken away)

What is the one remaining thing that occurs only once a day, and generates a lot of connections/calculations?

Shouldn't the answer be searched in that direction?

Super secret reinforced spam barrier 2.0
Shadowcast
ID: 369913
Level: 33
Posts: 808
Score: 0
Shadowcast [369913]Reply | Quote | Report

Posted on Sat Feb 10, 2007 09:26:10
alot of the lag peaks are around 7pm onwards, about the time alot of people will have got home from work and had dinner ect... could it just be too many of us trying to log in at once and things like that? *confused*

Super secret reinforced spam barrier 2.0
MrPink
ID: 95850
Level: 40
Posts: 1276
Score: -16
MrPink [95850]Reply | Quote | Report

Posted on Sat Feb 10, 2007 09:33:15
That was one of my thoughts aswell, but disregarded that thougt pretty fast tbh....

If it were simply lots of people signing in, that would have been obvious to anyone monitoring the databases.

Plus.....Ched's new toys (aka the new server set up) should be capable in handling such traffic.
Plus, timezones? I have no clue how the geographical spread is of the players, but I think you'd be seeing more peaks then. One when Europe gets home. one when the US East coast gets home, the West coast, asia etc etc..

Super secret reinforced spam barrier 2.0

ID:
Level:
Posts:
Score:
 []Edit | Reply | Quote | Report

Posted on Sat Feb 10, 2007 09:38:30
@pink they use persistent connections to mysql and you need to see the config files of mysql & apache and the php connection strings to see how the handle the sessions timouts

Super secret reinforced spam barrier 2.0
My_Cat_Quit
ID: 165026
Level: 30
Posts: 126
Score: 0
My_Cat_Quit [165026]Reply | Quote | Report

Posted on Sat Feb 10, 2007 09:40:53
Guys, if it's related to active connections, how about trying to reduce the inactive timeout.
At the moment the system recognises you as active for 60 minutes after your last action. How about reducing this to 30 minutes?

You have lost your Donater Status. You will no longer recieve 5 energy every 10 minutes and your 150 energy bar has been reduced to 100. If you would like them back, please go here to donate again.

In a word... NO!!!


*You haven't voted at TOPRPG yet
Super secret reinforced spam barrier 2.0

ID:
Level:
Posts:
Score:
 []Edit | Reply | Quote | Report

Posted on Sat Feb 10, 2007 09:42:23
Guys, if it's related to active connections, how about trying to reduce the inactive timeout.
At the moment the system recognises you as active for 60 minutes after your last action. How about reducing this to 30 minutes?

that can be done according to my last post

Forum Main>>Announcements>> Lag Spikes #2
First  << 1  2  3  4  5 >>  Last

This thread has been locked.