Announcement

Collapse
No announcement yet.

Forum Move

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • converge
    replied
    Rumor has it, DT has taken the gunnery seat and will be personally accepting or denying every packet that touches defcon.org until the 1st of August. Be warned.

    Leave a comment:


  • Deviant Ollam
    replied
    sweet zombie jesus! i disabled use of the local proxy as described above and the forums are fucking flying! that was definitely it. i'll have to pull some pages from my own apache box and check the logs to see what on earth the filter proxy does when trying to fetch the HTML.

    thanks for all the helpful replies with respect to server tolerances.

    Leave a comment:


  • The Dark Tangent
    replied
    Total Connections

    If you are unlucky enough to anger the forums, you will know about it because no more pages will load.

    Leave a comment:


  • Deviant Ollam
    replied
    i tend to punch up between half a dozen and a dozen tabs when viewing sites with multiple links that i plan to read. i'll keep it down around 3 to 4 and see how the defcon forums behave for me now.

    i'm also going to tell mozilla that forum.defcon.org doesn't need to be routed through my local filtering proxy, since i don't know how that software handles the HTTP requests... perhaps it is pulling the page down with multiple GET requests for identical images, etc. it's an old proxy and i haven't updated it in forever. that may be part of my problem.

    Leave a comment:


  • converge
    replied
    well.. I'm reluctant to give out *all* the details about it, for obvious publicly readable reasons. But denying and/or providing no info would just be stiff imo.

    Assuming that you are using an http1.1 complaint browser that only uses 1 connection per loading tab, the foremost possibility that strikes me is you are using a script/mod to autoload all of the links into tabs.. which would cause problems. Or you need to check the forums more often than every 48 active threads :p

    Leave a comment:


  • TheCotMan
    replied
    Originally posted by converge
    Don't connect simultaneously more than 48 times from a given IP at a time. This is done to control various bots and tards from raping forum resources for their indexing or DoSing schemes.
    I did not know if that was some sort of super-secret, security by obscurity thing. ( Dataworm: :-D )

    If a user has a busted/old web client, it may be possible for the loading of one page to create well over 10 connections on pages with many different images, as it is *possible* for each image to be loaded with a separate connection.

    Most pages do not have lots of different images though, and most modern clients people will use should support loading of multiple items through the same connection, and if they don't, 48 should be MORE than enough for any threads we still have if they only load one page at a time.

    Newer* versions of HTTP allow for one connection to load more than one thing without starting a new connection.

    * "Newer" heh. I think this started with HTTP/1.1 and that is not really that new.

    Leave a comment:


  • converge
    replied
    Don't connect simultaneously more than 48 times from a given IP at a time. This is done to control various bots and tards from raping forum resources for their indexing or DoSing schemes.

    Of course there are other more specific thresholds.. but details are available on a need to know basis.. and ...

    Leave a comment:


  • TheCotMan
    replied
    Originally posted by Deviant Ollam
    if, however, i have a forum index pulled up and i click a series of discussion threads, launching them in new tabs and letting them load all at once, i'll have the first few bytes of each loading page... then everything hangs. i'll get nothing for the next 20 to 30 seconds. the tabs all go on, attempting to continue loading data... but nothing comes through.

    is the web server interpreting my multiple connections from a single client as an attack or otherwise something to be blocked?
    I can neither confirm nor deny if this does exist or does not (I'll leave that to someone else ;-) but I will say that I do the same thing as you describe- (use multiple tabs with right-click on "show me most recent unread post in thread") and I do not have problems so long as I limit it to about 3 or 4 tabs that are actually loading. When I keep these limits, I do not have any problems.

    Also, the cookie system in Mozilla is not perfect with the forums for noting "read" threads when you do this. It can lead to weird "bugs" that are not really bugs in the forum software, but have to do with cookie updates in parallel by Mozilla instead of the expected serialized fashion used by most people.

    Leave a comment:


  • Deviant Ollam
    replied
    does the new forum server/firewall setup have some sort of client connections threshold, which if exceeded will result in a data for the user making the connections being suspend temporarily? i ask because while using mozilla, i'll typically click a whole series of links and launch them in new browsing tabs. i do this with google search results, with news headlines, and while flipping through online forums, including the DC forums.

    i've found that if i just click through pages on these forums a single link at a time, everything is fine. pages load pretty quickly and i can get what i need without difficulty. if, however, i have a forum index pulled up and i click a series of discussion threads, launching them in new tabs and letting them load all at once, i'll have the first few bytes of each loading page... then everything hangs. i'll get nothing for the next 20 to 30 seconds. the tabs all go on, attempting to continue loading data... but nothing comes through.

    is the web server interpreting my multiple connections from a single client as an attack or otherwise something to be blocked?

    Leave a comment:


  • mage2
    replied
    Feels alot better from here on my slow ass work connection. Thanks for the upgrade.



    Originally posted by Dark Tangent
    Hmm.. I am starting to suspect strange networking issues, either with the cisco router to firewall connection, or some as of yet un-known problem.

    At first I thought it was the firewall being stressed out. Well I was looking at the load average, not the CPU usage stats. Load has doubled since the forum moved over, but that just meant the CPU idle time went from 99 percent free to 98.

    This will have to entail my friend Mr. tcpdump and find out where the latency is being introduced.

    UPDATE: Strange interactions between the firewall set at full duplex, and the forum machine set at full duplex (But really failing down to half duplex) caused some performance issues. Once both the firewall and the forums were set to auto negotiate they both came back up at full-duplex (And didn't fall back to half duplex.. go figure) I think that should make a visible difference. Let me know if you guys notice any difference.

    Leave a comment:


  • skroo
    replied
    Originally posted by Dark Tangent
    Once both the firewall and the forums were set to auto negotiate they both came back up at full-duplex (And didn't fall back to half duplex.. go figure) I think that should make a visible difference. Let me know if you guys notice any difference.
    Noticeably smoother today, no more timeouts here. Bliss.

    Leave a comment:


  • The Dark Tangent
    replied
    Strange behavior with performance

    Hmm.. I am starting to suspect strange networking issues, either with the cisco router to firewall connection, or some as of yet un-known problem.

    At first I thought it was the firewall being stressed out. Well I was looking at the load average, not the CPU usage stats. Load has doubled since the forum moved over, but that just meant the CPU idle time went from 99 percent free to 98.

    This will have to entail my friend Mr. tcpdump and find out where the latency is being introduced.

    UPDATE: Strange interactions between the firewall set at full duplex, and the forum machine set at full duplex (But really failing down to half duplex) caused some performance issues. Once both the firewall and the forums were set to auto negotiate they both came back up at full-duplex (And didn't fall back to half duplex.. go figure) I think that should make a visible difference. Let me know if you guys notice any difference.
    Last edited by The Dark Tangent; July 12, 2005, 00:18.

    Leave a comment:


  • highwizard
    Guest replied
    Hopefully with the move, Nulltone will use his super-leet Ninja powers (The type that make people crap their pants), and keeps the forums up during the con.

    Leave a comment:


  • The Dark Tangent
    replied
    Forum Speed

    Yeah, it is a bit slow, even though it is on a much faster box. I am investigating the firewall settings.

    I don't want to spend too much time on the firewall if possible, though, because that machine gets upgraded as soon as the second CPU and new drives arrive in the mail. Then the FW box will be about 2.5 times faster, and that might fix the problem.

    I'll do some tweaking now and see what happens, then let you guys know when the new upgraded box is getting ready to be deployed.

    Leave a comment:


  • astcell
    replied
    These paes are indeed running slow. My DNS has still not updated, 12 hour is about right for my end, ho hum.

    Leave a comment:

Working...
X