Scoop -- the swiss army chainsaw of content management
Front Page · Everything · News · Code · Help! · Wishlist · Project · Scoop Sites · Dev Notes · Latest CVS changes · Development Activities
How well does Scoop scale? Feature Requests
By Drog , Section Wishlist []
Posted on Sat Jun 05, 2004 at 12:00:00 PM PST
I was recently reading a story submitted two years ago, regarding how well Scoop scales (or doesn't scale). Can anyone tell me if any progress has been made in this area since then? Are there still plans for making it better? Or is it already quite capable of scaling up to support a community as large (or larger) than Slashdot?

< New Scoop Site Launched: Sportscolumn.com | Scoop 1.0 release >

Menu
· create account
· faq
· search
· report bugs
· Scoop Administrators Guide
· Scoop Box Exchange

Login
Make a new account
Username:
Password:

Related Links
· Slashdot
· story
· More on Feature Requests
· Also by Drog

Story Views
  29 Scoop users have viewed this story.

Display: Sort:
How well does Scoop scale? | 5 comments (5 topical, 0 hidden)
scaling (none / 0) (#1)
by janra on Tue Jun 08, 2004 at 02:45:23 PM PST

well, that particular question came up because Scoop doesn't handle really deep threads very well. Loads of comments on a page does still slow it down, but because Scoop builds up the threads recursively it's the deep threads that are the killer - they eat up memory like crazy.

This is pure speculation, but I think slashdot manages as many users as it does because it archives stuff very quickly, thus getting it out of the db and keeping the size down, and because I heard that they'd ported it to Oracle or some similar seriously heavy-duty database. Scoop can already do the archiving, and there is work underway to allow for different database backends. (I know the work has been underway for ages, and no I don't know when it'll be done. I don't know what's involved in a job like that.)

Slash gets around the long/deep threads issue with its comment paging, which has some advantages and some issues (I believe I heard somebody call it "braindead" in how it handles threads longer than the number of comments allowed on a page...)

I think the idea presented in the article you link to about cutting off really deep threads with a "continued..." link is a good one - that alone will make a big difference in how Scoop scales.

--
Discuss the art and craft of writing




I think not very well (none / 0) (#3)
by phr on Sat Jun 26, 2004 at 01:18:11 PM PST

Big scoop sites like Dailykos.com get bogged down horribly whenever there's breaking news of interest and lots of users are hitting the site at once.



There are simple solutions to this : (none / 0) (#5)
by Troutfishing on Sun Jul 03, 2005 at 01:48:40 PM PST

A simple solution : automated thread subdivision so that after x number of comments, Scoop generates a new thread, for continued comments, with the same name as the parent thread plus a number. So if the parent is one, the second thread is parent name +2, the 3rd is parent name +3, etc. A 50 comment limit should do nicely. Scoop also would put a little sub-menu to the all the thread continuations at the top and bottom of each thread sub-page. That approach would dramatically speed things up. I bet Kos would pay somebody to do that - he'd probably save enough in reduced bandwidth use to pay back the programming fee in a month or less. [ Just a guess ]



How well does Scoop scale? | 5 comments (5 topical, 0 hidden)
Display: Sort:

Hosted by ScoopHost.com Powered by Scoop
All trademarks and copyrights on this page are owned by their respective companies. Comments are owned by the Poster. The Rest © 1999 The Management

create account | faq | search