Welcome to Sawmill.Net
 
 

Sawmill Discussion Forum

Subject: "Optimized support for Sparc, multiprocessors..."     Previous Topic | Next Topic
Printer-friendly copy     Email this topic to a friend    
Conferences Feature Requests Topic #19
Reading Topic #19
warnockm
Member since Dec-27-01
3 posts
Jan-04-02, 06:42 AM (PST)
Click to EMail warnockm Click to send private message to warnockm Click to add this user to your buddy list  
"Optimized support for Sparc, multiprocessors..."
 
   I'd really like to have Sawmill run faster on Solaris 8, using 64bit Sparc processors, especially multiprocessor boxes. We are running HUGE log files and have the equipment to do it fast, just not the software. Otherwise, i love the features! good luck


  Alert | IP Printer-friendly page | Edit | Reply | Reply With Quote | Top
ferrar
Member since Sep-5-01
275 posts
Jan-04-02, 03:04 PM (PST)
Click to EMail ferrar Click to send private message to ferrar Click to view user profileClick to add this user to your buddy list  
1. "RE: Optimized support for Sparc, multiprocessors..."
In response to message #0
 
   We've gotten quite a number of requests along these lines lately. We will be profiling on SPARC very soon, to try to determine the bottleneck, if any.

Multiprocessing support has been contemplated before, and indeed was implemented in version 6.0. But it never worked well, only gave a 2x speedup on 6 processors, and usually crashed to boot, so we disabled it. We've been tentatively planning to reimplement it in version 7, but using a more distributed model (in version 6, it used SMP and required a lot of locking, which is why it was so slow). This model will involve splitting the log data into separate chunks, processing each chunk with a completely separate Sawmill process, and then adding the processed results into the database. The final stage (adding into the database) will be single-threaded, but the rest of it (the majority of the time spent) will be done in parallel, so it should give a better speedup than the previous model. Even cooler, it should be possible to distribute it across multiple machines if desired (DMP). Given the dull roar of the crowds clamoring for this feature, I believe it will be part of version 7, but we have not yet begin implementation of it in version 7.

Version 7, by the way, is well underway, but at this point it's a mess, because we're changing so many things about the underlying database and configuration architecture that it's not even beta quality yet. When it reaches beta quality, it will be released as a beta, probably a public beta. That may be several months yet, though, and the first beta will have only a small set of the version 7 features, and will probably no include multiprocessing.

-
Greg Ferrar, Sawmill Product Manager
http://www.flowerfire.com/sawmill/


  Alert | IP Printer-friendly page | Edit | Reply | Reply With Quote | Top

Conferences | Topics | Previous Topic | Next Topic

Home    Overview    Features    Samples    Testimonials     FAQ    Downloads    Ordering    Manual    Support

 

Copyright © 2001 by Flowerfire Privacy Policy