Armando Fox » SML http://www.armandofox.com/geek A breadth-first traversal of life Sun, 05 May 2013 22:09:08 +0000 http://wordpress.org/?v=2.9.2 en hourly 1 Opportunities for // and multicore in SML http://www.armandofox.com/geek/2009/05/opportunities-for-and-multicore-in-sml/ http://www.armandofox.com/geek/2009/05/opportunities-for-and-multicore-in-sml/#comments Tue, 05 May 2009 20:34:55 +0000 fox http://radlab.cs.berkeley.edu/people/fox/wp/?p=101 Parallelizing/decomposing big models and trading off accuracy, precision, etc. (Similar to trading consistency for availability/scalability in storage.) EG: EM training with Markov models, you have a single big data structure (the translation table) that everyone uses and then has to be globally updated (in the M-step). A NIPS paper (described as “hacky” by Alex Smola) partitions the model and uses peer-peer anti-entropy to periodically try to sync models.

In general, one avenue of opportunity is to improve performance or power of most sophistiacted models.  But another avenue is: what can we do with yesterday’s/less sophisticated models, which may be perfectly adequate for some app domains esp. if they could run in real time or be portable, and/or they could be used in a layered approach with more sophisticated models within a particular domain.

]]> http://www.armandofox.com/geek/2009/05/opportunities-for-and-multicore-in-sml/feed/ 0 Universal data interchange format for SML data structures & models http://www.armandofox.com/geek/2009/05/universal-data-interchange-format-for-sml-data-structures-models/ http://www.armandofox.com/geek/2009/05/universal-data-interchange-format-for-sml-data-structures-models/#comments Tue, 05 May 2009 20:33:23 +0000 fox http://radlab.cs.berkeley.edu/people/fox/wp/?p=99 Given that interesting apps will use multiple languages/frameworks (if not at the productivity layer, then at the efficiency layer), we should be working on portable in-memory and on-disk data formats for various types of ML models (and fast swizzling/unswizzling). Use Google Code Protocol Buffers and define some standard schemata?

]]> http://www.armandofox.com/geek/2009/05/universal-data-interchange-format-for-sml-data-structures-models/feed/ 0