Category Archives: meandre

Meandre 2.0 Alpha Preview = Scala + MongoDB

Posted on July 16, 2010 by xavier

A lot of water under the bridge has gone by since the first release of Meandre 1.4.X series. In January I went back to the drawing board and start sketching what was going to be 1.5.X series. The slide deck embedded above is a extended list of the thoughts during the process. As usual, I [...]

Related posts:

  1. Fast REST API prototyping with Crochet and Scala
  2. Meandre is going Scala
  3. Meandre Infrastructure 1.4 RC1 tagged

Continue reading →

Posted in Crochet, Data-Intensive Computing, meandre, mongodb, Presentations, RDF, Research, scala, Software | Tagged , , , | Comments Off

Soaring the Clouds with Meandre

Posted on March 16, 2010 by xavier

You may find the slide deck and the abstract for the presentation we delivered today at the “Data-Intensive Research: how should we improve our ability to use data” workshop in Edinburgh. Abstract This talk will focus a highly scalable data intensive infrastructure being developed at the National Center for Supercomputing Application (NCSA) at the University [...]

Related posts:

  1. Meandre: Semantic-Driven Data-Intensive Flows in the Clouds
  2. Data-Intensive Computing for Competent Genetic Algorithms: A Pilot Study using Meandre
  3. [BDCSG2008] Clouds and ManyCores: The Revolution (Dan Reed)

Continue reading →

Posted in cloud computing, Data-Intensive Computing, hadoop, meandre, Notes, Research, ZigZag | Comments Off

Fast REST API prototyping with Crochet and Scala

Posted on January 21, 2010 by xavier

I just finished committing the last changes to Crochet and tagged version 0.1.4vcli now publicly available on GitHub (http://github.com/xllora/Crochet). Also feel free to visit the issues page in case you run into question/problems/bugs. Motivation Crochet is a light weight web framework oriented to rapid prototyping of REST APIs. If you are looking for a Rails [...]

Related posts:

  1. Meandre 2.0 Alpha Preview = Scala + MongoDB
  2. Meandre is going Scala
  3. Fast mutation implementation for genetic algorithms in Python

Continue reading →

Posted in APIs, Crochet, meandre, REST, scala, SEASR, Software | Comments Off

Meandre is going Scala

Posted on December 2, 2009 by xavier

After quite a bit of experimenting with different alternatives, Meandre is moving into Scala. Scala is a general purpose programming language designed to express common programming patterns in a concise, elegant, and type-safe way. This is not a radical process, but a gradual one while I am starting to revisit the infrastructure for the next [...]

Related posts:

  1. Fast REST API prototyping with Crochet and Scala
  2. Meandre: Semantic-Driven Data-Intensive Flow Engine
  3. Meandre Infrastructure 1.4 RC1 tagged

Continue reading →

Posted in clojure, data-intensive flows, erlang, jruby, jython, meandre, Notes, scala, Software, ZigZag | Comments Off

Temporary storage for Meandre’s distributed flow execution

Posted on September 29, 2009 by xavier

Designing the distributed execution of a generic Meandre flow involves several moving pieces. One of those is the temporary storage required by the computing nodes (think of it as one node as one isolated component of a flow) to keep up with the data generated by a component, and also be able to replicate such [...]

Related posts:

  1. Easy, reliable, and flexible storage for Python
  2. ZooKeeper and distributed applications
  3. Meandre: Semantic-Driven Data-Intensive Flow Engine

Continue reading →

Posted in Data-Intensive Computing, data-intensive flows, java, meandre, Notes, python, Software, storage, tokyo cabinet | Comments Off

Liquid: RDF endpoint for FluidDB

Posted on September 25, 2009 by xavier

A while ago I wrote some thoughts about how to map RDF to and from FluidDB. There I explored how you could map RDF onto FluidDB, and how to get it back. That got me thinking about how to get a simple endpoint you could query for RDF. Imagine that you could pull FluidDB data [...]

Related posts:

  1. Liquid: RDF meandering in FluidDB
  2. Temporary storage for Meandre’s distributed flow execution
  3. Efficient serialization for Java (and beyond)

Continue reading →

Posted in cloud computing, Data-Intensive Computing, FluidDB, meandre, Notes, RDF, Software, sparql, storage | Comments Off

From Galapagos to Twitter: Darwin, Natural Selection, and Web 2.0

Posted on September 19, 2009 by xavier

Yesterday I was visiting Monmouth College to participate on the Darwinpalooza which commemorates the 200th anniversary of Charles Darwin’s birth and the 150th anniversary of the publication of On the Origin of Species. After scratching my head about about what to present, I came out with quite a mix. You will find the abstract of [...]

Related posts:

  1. Challenging lectures on-line at TED
  2. Dusting my Ph.D. thesis off
  3. Scaling Genetic Algorithms using MapReduce

Continue reading →

Posted in Charles Darwin, DISCUS, Genetic algorithms, human-based genetic algorithms, interactive genetic algorithms, meandre, Presentations | Comments Off

Liquid: RDF meandering in FluidDB

Posted on August 26, 2009 by xavier

Meandre (NCSA pushed data-intensive computing infrastructure) relies on RDF to describe components, flows, locations and repositories. RDF has become the central piece that makes possible Meandre’s flexibility and reusability. However, one piece still remains largely sketchy and still has no clear optimal solution: How can we facilitate to anybody sharing, publishing and annotating flows, components, [...]

Related posts:

  1. Liquid: RDF endpoint for FluidDB
  2. Meandre: Semantic-Driven Data-Intensive Flows in the Clouds
  3. Meandre 1.4.0 final release candidate tagged

Continue reading →

Posted in cloud computing, Data-Intensive Computing, FluidDB, meandre, Notes, RDF, Research, Social Networks, Software, storage | Comments Off