There are plenty of ways to get Stratosphere. Pick any of the following to start.
Download the ready to run binary package if you want to use Stratosphere on your computer or cluster.
Stratosphere has dependencies to Hadoop (e.g. HDFS and HBase). Choose a Stratosphere distribution that matches your Hadoop version. In doubt, use the Stratosphere version for Hadoop 1.2.
Make sure to checkout the Documentation for further help.
Use the Maven Dependencies to add Stratosphere to your project.
These dependencies also include a local execution environment. Therefore they are sufficient for local testing.
The current development version is not pushed to Maven central yet (this will change with the release), so please make sure to add the Sonatype snapshot repository to your Maven project between:
<repositories>
<repository>
<id>snapshots-repo</id>
<url>https://oss.sonatype.org/content/repositories/snapshots</url>
<releases><enabled>false</enabled></releases>
<snapshots><enabled>true</enabled></snapshots>
</repository>
</repositories>
Maven will now be able to find the Stratosphere dependencies. If you want to interact with Hadoop, make sure to pick the dependency matching your Hadoop version. In doubt, use the Stratosphere version for Hadoop 1.2.
<dependency>
<groupId>eu.stratosphere</groupId>
<artifactId>pact-common</artifactId>
<version>0.4-SNAPSHOT</version>
</dependency>
<dependency>
<groupId>eu.stratosphere</groupId>
<artifactId>pact-clients</artifactId>
<version>0.4-SNAPSHOT</version>
</dependency>
<dependency>
<groupId>eu.stratosphere</groupId>
<artifactId>pact-common</artifactId>
<version>0.4-hadoop2-SNAPSHOT</version>
</dependency>
<dependency>
<groupId>eu.stratosphere</groupId>
<artifactId>pact-clients</artifactId>
<version>0.4-hadoop2-SNAPSHOT</version>
</dependency>
If you don't have a Maven project yet, we encourage you to use our Quickstart scripts to create one with all the Stratosphere dependencies already in place.
Use a virtual machine if you don't want to run on your native system.
We provide a virtual machine image that comes with a fresh Stratosphere installation and small data sets to play around with. The image will run on both Virtual Box and VMWare.
Let Vagrant set up a virtual machine with Stratosphere installed for you.
wget http://dev.stratosphere.eu/vm/Vagrantfile
vagrant up
vagrant ssh
Use vagrant as username and password.
We have also prepared a Debian repository for Debian/Ubuntu systems.
# vim /etc/apt/sources.list.d/stratosphere.list
deb http://dev.stratosphere.eu/repo/binary precise main
# apt-get update
apt-get install stratosphere-dist
Compile Stratosphere on your own machine.
git clone https://github.com/stratosphere/stratosphere.git
cd stratosphere
mvn clean package -DskipTests
git clone https://github.com/stratosphere/stratosphere.git
cd stratosphere
mvn clean package -DskipTests -Dhadoop.profile=2
Make sure to checkout the Documentation for further help.
Feel free to contact us if you have any problems or suggestions.
This project uses Java Profiler from from ej-technologies.