Hue is an open source Web interface for analyzing data with any Apache Hadoop: gethue.com
It features:
- SQL editors for Hive, Impala, MySQL, Oracle, PostgreSQL, SparkSQL, Solr SQL, Phoenix...
- Dynamic Search dashboards with Solr
- Spark and Hadoop notebooks
- Scheduling of jobs and workflows through an Oozie Editor and Dashboard
More user and developer documentation is available at gethue.com.
To build and get the development server running:
$ git clone https://github.com/cloudera/hue.git
$ cd hue
$ make apps
$ build/env/bin/hue runserver
Now Hue should be running on http://localhost:8000 !
The configuration in development mode is desktop/conf/pseudo-distributed.ini.
Note: to start the production server (but lose the automatic reloading after source modification):
$ build/env/bin/supervisor
To run the tests:
Install the mini cluster (only once):
$ ./tools/jenkins/jenkins.sh slow
Run all the tests:
$ build/env/bin/hue test all
Or just some parts of the tests, e.g.:
$ build/env/bin/hue test specific impala
$ build/env/bin/hue test specific impala.tests:TestMockedImpala
$ build/env/bin/hue test specific impala.tests:TestMockedImpala.test_basic_flow
Start Hue in a single click with the Docker Guide or the video blog post.
You'll need these library development packages and tools installed on your system:
Ubuntu:
-
sudo apt-get install git ant gcc g++ libffi-dev libkrb5-dev libmysqlclient-dev libsasl2-dev libsasl2-modules-gssapi-mit libsqlite3-dev libssl-dev libxml2-dev libxslt-dev make maven libldap2-dev python-dev python-setuptools libgmp3-dev
-
Oracle's JDK (read more here)
sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java7-installer
- mvn (from
mavenpackage or maven3 tarball) - openldap-dev / libldap2-dev
- libtidy-0.99-0 (for unit tests only)
CentOS/RHEL:
- Oracle's JDK (read more here)
- ant
- asciidoc
- cyrus-sasl-devel
- cyrus-sasl-gssapi
- cyrus-sasl-plain
- gcc
- gcc-c++
- krb5-devel
- libffi-devel
- libtidy (for unit tests only)
- libxml2-devel
- libxslt-devel
- make
- mvn (from
apache-mavenpackage or maven3 tarball) - mysql
- mysql-devel
- openldap-devel
- python-devel
- sqlite-devel
- openssl-devel (for version 7+)
- gmp-devel
MacOS:
- Xcode command line tools
- Oracle's JDK 1.7+
- maven (Homebrew)
- mysql (Homebrew)
- gmp (Homebrew)
- openssl (Homebrew)
- Required for Mac OS X 10.11+ (El Capitan), after
brew install openssl, run:export LDFLAGS=-L/usr/local/opt/openssl/lib && export CPPFLAGS=-I/usr/local/opt/openssl/include
All, just in case you want to run the Jasmine tests:
- NodeJS (https://nodejs.org/)
- PhantomJS (npm install -g phantomjs-prebuilt)
The Hue "framework" is in desktop/core/ and contains the Web components.
desktop/libs/ is the API for talking to various Hadoop services.
The installable apps live in apps/. Please place third-party dependencies in the app's ext-py/
directory.
The typical directory structure for inside an application includes:
src/
for Python/Django code
models.py
urls.py
views.py
forms.py
settings.py
conf/
for configuration (``.ini``) files to be installed
static/
for static HTML/js resources and help doc
templates/
for data to be put through a template engine
locales/
for localizations in multiple languages
For the URLs within your application, you should make your own urls.py
which will be automatically rooted at /yourappname/ in the global
namespace. See apps/about/src/about/urls.py for an example.
Hue would not be possible without:
- Python 2.6.5 - 2.7
- Django 1.6 (https://docs.djangoproject.com/)
- Knockout.js (http://knockoutjs.com/)
- jQuery (http://jquery.com/)
- Bootstrap (http://getbootstrap.com/)
- User group: http://groups.google.com/a/cloudera.org/group/hue-user
- Jira: https://issues.cloudera.org/browse/HUE
- Reviews: https://review.cloudera.org/dashboard/?view=to-group&group=hue (repo 'hue-rw')
Apache License, Version 2.0 http://www.apache.org/licenses/LICENSE-2.0