Flume Usage

MongoDB Flume Adapter

Provides integration for Flume and MongoDB, currently as a sink only (Data can be written to MongoDB)

You can configure MongoDB as a sink using our Standard URI Format.

To test this, you'll need to set up Flume in Pseudo-distributed mode. First, run a master node using:

flume master

You can check that this is running by accessing the master node configuration page. You should then start a slave node using:

flume node_nowatch

Verify that this is running correctly by accessing the admin page.

Go back to the master node configuration page and click on the config link to configure a node. In the dropdown labelled 'Configure node:' select the IP of your local host. For 'Source:', enter 'text("/Users/bwmcadams/code/mongodb/mongo-hadoop/examples/pigtutorial/resources/excite-small.log")'. For 'Sink:', enter 'mongoDBSink("mongodb://localhost/test.flume")'.