Pipes for MarkLogic Data Hub v1.0.2

New Features

#222 Pipes will now be smarter on start-up and warn user if they failed to deploy Pipes backend-modules or have older version of modules in their data hub

#204 Pipes will now inform user if they're trying to reload a source block for which there's no data available in their data hub

Bug fixes

#218 When deleting a source block, it doesn't get removed from the right-click menu (Sources)
#221 (Graph) Upgrade broken for subgraphs
#220 Xpath and String Split block not updated correctly
#201 Reloading a block doesn't reconstruct the toggle settings

Pipes for MarkLogic Data Hub v1.0.1

Welcome to Pipes 1.0.1

In this release, we added tons of new features:

• New functional blocks
• Improved organization of blocks
• Preview and source block wizards
• New DHF project samples for Pipes
• Chose JSON or XML output
• Run Pipes in Docker
• Reload and change source blocks

and lots more...read on.

New Features

#56 As a user, I want to have to option to determine the type of graph output - JSON or XML
#91 As a user I'd like to connect Pipes to DHS
#102 As a Pipes user, I'd like to have a user-friendly graph preview experience
#101 As a developer, I'd like to have a gradle task to build the jar
#79 As a user I'd like to be able to change the definition of the source block in the current graph
#36 Allow Source Blocks to be created from DHF Custom Step details
#136 Make Soure Block creation easier
#137 Sort Collections in Source block and Preview on collection name
#158 As a Pipes user, it's not clear to me how to define Subgraph inputs and outputs so that they are visible in the main graph
#160 Improve Entity Selection Panel
#162 Hook for property editing
#156 Make the block color configurable
#185 Remove background line
#182 Allow me to collapse the setup stuff on the Preview
#135 Setup Unit Test framework
#177 As a Pipes developer writing unit tests, I'd like to be able to execute the graph by providing database name instead of id
#85 As a user, I'd like to delete blocks using Del on the keyboard
#161 Create a Map Range Values Block
#54 As a user I'd like to be able to run Pipes in a docker container
#188 Graph JSON pretty print when downloading
#98 As a user, I'd like to be warned when clicking on "Log out" button

Bug Fixes

#81 Pipes will fail silently if wrong modules DB supplied in the application.properties
#75 When specifying a wrong db, collection and URI in the preview, I get an error I don't understand #75
#77 Preview will crash on empty output
#72 Preview based on URI does not work
#95 Multiple "Block Created" messages appear sometimes when block is created/updated
#100 quasar build should complete prior to execution of the rest of the …
#106 Save flows to Staging as flow-developer
#148 Envelope attachment not working on master
#170 Remove the input / output type of inputs / outputs in subgraphs
#107 deployBackend=true conflicts with mlBundle
#134 Removing outputs in a subgraph do not get removed in parent block
#176 Lookup/QueryBuilder etc are not working if the variable is (empty) sequence
#175 Internal: ml-litegraph lifecycle running twice
#155 Bug: Source Block wizards fails when using Custom Step
#159 Field collection throws error when collection doesn't exist
#122 Feature/Lookup is still not dynamic
#97 BUG: Pipes allowing source blocks without database, collection and/or fields
#108 JSON Collection sampler does not work if NULL and other type is used
#128 selectCase does not store the properties
#118 Lookup block does not retain widget fields and value on reload
#104 Preview wizard: if no documents exist for selected custom step collection, preview will fail

Pipes for MarkLogic Data Hub v1.0-beta.4

Bug fixes:

#94: Critical bug: Pipes relies on the service extension before it's been deployed
#92 String/uuid is not compiling to native SJS
#89 Xpath block throwing error

New features

#90 As a user, I'd like to be able to log out of Pipes

Documentation improvements

#82 Documentation enhancement: change plugin to tool in readme.md

Pipes for MarkLogic Data Hub v1.0-beta.3

Features

New execution engine

Very excited to introduce a beta version of a new Pipes engine that produces pure JS code for the custom DHF step, developed by @josvanroosmalen! The code executes natively on MarkLogic so it's very performant and doesn't require any dependencies on backend-modules to execute.

Log-in screen

#53 As a user, I'd like to be able to log into Pipes using a log-in form instead of specifying the credentials in application.properties

ml-gradle plugin for Pipes (using mlBundle)

#38 Gradle plugin for deploy/undeploy pipes backend

Port auto-selecting

#60 Pipes should select 1st free port when booting, without the need to specify it in properties

Improvements

#71 Check compatibility with DHF 5.2
#68 More Clear UI that subgraphs works on arrays
#50 Introduce java unit tests to middle-tier

Better checks on startup

#62 Check whether properties are set and log an error if not
#57 Credentials checking at start-up
#32 Clean/check parameters in application.properties
#23 Restrict file upload to relevant types

Bug Fixes

#76 Source block cannot handle with arrays of objects
#22 Creating source block duplicates elements in the source tree for mixed collection

Pipes for MarkLogic Data Hub v1.0-beta.2

Bugs fixed

• #64 Running custom step in DHF was causing false values in the envelope
• #24 Reloaded blocks not available in graph
• #51 Add "no-cache" header for custom user blocks
• #59 Only user with username “admin” is able to deploy the backend
• #41 Ports 8001/8002 hardcoded in pipes.jar
• #13 Error starting Pipes on Windows
• #20 Graph execution sometimes fails with xdmp.documentGetCollections(null) -- arg1 is not of type String

Documentation

• #29 Add example graphs and data to the repo
• #6 Identify minimum security role to run Pipes and document
• Added a lot of Wiki pages (with videos!)

Enhancements

• #43 Allow multiple custom uris for analysis
• #46 Add XPath block
• #17 As a user, I want to provide my own user block library (json and sjs) at middle tier startup
• #15 As a user, I'd like better error reporting when graph fails.
• #39 Pipes is throwing away Exceptions
• #25 Use Graph title when saving
• #27 When booting Pipes, make sure to check if the DHF path exists
• #18 Block creation screen UI improvements
• #28 Graph validation messages should use the block labels instead of name/ID
• #16 As a user, I want to know if the graph as the minimum requirements to be executed

Pipes for MarkLogic Data Hub v1.0-beta.1

• Stability improvements
• Better error reporting
• Improved user experience
• Added a lot of documentation to https://github.com/marklogic-community/pipes/wiki

Pipes for MarkLogic Data Hub v0.9-beta.1

Release notes:

• big fixes (nasty bug that was preventing the custom step to execute in the DHF)
• feature: Pipes now saves the custom step code and optionally deploys it directly to MarkLogic

Pipes for MarkLogic Data Hub v0.8-beta.3

Bug Fixes:

• #14 Pipes was failing to boot up for any other host than 'localhost'

Pipes for MarkLogic Data Hub v0.8-beta.2

• Better validation and error reporting
• Security improvements (node.js)
• Teardown (uninstall function) now available: use --undeployBackend=true when running Pipes

Pipes for MarkLogic Data Hub v0.8-beta.1

This is a pre-release of Pipes. Expect to find bugs and we expect from you to report them. Have fun!