Distributed Data Framework (DDF) is an open source, modular catalog framework.
- Standardization
- Building on established Free and Open Source Software (FOSS) and open standards avoids vendor lock-in
- Extensibility
- Capabilities can be extended by developing and sharing new features
- Built on top of Apache Karaf for OSGi support
- Flexibility
- Only features required can be deployed
- Federated Open Geospatial Consortium (OGC) filter powered metadata catalog
- Enterprise Service Bus (ESB) performs transformation between query standards
- Apache Solr integration
- Well Known Text (WKT) indexing and search for spatial awareness
- Full text search
- XML indexing
- Open Geospatial Consortium (OGC) CSW federated services
- OpenSearch federated services
- REST API for catalog operations
- Integrated content framework to store actual products associated with the indexed metadata
- Tika parser for extracting metadata from common file formats (Office, PDF, etc)
- Plugin support for pre and post processing on all operations
- Metrics
- Simplicity of installation and operation
- Unzip and run
- Simplicity of Development
- Build simple Java Objects and wire them in via a choice of dependency injection frameworks
- Make use of widely available documentation and components for DDF's underlying technologies
- Modular development supports multi-organizational and multi-regional teams
- Install OpenJDK 17.
- Make sure that your JAVA_HOME environment variable is set to the newly installed JDK location, and that your PATH includes %JAVA_HOME%\bin (Windows) or
$JAVA_HOME$ /bin (*NIX). - Install Maven 3.8.5 (or later). Make sure that your PATH includes the MVN_HOME/bin directory.
- Set the MAVEN_OPTS variable with the appropriate memory settings
- If you do not wish to run formatting from the commandline (see below) you may use an IDE to format the code for you with the google-java-format plugins.
In order to run through a full build, be sure to have a clone for the ddf repository and optionally the ddf-support repository (NOTE: daily snapshots are deployed so downloading and building each repo may not be necessary since those artifacts will be retrieved.):
git clone git://github.com/codice/ddf.git
git clone git://github.com/codice/ddf-support.git (Optional)
Change to the root directory of the cloned ddf repository. Run the following command:
mvn install
This will compile DDF and run all of the tests in the DDF source distribution. It usually takes some time for maven to download required dependencies in the first build. The distribution will be available under "distribution/ddf/target" directory.
See https://github.com/codice/ddf/wiki/Release-Process for documentation on how to perform a release.
If during development the build fails for formatting, eg:
Failed to execute goal com.coveo:fmt-maven-plugin:1.8.0:check (default-cli) on project <module name>: Found <number> non-complying files, failing build
You can run the formatter with the command:
mvn fmt:format
For additional information about building DDF, see Building DDF.
- Start SolrCloud based on the README in <ddf_repo_src>/distribution/docker/solrcloud
- Unzip the distribution.
- Run the executable at <distribution_home>/bin/ddf.bat or <distribution_home>/bin/ddf
Find documentation about DDF at codice.org.
Discussions can be found on the Announcements forum, Users forum, and Developers forum.
For changes between versions and known issues, please read the release notes.
If you find any issues with DDF, please submit an issue.
For information on contributing to DDF see Contributing to Codice.
The DDF Website also contains additional information at http://ddf.codice.org.
Many thanks for using DDF.
-- The Codice DDF Development Team
Copyright (c) Codice Foundation
This is free software: you can redistribute it and/or modify it under the terms of the GNU Lesser General Public License as published by the Free Software Foundation, either version 3 of the License, or any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Lesser General Public License for more details. A copy of the GNU Lesser General Public License is distributed along with this program and can be found at http://www.gnu.org/licenses/lgpl.html.