-
Notifications
You must be signed in to change notification settings - Fork 0
Home
The Carbon Portal is a set of services to collect, store, and distribute ICOS data (and more). This infrastructure is also used for the SITES data portal. These services are mostly written in Scala and JavaScript.
The data service stores the uploaded data as files on disk. Depending on the data type, these files can be processed during the upload to generate a binary representation of the data, allowing for a fast preview of the data.
- Portal (Carbon Portal – SITES): The data portal is the main way to access our data. It is a React/Redux JavaScript app that queries our metadata store using SPARQL.
- Stats (Carbon Portal – SITES): A React/Redux app to view download and preview statistics about our data.
- Dygraph: A JavaScript wrapper to preview time series using the dygraph charting library inside the data portal.
- NetCDF: NetCDF files preview inside the data portal.
- Map-Graph: An app to preview data with ship tracks inside the portal. It displays both a map and dygraph.
The metadata service stores metadata associated to uploaded data and exposes it through a SPARQL API.
- Upload (Carbon Portal – SITES): A frontend to upload data. Once you login, the metadata is submitted using your API token, the data is validated, and then uploaded to our storage.
- Metadata editing (Carbon Portal – SITES): An internal app to edit reusable metadata.
- SPARQL Client (Carbon Portal): An interface to write SPARQL queries against our metadata store.
Authentication (Carbon Portal – SITES)
The authentication service allows people to create an account. It allows you to permanently accept the data license so you don't have to accept it every time you want to download data. After being granted submitter rights, you can use the upload form or the API token found in your profile to upload data to the portal. More information about the upload can be found on Github.
A MongoDB with a rest API used to store usage statistics.
RDF Log is a Postgres database that contains every an history of every RDF statement applied to the metadata. It is the base on top of which the SPARQL engine is instantiated.
DOI Minting (Carbon Portal)
The DOI minting service uses DataCite to mint DOIs.