Releases: pravega/schema-registry
Schema Registry v0.1.0
Pravega Schema Registry is the latest service offering from Pravega team. The registry service is designed to store and manage schemas for the unstructured data stored in Pravega streams. However, the service is designed to not be limited to the data stored in Pravega and can serve as a general purpose management solution for storing and evolving schemas in wide variety of streaming and non streaming use cases.
It provides RESTful interface to store and manage schemas under schema groups. Users can safely evolve their schemas within the context of the schema group based on desired schema compatibility policy configured at a group level. The service has built in support for popular serialization formats in Avro, Profobuf and JSON schemas, however, users can also store and manage schemas from any serialization system. The service allows users to specify desired compatibility policies for evolution of their schemas but these are employed only for the natively supported serialization systems. In v0.1 we have compatibility policies enabled for Avro. Subsequently we will expand the scope to include Protobuf and Json.
Along with providing a storage layer for schema, the service also stores and manages additional encoding information in form of codec information. Codecs could correspond to different compression or encryption used while encoding the serialized data at rest. The service generates unique identifiers for schemas and codec information pairs that users may use to tag their data with.
**Important: Currently all APIs are in beta. This means that though the service is ready to be used in production, but the APIs may evolve in subsequent releases based on user feedback. This means we do not guarantee backward compatibility vis a vis API evolution. **
Please refer to following wiki pages for installation and usage samples.
Schema Registry Release
Pravega Schema Registry is the latest service offering from Pravega team. The registry service is designed to store and manage schemas for the unstructured data stored in Pravega streams. However, the service is designed to not be limited to the data stored in Pravega and can serve as a general purpose management solution for storing and evolving schemas in wide variety of streaming and non streaming use cases.
It provides RESTful interface to store and manage schemas under schema groups. Users can safely evolve their schemas within the context of the schema group based on desired schema compatibility policy configured at a group level. The service has built in support for popular serialization formats in Avro, Profobuf and JSON schemas, however, users can also store and manage schemas from any serialization system. The service allows users to specify desired compatibility policies for evolution of their schemas but these are employed only for the natively supported serialization systems. In v0.1 we have compatibility policies enabled for Avro. Subsequently we will expand the scope to include Protobuf and Json.
Along with providing a storage layer for schema, the service also stores and manages additional encoding information in form of codec information. Codecs could correspond to different compression or encryption used while encoding the serialized data at rest. The service generates unique identifiers for schemas and codec information pairs that users may use to tag their data with.
Important: Currently all APIs are in beta.
Please refer to following wiki pages for installation and usage samples.