Skip to content

[Partial][compression][gorilla] Add survey and implementation for facebook gorilla #22

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
at15 merged 9 commits into from
May 13, 2020
Merged

[Partial][compression][gorilla] Add survey and implementation for facebook gorilla #22

at15 merged 9 commits into from
May 13, 2020

Conversation

@at15
Copy link
Member

@at15 at15 commented Feb 5, 2020 •
edited
Loading

Fix #21

  • read the paper
  • survey other databases
  • time compression, double delta
  • value compression
  • test compression ratio (might put it to xephon-b)

@at15
[compression][gorilla] Add notes from paper & time
d479841 
- implemented (or copied) the double delta for time
@at15 at15 added this to the 0.0.2 milestone Feb 5, 2020
@at15 at15 self-assigned this Feb 5, 2020
at15 added 8 commits February 4, 2020 20:14
@at15
go mod tidy
208126c
@at15
[compression][gorilla] Add ref and bit reader
1bb4acc 
- can't follow bstream in go-tsz, it modfies bit when read
@at15
[compression][gorilla] Keep original stream in bit reader
e01c96b 
- Actually I feel it's easier to read ... not sure why go-tsz did it
that way ...
@at15
[compress][gorilla] Faied to read neagtive double delta
acf8b68 
- when read dod out, first need to convert it from uint64 to int64, it
seems it works for writing negative value directly but didn't work when
writing the example figure 2
@at15
[compression][gorilla] Fix set remain to 0 instead of 8
a6693fb 
- after moving the buffer, the remaining bytes is 8 instead of 0 ...
@at15
[doc] Add survey for prometheus encode
64aa547 
- [log] Add survey on primitive types, covered endianess
@at15
[log] Continue survey on primitive types
47f8313 
- when converting from uint to int, the underlying bits are not changed
- signed integer is using two's complement, the actual value is the sum
of 2^(64-1) + rest 63 bits, the MSB is not only a sign i.e. not sign
magnitude
@at15
[play] Add float point
7308387
@at15 at15 mentioned this pull request May 13, 2020
Open
@at15 at15 changed the title [WIP][compression][gorilla] Add survey and implementation for facebook gorilla [Partial][compression][gorilla] Add survey and implementation for facebook gorilla May 13, 2020
@at15 at15 merged commit 2b4493f into master May 13, 2020
@at15 at15 deleted the compression/gorilla/survey branch May 13, 2020 10:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@at15 at15

Labels

None yet

Projects

None yet

Milestone

0.0.2

Development

Successfully merging this pull request may close these issues.

[compression][survey] Survey and write about facebook gorilla compression

2 participants

@at15