Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Indexer fixes and improvements #758

Merged
merged 40 commits into from
May 16, 2019
Merged

Indexer fixes and improvements #758

merged 40 commits into from
May 16, 2019

Commits on May 15, 2019

  1. indexer: add module indexer

    module indexer introduces a extensible architecture for indexing the
    chain. It provides a base class which handles syncing with the chain,
    handling re-orgs, interruptions, dynamic toggling, etc. TXIndexer
    and AddrIndexer are provided for indexing transactions and addresses,
    using the same flags as before i.e --index-tx and --index-address.
    Indexes are stored in a different database and can be maintained
    independently of the chain.
    tuxcanfly authored and braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    05794f5 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    33de39c View commit details
    Browse the repository at this point in the history
  3. changelog: add indexer to changelog

    tuxcanfly authored and braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    51ac4a7 View commit details
    Browse the repository at this point in the history
  4. indexer: work with blockstore

    tuxcanfly authored and braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    9f89c79 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    f9aab08 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    8bff122 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    b9e8c7b View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    05d55ef View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    7dc55c9 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    32904c7 View commit details
    Browse the repository at this point in the history
  11. migrate: update chaindb5to6 migration

    tuxcanfly authored and braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    7342952 View commit details
    Browse the repository at this point in the history
  12. chaindb: bump to v6

    tuxcanfly authored and braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    9f86dbc View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    aa3f02d View commit details
    Browse the repository at this point in the history
  14. addrindexer: index by address prefix

    tuxcanfly authored and braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    e2a6a92 View commit details
    Browse the repository at this point in the history
  15. indexer: fix, simplify and rewrite indexer base

    - Write indexer state and index atomically.
    - Simplify chain state with current height.
    - Roll forward to best height.
    - Synchronize the index with the chain with common method `sync` for
      the events 'connect', 'disconnect' and 'reset'. This will prevent
      any of the events from conflicting with each other.
    - Fix the chain rollback and reset.
    - Make sure blocks are connected in the correct order.
    - Improve logging to log similar to chain.
    braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    93c6ff8 View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    ebc40a5 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    06ef0e3 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    4c8f11e View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    bd26dbf View commit details
    Browse the repository at this point in the history
  20. node: add http indexer info

    braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    bb79760 View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    b37ac59 View commit details
    Browse the repository at this point in the history
  22. test: add mempool index persistence test

    nodech authored and braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    80aaa14 View commit details
    Browse the repository at this point in the history
  23. test: add mempool indexing tests

    nodech authored and braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    f30276b View commit details
    Browse the repository at this point in the history
  24. Configuration menu
    Copy the full SHA
    fae647b View commit details
    Browse the repository at this point in the history
  25. Configuration menu
    Copy the full SHA
    69e9844 View commit details
    Browse the repository at this point in the history
  26. test: improve addrindex tests

    - Vectors for p2wsh and p2sh.
    - Edge case for witness program.
    - Improve determinism by not comparing mtime.
    - Various edge and error cases.
    braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    b4be857 View commit details
    Browse the repository at this point in the history
  27. Configuration menu
    Copy the full SHA
    865f740 View commit details
    Browse the repository at this point in the history
  28. Configuration menu
    Copy the full SHA
    efb2551 View commit details
    Browse the repository at this point in the history
  29. Configuration menu
    Copy the full SHA
    5d18f9b View commit details
    Browse the repository at this point in the history
  30. Configuration menu
    Copy the full SHA
    cede31d View commit details
    Browse the repository at this point in the history
  31. indexer: check that blocks are connected

    There was a rare case that a block could be incorrectly added to
    the indexer if the indexer was disabled during a reorg to a height
    that matched the height that was expected, and the `sync` method
    for the indexer wasn't called that would detect the reorg.
    braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    ed06c21 View commit details
    Browse the repository at this point in the history
  32. migrate: update latest migration

    tuxcanfly authored and braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    5111af0 View commit details
    Browse the repository at this point in the history
  33. Configuration menu
    Copy the full SHA
    677b45f View commit details
    Browse the repository at this point in the history
  34. Configuration menu
    Copy the full SHA
    a6fd1be View commit details
    Browse the repository at this point in the history
  35. Configuration menu
    Copy the full SHA
    ce16bc9 View commit details
    Browse the repository at this point in the history
  36. Configuration menu
    Copy the full SHA
    372b9f9 View commit details
    Browse the repository at this point in the history
  37. blockchain: cleanup deprecated methods

    Deprecation details are in CHANGELOG.md
    braydonf committed May 15, 2019
    Configuration menu
    Copy the full SHA
    662a68c View commit details
    Browse the repository at this point in the history

Commits on May 16, 2019

  1. Configuration menu
    Copy the full SHA
    34e8f22 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7e9d00a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    6c497d4 View commit details
    Browse the repository at this point in the history