Slow in a repo with large working tree

[rockyzhang24]

Hi, this plugin is awesome. Great ideas on filtering and sources, easy to customize and extend, and very active development. Thank you first.

To reproduce this issue:

1. Create a bare repo git init --bare $HOME/bare.git
2. In zshenv, set git env

   export GIT_DIR="$HOME/bare.git"
   export GIT_WORK_TREE="$HOME"

3. In a new shell, under $HOME, let's create a file, and commit it

   touch file1
   git add file1
   git commit -m "first commit"

4. Next, we open this file using Neovim. Then open neo-tree via :NeoTreeRevealToggle. Now it freezes there. After around 2~3 seconds, the neo-tree window opens.
5. Then with neo-tree window open, we modify this file. Finally we save it via :w. After pressing <ENTER>, Neovim freezes again.

It seems that neo-tree fetches the git info synchronously, so Neovim will block in a bare repo with a large working directory. Is it possible to deal with this situation?

Looking forward to your response, and thank you so much.

[cseickel]

I ran through the test and I don't have an issue if I follow the instructions exactly, but ti will freeze up if I open the bare.git directory.

This is a known issue with adding file watches to a git directory, because it throws off change events constantly. I have a check for .git directories where I skip adding watchers to those, but I hadn't come across the bare.git pattern before this.

Does this sound like it may be the issue?

If not, can you please include your neo-tree config and try capturing a log file with the instructions here: https://github.com/nvim-neo-tree/neo-tree.nvim/wiki/Troubleshooting#logs

[cseickel]

Oh, and thanks for the kind words!

[rockyzhang24]

Thank you.

Does this sound like it may be the issue

Maybe not. Let me make my example above clearer. :)

Throughout the process, I stay under $HOME directory. On step 4, I open this file by nvim file1. Then I run :NeoTreeShow. Neovim is stuck there for around 3 seconds until neo-tree window shows up. Next, I type something in this file, then I run :w, Neovim will be stuck again for a little while until [M] symbol shows next to the filename.

I will put a short video below for demo.

https://asciinema.org/a/elRuwAgal79z09hL5bWGIM9sC

can you please include your neo-tree config

I didn't config it. What I did is install neo-tree and nui and that's it.

I will attach the log info below

[DEBUG Tue Feb 15 06:59:28 2022] ...ig/nvim/pack/minpac/start/neo-tree.nvim/lua/neo-tree.lua:529: setup
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:44: Teardown autocmds for  vim_buffer_added
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:44: Teardown autocmds for  vim_buffer_changed
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:44: Teardown autocmds for  vim_buffer_deleted
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:44: Teardown autocmds for  vim_buffer_enter
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:44: Teardown autocmds for  vim_diagnostic_changed
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:44: Teardown autocmds for  vim_dir_changed
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:44: Teardown autocmds for  vim_tab_closed
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:44: Teardown autocmds for  vim_win_enter
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:170: Creating queue for event: vim_buffer_enter
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:39: Registering autocmds: %s augroup NeoTreeEvent_vim_buffer_enter
autocmd BufEnter,BufWinEnter * :lua require('neo-tree.events').fire_event('vim_buffer_enter', { afile = vim.fn.expand('<afile>') })
augroup END
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:177: Setup for event vim_buffer_enter was run
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ nil ] for event:  vim_buffer_enter
[DEBUG Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:445: filesystem  setup  {
  bind_to_cwd = true,
  commands = {
    add = <function 1>,
    clear_filter = <function 2>,
    close_all_nodes = <function 3>,
    close_node = <function 4>,
    close_window = <function 5>,
    ...
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: filesystem.before_render
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:170: Creating queue for event: before_render
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ filesystem.before_render ] for event:  before_render
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: filesystem.vim_buffer_changed
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:170: Creating queue for event: vim_buffer_changed
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:39: Registering autocmds: %s augroup NeoTreeEvent_vim_buffer_changed
autocmd BufWritePost,BufFilePost * :lua require('neo-tree.events').fire_event('vim_buffer_changed', { afile = vim.fn.expand('<afile>') })
augroup END
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:177: Setup for event vim_buffer_changed was run
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ filesystem.vim_buffer_changed ] for event:  vim_buffer_changed
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: filesystem.vim_dir_changed
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:170: Creating queue for event: vim_dir_changed
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:39: Registering autocmds: %s augroup NeoTreeEvent_vim_dir_changed
autocmd DirChanged * :lua require('neo-tree.events').fire_event('vim_dir_changed', { afile = vim.fn.expand('<afile>') })
augroup END
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:177: Setup for event vim_dir_changed was run
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ filesystem.vim_dir_changed ] for event:  vim_dir_changed
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: filesystem.vim_diagnostic_changed
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:170: Creating queue for event: vim_diagnostic_changed
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:39: Registering autocmds: %s augroup NeoTreeEvent_vim_diagnostic_changed
autocmd DiagnosticChanged * :lua require('neo-tree.events').fire_event('vim_diagnostic_changed', { afile = vim.fn.expand('<afile>') })
augroup END
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:177: Setup for event vim_diagnostic_changed was run
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ filesystem.vim_diagnostic_changed ] for event:  vim_diagnostic_changed
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: filesystem.vim_tab_closed
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:170: Creating queue for event: vim_tab_closed
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:39: Registering autocmds: %s augroup NeoTreeEvent_vim_tab_closed
autocmd TabClosed * :lua require('neo-tree.events').fire_event('vim_tab_closed', { afile = vim.fn.expand('<afile>') })
augroup END
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:177: Setup for event vim_tab_closed was run
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ filesystem.vim_tab_closed ] for event:  vim_tab_closed
[DEBUG Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:445: buffers  setup  {
  bind_to_cwd = true,
  commands = {
    add = <function 1>,
    buffer_delete = <function 2>,
    close_node = <function 3>,
    close_window = <function 4>,
    copy_to_clipboard = <function 5>,
 ...
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: buffers.before_render
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ buffers.before_render ] for event:  before_render
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: buffers.vim_buffer_changed
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ buffers.vim_buffer_changed ] for event:  vim_buffer_changed
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: buffers.vim_buffer_added
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:170: Creating queue for event: vim_buffer_added
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:39: Registering autocmds: %s augroup NeoTreeEvent_vim_buffer_added
autocmd BufAdd * :lua require('neo-tree.events').fire_event('vim_buffer_added', { afile = vim.fn.expand('<afile>') })
augroup END
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:177: Setup for event vim_buffer_added was run
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ buffers.vim_buffer_added ] for event:  vim_buffer_added
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: buffers.vim_buffer_deleted
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:170: Creating queue for event: vim_buffer_deleted
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:39: Registering autocmds: %s augroup NeoTreeEvent_vim_buffer_deleted
autocmd BufDelete * :lua require('neo-tree.events').fire_event('vim_buffer_deleted', { afile = vim.fn.expand('<afile>') })
augroup END
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:177: Setup for event vim_buffer_deleted was run
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ buffers.vim_buffer_deleted ] for event:  vim_buffer_deleted
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: buffers.vim_dir_changed
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ buffers.vim_dir_changed ] for event:  vim_dir_changed
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: buffers.vim_diagnostic_changed
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ buffers.vim_diagnostic_changed ] for event:  vim_diagnostic_changed
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: buffers.vim_tab_closed
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ buffers.vim_tab_closed ] for event:  vim_tab_closed
[DEBUG Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:445: git_status  setup  {
  commands = {
    add = <function 1>,
    close_node = <function 2>,
    close_window = <function 3>,
    copy_to_clipboard = <function 4>,
    cut_to_clipboard = <function 5>,
    delete = <functi...
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: git_status.vim_buffer_changed
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ git_status.vim_buffer_changed ] for event:  vim_buffer_changed
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: git_status.vim_diagnostic_changed
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ git_status.vim_diagnostic_changed ] for event:  vim_diagnostic_changed
[TRACE Tue Feb 15 06:59:28 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:136: subscribing to event: git_status.vim_tab_closed
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ git_status.vim_tab_closed ] for event:  vim_tab_closed
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:170: Creating queue for event: vim_win_enter
[TRACE Tue Feb 15 06:59:28 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/events/init.lua:39: Registering autocmds: %s augroup NeoTreeEvent_vim_win_enter
autocmd WinEnter * :lua require('neo-tree.events').fire_event('vim_win_enter', { afile = vim.fn.expand('<afile>') })
augroup END
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:177: Setup for event vim_win_enter was run
[DEBUG Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:184: Adding event handler [ neo-tree-win-enter ] for event:  vim_win_enter
[TRACE Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  {
  event = "vim_buffer_enter",
  handler = <function 1>
}  for vim_buffer_enter called successfully.
[TRACE Tue Feb 15 06:59:28 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  {
  event = "vim_buffer_enter",
  handler = <function 1>
}  for vim_buffer_enter called successfully.
[TRACE Tue Feb 15 06:59:29 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  {
  event = "vim_buffer_enter",
  handler = <function 1>
}  for vim_buffer_enter called successfully.
[TRACE Tue Feb 15 06:59:29 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  {
  event = "vim_buffer_enter",
  handler = <function 1>
}  for vim_buffer_enter called successfully.
[TRACE Tue Feb 15 06:59:30 2022] ...t/neo-tree.nvim/lua/neo-tree/sources/filesystem/init.lua:287: refreshing due to vim_buffer_changed event:  [Wilder Float 1]
[TRACE Tue Feb 15 06:59:30 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  filesystem.vim_buffer_changed  for vim_buffer_changed called successfully.
[TRACE Tue Feb 15 06:59:30 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  buffers.vim_buffer_changed  for vim_buffer_changed called successfully.
[TRACE Tue Feb 15 06:59:30 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  git_status.vim_buffer_changed  for vim_buffer_changed called successfully.
[TRACE Tue Feb 15 06:59:33 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:307: navigate filesystem nil nil
[TRACE Tue Feb 15 06:59:33 2022] ...t/neo-tree.nvim/lua/neo-tree/sources/filesystem/init.lua:166: navigate nil nil
[TRACE Tue Feb 15 06:59:33 2022] ...t/neo-tree.nvim/lua/neo-tree/sources/filesystem/init.lua:112: navigate_internal nil nil nil
[DEBUG Tue Feb 15 06:59:33 2022] ...t/neo-tree.nvim/lua/neo-tree/sources/filesystem/init.lua:116: navigate_internal: path is nil, using cwd
[DEBUG Tue Feb 15 06:59:33 2022] ...t/neo-tree.nvim/lua/neo-tree/sources/filesystem/init.lua:120: navigate_internal: path changed from  nil  to  /Users/rockyzhang
[TRACE Tue Feb 15 06:59:33 2022] ...t/neo-tree.nvim/lua/neo-tree/sources/filesystem/init.lua:148: navigate_internal: position saved
[DEBUG Tue Feb 15 06:59:33 2022] ...ree.nvim/lua/neo-tree/sources/filesystem/lib/fs_scan.lua:173: Not unwatching folders... use_libuv_file_watcher is  false  and state.tree is  false
[TRACE Tue Feb 15 06:59:36 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  filesystem.before_render  for before_render called successfully.
[TRACE Tue Feb 15 06:59:36 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  buffers.before_render  for before_render called successfully.
[TRACE Tue Feb 15 06:59:36 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  neo-tree-win-enter  for vim_win_enter called successfully.
[TRACE Tue Feb 15 06:59:36 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  {
  event = "vim_buffer_enter",
  handler = <function 1>
}  for vim_buffer_enter called successfully.
[TRACE Tue Feb 15 06:59:36 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  {
  event = "vim_buffer_enter",
  handler = <function 1>
}  for vim_buffer_enter called successfully.
[DEBUG Tue Feb 15 06:59:36 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/ui/renderer.lua:395: Setting expanded nodes
[DEBUG Tue Feb 15 06:59:36 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/ui/renderer.lua:351: No node_id to restore to
[TRACE Tue Feb 15 06:59:36 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  neo-tree-win-enter  for vim_win_enter called successfully.
[TRACE Tue Feb 15 06:59:36 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  {
  event = "vim_buffer_enter",
  handler = <function 1>
}  for vim_buffer_enter called successfully.
[TRACE Tue Feb 15 06:59:36 2022] ...t/neo-tree.nvim/lua/neo-tree/sources/filesystem/init.lua:284: Ignoring vim_buffer_changed event from filesystem
[TRACE Tue Feb 15 06:59:36 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  filesystem.vim_buffer_changed  for vim_buffer_changed called successfully.
[TRACE Tue Feb 15 06:59:36 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  buffers.vim_buffer_changed  for vim_buffer_changed called successfully.
[TRACE Tue Feb 15 06:59:36 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  git_status.vim_buffer_changed  for vim_buffer_changed called successfully.
[TRACE Tue Feb 15 06:59:39 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  {
  event = "vim_buffer_enter",
  handler = <function 1>
}  for vim_buffer_enter called successfully.
[TRACE Tue Feb 15 06:59:39 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  {
  event = "vim_buffer_enter",
  handler = <function 1>
}  for vim_buffer_enter called successfully.
[TRACE Tue Feb 15 06:59:39 2022] ...t/neo-tree.nvim/lua/neo-tree/sources/filesystem/init.lua:287: refreshing due to vim_buffer_changed event:  file1
[TRACE Tue Feb 15 06:59:39 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:327: filesystem  refresh
[TRACE Tue Feb 15 06:59:39 2022] ...pac/start/neo-tree.nvim/lua/neo-tree/sources/manager.lua:307: navigate filesystem /Users/rockyzhang nil
[TRACE Tue Feb 15 06:59:39 2022] ...t/neo-tree.nvim/lua/neo-tree/sources/filesystem/init.lua:166: navigate /Users/rockyzhang nil
[TRACE Tue Feb 15 06:59:39 2022] ...t/neo-tree.nvim/lua/neo-tree/sources/filesystem/init.lua:112: navigate_internal left /Users/rockyzhang nil
[TRACE Tue Feb 15 06:59:39 2022] ...t/neo-tree.nvim/lua/neo-tree/sources/filesystem/init.lua:148: navigate_internal: position saved
[DEBUG Tue Feb 15 06:59:39 2022] ...ree.nvim/lua/neo-tree/sources/filesystem/lib/fs_scan.lua:173: Not unwatching folders... use_libuv_file_watcher is  false  and state.tree is  false
[TRACE Tue Feb 15 06:59:41 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  filesystem.vim_buffer_changed  for vim_buffer_changed called successfully.
[TRACE Tue Feb 15 06:59:41 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  buffers.vim_buffer_changed  for vim_buffer_changed called successfully.
[TRACE Tue Feb 15 06:59:41 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  git_status.vim_buffer_changed  for vim_buffer_changed called successfully.
[TRACE Tue Feb 15 06:59:41 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  filesystem.before_render  for before_render called successfully.
[TRACE Tue Feb 15 06:59:41 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  buffers.before_render  for before_render called successfully.
[TRACE Tue Feb 15 06:59:41 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/ui/renderer.lua:611: Preserving expanded nodes
[DEBUG Tue Feb 15 06:59:41 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/ui/renderer.lua:395: Setting expanded nodes
[DEBUG Tue Feb 15 06:59:41 2022] .../minpac/start/neo-tree.nvim/lua/neo-tree/ui/renderer.lua:355: Restoring position to node_id: /Users/rockyzhang
[TRACE Tue Feb 15 06:59:42 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  {
  event = "vim_buffer_enter",
  handler = <function 1>
}  for vim_buffer_enter called successfully.
[TRACE Tue Feb 15 06:59:42 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  {
  event = "vim_buffer_enter",
  handler = <function 1>
}  for vim_buffer_enter called successfully.
[TRACE Tue Feb 15 06:59:44 2022] ...minpac/start/neo-tree.nvim/lua/neo-tree/events/queue.lua:130: Handler  neo-tree-win-enter  for vim_win_enter called successfully.

Thanks a lot.

Update:
Even if I disabled enable_git_status, this issue still remained. It seems that this issue exists as long as the working tree is very large, e.g., $HOME.

Another experiment:
In the shell rc file, only set GIT_WORK_TREE like export GIT_WORK_TREE="$HOME". Then cd into any normal git repo, and open any file in the repo via Neovim. Then run :NeoTreeShow. It can be observed that the issue appears again. So probably I can conclude that this issue is caused by setting the git work tree to a very large directory.

Thank you very much.

[cseickel]

I think the problem is with the respect_gitignore setting. Can you try disabling that with:

      require("neo-tree").setup({
        filesystem = {
          filters = {
            respect_gitignore = false,
          }
        }
      })

and letting me know if that fixes the problem?

if it does we may be able to throttle or cache that check.

[cseickel]

Here is the command that is actually run to get the ignored files:

git --no-optional-locks status --porcelain=v1 --ignored=matching --untracked-files=normal

[rockyzhang24]

Thanks.

letting me know if that fixes the problem?

I can confirm that after setting respect_gitignore = false, the issue is totally solved and neo-tree is so smooth and responsive with a large git working tree. Awesome.
However, sometimes respect_gitignore = true is still useful for a repo with a large working tree. Is it possible to fix this to make neo-tree has good performance even if respect_gitignore set to true?

Thanks a lot.

[cseickel]

Is it possible to fix this to make neo-tree has good performance even if respect_gitignore set to true?

Maybe, I will try out different strategies and see if there is a better way. We may have to add options that trade accuracy for performance. The built-in plenary filter that we used to use is likely better performing in this situation, but not always accurate.

The hard part was figuring out exactly where the issue was. The rest should be downhill from here.

[rockyzhang24]

It makes sense. Thank you very much for developing and maintaining this plugin. I will use it with respect_gitignore = false and looking forward to your new strategies to see whether this can be solved.

[rockyzhang24]

Or is it possible to make the process of checking gitignore asynchronous?
neo-tree could open a window containing all files and check the gitignore in the background. After finishing, update the tree to filter out the entries in gitignore.

[cseickel]

You know, I checked out the linux repo, which is insanely huge, and I had no performance issues. I think the problem with the bare repo as you have configured it is that there is a large amount of untracked but eligible files. I bet if you just add an appropriate .gitignore file that would solve the issue. In this case, you might want to .gitignore everything and then only track what you explicitly add, or add an exclusion just for certain folders which you do actually want to track.

If you are using the bare repo for dotfile management, I would highlly recommend using dotbot instead.

I'll still add an alternative respect_ignore option, but I also wanted to throw this out there.

[cseickel]

... but if you do keep your bare repo as-is, update to the latest in main and add this option to enable the alternative gitignore logic:

      require("neo-tree").setup({
        filesystem = {
          filters = {
            respect_gitignore = true,
            gitignore_source = "plenary"
          }
        }
      })

[rockyzhang24]

Thank you so much for you help and suggestions.

You know, I checked out the linux repo, which is insanely huge, and I had no performance issues.

Lol, yesterday I tested it with linux repo (more than 5GB) as well. I opened the Makefile file under the root directory in linux and then run :NeoTreeReveal with respect_gitignore = true, the neo-tree window didn't show immediately after I pressed <ENTER>, and still had a hundreds of milliseconds latency time. I can feel it, even though it is not that noticeable. If I set respect_gitignore = false, I felt a little improvement, but it still had a very slight latency. If I run :NeoTreeReveal in a very small repo, the neo-tree window shows instantly. I thought linux repo is not large enough, because its actually files are just 1.1GB, .git is 4G. So the working tree of linux repo is not large actually. Then I did a further test.

In order to make the working tree large enough, in the shell rc file, I only set export GIT_WORK_TREE="$HOME". Then I opened a new shell and went back to the linux folder. This time linux repo has a very large working tree, the whole $HOME. Then, stay in linux folder, I tried to open a file like Makefile, and run :NeoTreeReveal. The performance issue appeared again, the latency time is very long, near 8s. Then I tried to set respect_gitignore = false, however, the latency was not gone, but relieved some, near 4s, and I don't know why the latency is not completely resolved. Could you please test this on your end?

In my original experiment, I set both GIT_DIR and GIT_WORK_TREE env. After setting respect_gitignore = false, the latency was resolved completely, and the neo-tree window shown instantly. I think the reason is that linux has lots of traced file, but my bare repo only has one tracked file, file1, right?

you might want to .gitignore everything and then only track what you explicitly add, or add an exclusion just for certain folders which you do actually want to track

But I need to see the whole structure of $HOME. I set showUntrackedFiles = no for the bare repo to hide all the untracked files for command like git status.

If you are using the bare repo for dotfile management

Yes, I am using bare repo to mange my dotfiles. And actually I set GIT_DIR=$HOME/dotfiles and GIT_WORK_TREE=$HOME", along with showUntrackedFiles = no`.

update to the latest in main and add this option to enable the alternative gitignore logic

I tried this option and the performance is great with respect_gitignore = true. Awesome. But this option has a low accuracy, right?

Sorry for this verbose reply, and really appreciate your patience for helping me debug this. :)