vec0 module not loaded in worker connections (Windows) — embeddings reindex fails with "no such module: vec0" #767

Activity

1. phernandez

   added

   bugSomething isn't workingSomething isn't working

   on Apr 29, 2026
2. phernandez commented on Apr 29, 2026

   

   phernandez

   on Apr 29, 2026

   Member

   More actions

   Thanks for the detailed reports — and special thanks to @mrhoga for tracing the exact bypass path in search_service.py. That diagnosis was correct for v0.20.3.

   Status on main

   The specific code path you identified has already been refactored. In v0.20.3, _purge_stale_search_rows ran the embedding cleanup via self.repository.execute_query(...), which pulled a fresh connection from the SQLAlchemy pool with no vec0 loaded — exactly the failure mode you described.

   On main, that branch was rewritten in PR #731 to delegate to a new method on the repository:

   src/basic_memory/services/search_service.py:599-610 (current main):

   # SQLite vec has no CASCADE — must delete embeddings before chunks
   if isinstance(self.repository, SQLiteSearchRepository):
       await self.repository.delete_stale_vector_rows()
   else:
       # Postgres CASCADE handles embedding deletion automatically
       await self.repository.execute_query(...)

   And delete_stale_vector_rows opens its own session and loads sqlite-vec before issuing the DELETE — src/basic_memory/repository/sqlite_search_repository.py:591-619:

   async def delete_stale_vector_rows(self) -> None:
       await self._ensure_vector_tables()
       async with db.scoped_session(self.session_maker) as session:
           await self._ensure_sqlite_vec_loaded(session)   # <-- the missing piece in 0.20.3
           ...
           await session.execute(
               text("DELETE FROM search_vector_embeddings WHERE rowid IN (...)"),
               params,
           )

   The wider invariant (every method that touches vec0 must load sqlite-vec on its own session) is now consistent across the repository — _ensure_sqlite_vec_loaded is called in delete_stale_vector_rows, _ensure_vector_tables, and the per-entity vector sync paths.

   Suggested next step

   Could you re-test against main (or wait for the next release after v0.20.3)? The existing integration test test_reindex_vectors (tests/services/test_search_service.py:1213) exercises the full reindex_vectors → _purge_stale_search_rows → delete_stale_vector_rows chain end-to-end with semantic enabled, which is what your reproduction hits.

   If bm reindex --embeddings still fails for you on main, please reopen with the new traceback — the only ways the failure could survive that refactor are (a) a different vec0-touching SQL still routed through execute_query, or (b) _ensure_sqlite_vec_loaded failing silently on Windows. Both would be useful to see.

   I'll close as fixed pending the next release. @andrewmautone — your "side note" about bm project default is a real separate issue; please do file it if you have a moment.
3. phernandez commented on Apr 29, 2026

   

   phernandez

   on Apr 29, 2026

   Member

   More actions

   Duplicate of #735 — same root cause, fixed on main. Closing.
4. phernandez

   closed this as completedon Apr 29, 2026