[bug] Unable to create initial user in multi-node Eloqdoc cluster when auth is enabled

[starrysky9959]

What happened?

When deploying a multi-node Eloqdoc cluster with Authentication enabled, the cluster fails to initialize properly.
According to MongoDB security rules, when authentication is enabled on a fresh instance, the system only allows connections via the localhost exception for the initial user creation. In a containerized multi-node setup, once the nodes are networked together, accessing the instance via localhost to perform this "createUser" will crash the node.

Steps to Reproduce

1. Deploy a 3-node Eloqdoc cluster with authorization enabled.

security:
  authorization: "enabled"

2. connect to a node via localhost and try to create a user.

Environment

• OS: Ubuntu
• Version: EloqDoc 0.2.8 with EloqStore
• Any other relevant details:

[coderabbitai]

📝 CodeRabbit Plan Mode

Generate an implementation plan and prompts that you can use with your favorite coding agent.

• Create Plan

Examples

• Example 1
• Example 2

_{You can configure auto-planning by selecting labels in the issue_enrichment configuration.}

🔗 Similar Issues

Related Issues

• [Bug]: Fix cluster start failure after bootstrap with built-in log service tx_service#264
• [Bug] EloqDoc hangs on jepsen test #129
• Failed to connect eloqdoc on jepsen test #266
• The elqdoc instance cannot be connected #313

👤 Suggested Assignees

• lokax
• githubzilla
• lininsoft

---

🧪 Issue enrichment is currently in open beta.

To disable automatic issue enrichment, add the following to your .coderabbit.yaml:

issue_enrichment:
  auto_enrich:
    enabled: false

💬 Have feedback or questions? Drop into our discord or schedule a call!

[xiexiaoy]

(gdb) bt
#0  std::__shared_ptr<mongo::transport::Session, (__gnu_cxx::_Lock_policy)2>::operator bool (this=0x18) at /usr/include/c++/13/bits/shared_ptr_base.h:1669
#1  std::operator!=<mongo::transport::Session>(std::shared_ptr<mongo::transport::Session> const&, decltype(nullptr)) (__a=...) at /usr/include/c++/13/bits/shared_ptr.h:595
#2  mongo::Client::hasRemote (this=0x0) at src/mongo/db/client.h:110
#3  mongo::Client::getIsLocalHostConnection (this=0x0) at src/mongo/db/client.h:103
#4  mongo::AuthzSessionExternalStateServerCommon::shouldAllowLocalhost (this=<optimized out>) at src/mongo/db/auth/authz_session_external_state_server_common.cpp:87
#5  0x00007fdcf269a863 in mongo::initializeOperationSessionInfo (opCtx=opCtx@entry=0x507d8070140, requestBody=..., requiresAuth=<optimized out>, isReplSetMemberOrMongos=isReplSetMemberOrMongos@entry=false, supportsDocLocking=supportsDocLocking@entry=true)
    at src/mongo/db/initialize_operation_session_info.cpp:76
#6  0x00007fdcf031272e in mongo::(anonymous namespace)::execCommandDatabase (opCtx=0x507d8070140, command=command@entry=0x7fdcef702f80 <mongo::(anonymous namespace)::findCmd>, request=..., replyBuilder=0x507d80f0090, behaviors=...) at src/mongo/db/service_entry_point_common.cpp:673
#7  0x00007fdcf03149f3 in operator() (__closure=__closure@entry=0x7fdceaff4440) at src/mongo/db/service_entry_point_common.cpp:1069
#8  0x00007fdcf03153c8 in mongo::(anonymous namespace)::receivedCommands (behaviors=..., message=..., opCtx=0x507d8070140) at src/mongo/db/service_entry_point_common.cpp:1084
#9  mongo::ServiceEntryPointCommon::handleRequest (opCtx=0x507d8070140, m=..., behaviors=...) at src/mongo/db/service_entry_point_common.cpp:1390
#10 0x00007fdcf37c52c4 in mongo::ServiceEntryPointMongod::handleRequest (this=<optimized out>, opCtx=<optimized out>, m=...) at src/mongo/db/service_entry_point_mongod.cpp:123
#11 0x00007fdcf139a767 in mongo::(anonymous namespace)::loopbackBuildResponse (opCtx=0x507d8070140, lastError=0x7fdceaff4d18, toSend=...) at src/mongo/db/dbdirectclient.cpp:145
#12 0x00007fdcf139a816 in mongo::DBDirectClient::call (this=<optimized out>, toSend=..., response=..., assertOk=<optimized out>, actualServer=<optimized out>) at src/mongo/db/dbdirectclient.cpp:150
#13 0x00007fdcf137ae4a in mongo::DBClientCursor::init (this=this@entry=0x507d80c0180) at src/mongo/client/dbclientcursor.cpp:159
#14 0x00007fdcf136b942 in mongo::DBClientBase::query (this=0x7fdceaff4ca0, ns=..., query=..., nToReturn=0, nToSkip=0, fieldsToReturn=0x7fdceaff4e20, queryOptions=0, batchSize=0) at src/mongo/client/dbclient.cpp:731
#15 0x00007fdcf1399ed1 in mongo::DBDirectClient::query (this=<optimized out>, ns=..., query=..., nToReturn=<optimized out>, nToSkip=<optimized out>, fieldsToReturn=0x7fdceaff4e20, queryOptions=0, batchSize=0) at src/mongo/db/dbdirectclient.cpp:170
#16 0x00007fdcf136ba0c in mongo::DBClientBase::query(std::function<void (mongo::DBClientCursorBatchIterator&)>, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, mongo::Query, mongo::BSONObj const*, int) (this=<optimized out>, f=..., ns=..., query=..., 
    fieldsToReturn=<optimized out>, queryOptions=<optimized out>) at src/mongo/client/dbclient.cpp:774
#17 0x00007fdcf136a2ca in mongo::DBClientBase::query(std::function<void (mongo::BSONObj const&)>, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, mongo::Query, mongo::BSONObj const*, int) (this=this@entry=0x7fdceaff4ca0, f=..., ns=..., query=..., 
    fieldsToReturn=fieldsToReturn@entry=0x7fdceaff4e20, queryOptions=queryOptions@entry=0) at src/mongo/client/dbclient.cpp:763
#18 0x00007fdcf23ff1f4 in mongo::AuthzManagerExternalStateMongod::query(mongo::OperationContext*, mongo::NamespaceString const&, mongo::BSONObj const&, mongo::BSONObj const&, std::function<void (mongo::BSONObj const&)> const&) (this=<optimized out>, opCtx=<optimized out>, collectionName=..., 
    query=..., projection=..., resultProcessor=...) at src/mongo/db/auth/authz_manager_external_state_d.cpp:70
#19 0x00007fdcf0f4cb83 in mongo::AuthzManagerExternalStateLocal::_initializeRoleGraph (this=0x506d8ba7200, opCtx=0x507d8070140) at src/mongo/db/auth/authz_manager_external_state_local.cpp:497
#20 0x00007fdcf0f4cf69 in mongo::AuthzManagerExternalStateLocal::initialize (this=<optimized out>, opCtx=<optimized out>) at src/mongo/db/auth/authz_manager_external_state_local.cpp:52
#21 0x00007fdcf0f1f6c4 in mongo::AuthorizationManagerImpl::initialize (this=0x506d8dd1e00, opCtx=0x507d8070140) at src/mongo/db/auth/authorization_manager_impl.cpp:591
#22 0x00007fdcef8c7e66 in operator() (__closure=0x50706aa04b8) at src/mongo/db/modules/eloq/src/eloq_kv_engine.cpp:648
#23 0x00007fdcef8c809a in std::__invoke_impl<bool, mongo::MongoSystemHandler::ReloadCache(std::function<void(bool)>)::<lambda()>&> (__f=...) at /usr/include/c++/13/bits/invoke.h:61
#24 std::__invoke_r<bool, mongo::MongoSystemHandler::ReloadCache(std::function<void(bool)>)::<lambda()>&> (__fn=...) at /usr/include/c++/13/bits/invoke.h:114
#25 operator() (__closure=<optimized out>) at /usr/include/c++/13/future:1491
#26 std::__future_base::_Task_setter<std::unique_ptr<std::__future_base::_Result<bool>, std::__future_base::_Result_base::_Deleter>, std::__future_base::_Task_state<mongo::MongoSystemHandler::ReloadCache(std::function<void(bool)>)::<lambda()>, std::allocator<int>, bool()>::_M_run()::<lambda()>, bool>::operator() (this=<optimized out>) at /usr/include/c++/13/future:1409
#27 std::__invoke_impl<std::unique_ptr<std::__future_base::_Result<bool>, std::__future_base::_Result_base::_Deleter>, std::__future_base::_Task_setter<std::unique_ptr<std::__future_base::_Result<bool>, std::__future_base::_Result_base::_Deleter>, std::__future_base::_Task_state<mongo::MongoSystemHandler::ReloadCache(std::function<void(bool)>)::<lambda()>, std::allocator<int>, bool()>::_M_run()::<lambda()>, bool>&> (__f=...) at /usr/include/c++/13/bits/invoke.h:61
#28 std::__invoke_r<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter>, std::__future_base::_Task_setter<std::unique_ptr<std::__future_base::_Result<bool>, std::__future_base::_Result_base::_Deleter>, std::__future_base::_Task_state<mongo::MongoSystemHandler::ReloadCache(std::function<void(bool)>)::<lambda()>, std::allocator<int>, bool()>::_M_run()::<lambda()>, bool>&> (__fn=...) at /usr/include/c++/13/bits/invoke.h:116
#29 std::_Function_handler<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter>(), std::__future_base::_Task_setter<std::unique_ptr<std::__future_base::_Result<bool>, std::__future_base::_Result_base::_Deleter>, std::__future_base::_Task_state<mongo::MongoSystemHandler::ReloadCache(std::function<void(bool)>)::<lambda()>, std::allocator<int>, bool()>::_M_run()::<lambda()>, bool> >::_M_invoke(const std::_Any_data &) (__functor=...) at /usr/include/c++/13/bits/std_function.h:291
#30 0x00007fdcef8cda92 in std::function<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> ()>::operator()() const (this=<optimized out>) at /usr/include/c++/13/bits/std_function.h:591
#31 std::__future_base::_State_baseV2::_M_do_set(std::function<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> ()>*, bool*) (this=0x50706aa0490, __f=<optimized out>, __did_set=0x7fdceaff540f) at /usr/include/c++/13/future:589
#32 0x00007fdcf34a1ed3 in __pthread_once_slow (once_control=0x50706aa04a8, init_routine=0x7fdcf38eb420 <std::__once_proxy()>) at ./nptl/pthread_once.c:116
#33 0x00007fdcef8c93fc in __gthread_once (__func=<optimized out>, __once=0x50706aa04a8) at /usr/include/x86_64-linux-gnu/c++/13/bits/gthr-default.h:700
#34 std::call_once<void (std::__future_base::_State_baseV2::*)(std::function<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> ()>*, bool*), std::__future_base::_State_baseV2*, std::function<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> ()>*, bool*>(std::once_flag&, void (std::__future_base::_State_baseV2::*&&)(std::function<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> ()>*, bool*), std::__future_base::_State_baseV2*&&, std::function<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> ()>*&&, bool*&&) (
    __f=@0x7fdceaff5450: (void (std::__future_base::_State_baseV2::*)(std::__future_base::_State_baseV2 * const, std::function<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter>()> *, bool *)) 0x7fdcef8cda60 <std::__future_base::_State_baseV2::_M_do_set(std::function<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> ()>*, bool*)>, __once=...) at /usr/include/c++/13/mutex:907
#35 std::__future_base::_State_baseV2::_M_set_result(std::function<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> ()>, bool) (__ignore_failure=false, __res=..., this=0x50706aa0490) at /usr/include/c++/13/future:428
#36 std::__future_base::_Task_state<mongo::MongoSystemHandler::ReloadCache(std::function<void(bool)>)::<lambda()>, std::allocator<int>, bool()>::_M_run (this=0x50706aa0490) at /usr/include/c++/13/future:1494
#37 std::packaged_task<bool ()>::operator()() (this=0x7fdceaff5440) at /usr/include/c++/13/future:1628
#38 operator() (__closure=0x506d80c2ee8) at src/mongo/db/modules/eloq/src/eloq_kv_engine.cpp:617
#39 std::__invoke_impl<void, mongo::MongoSystemHandler::MongoSystemHandler()::<lambda()> > (__f=...) at /usr/include/c++/13/bits/invoke.h:61
#40 std::__invoke<mongo::MongoSystemHandler::MongoSystemHandler()::<lambda()> > (__fn=...) at /usr/include/c++/13/bits/invoke.h:96
#41 std::thread::_Invoker<std::tuple<mongo::MongoSystemHandler::MongoSystemHandler()::<lambda()> > >::_M_invoke<0> (this=0x506d80c2ee8) at /usr/include/c++/13/bits/std_thread.h:292
#42 std::thread::_Invoker<std::tuple<mongo::MongoSystemHandler::MongoSystemHandler()::<lambda()> > >::operator() (this=0x506d80c2ee8) at /usr/include/c++/13/bits/std_thread.h:299
#43 std::thread::_State_impl<std::thread::_Invoker<std::tuple<mongo::MongoSystemHandler::MongoSystemHandler()::<lambda()> > > >::_M_run(void) (this=0x506d80c2ee0) at /usr/include/c++/13/bits/std_thread.h:244
#44 0x00007fdcf38ecdb4 in std::execute_native_thread_routine (__p=0x506d80c2ee0) at ../../../../../src/libstdc++-v3/src/c++11/thread.cc:104
#45 0x00007fdcf349caa4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:447
#46 0x00007fdcf3529c6c in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:78

[xiexiaoy]

Bypass creating index at restart server for the users collection temporarily for CP test.

[xiexiaoy]

Change it to backlog. Lack of an index for the user/role collection affects little.