Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

clique_percolation takes enormous memory and never finishes on a large graph #299

Open
wangyi91 opened this issue Sep 13, 2023 · 1 comment
Labels
enhancement New feature or request

Comments

@wangyi91
Copy link

wangyi91 commented Sep 13, 2023

Description of bug
Hello, I was using the clique_percolation function to detect communities. It works for some of my networks, but for some other a bit more complicated ones, e.g. with 25376 connections between 2646 nodes, I found that the computation is using enormous amount of memory and simply won't finish. May I ask if this could possibly be a bug? Thank you for helping.

How to reproduce
Here I upload a network of mine in .jld2 format. You can simply unzip and read it in as
netw=load_object("network.local.jld2")
and transform it to graph using g=graph(netw). The computation I attempted is clique_percolation(g, k=3)

Expected behavior
Output results within a few hours or even minutes.

Actual behavior
Taking large memory (100+G) and never finishing.

Code demonstrating bug

netw=load_object("network.local.jld2")
g=graph(netw)
clique_percolation(g, k=3)

Additional context
Attachment:
network.local.jld2.gz

@wangyi91 wangyi91 added the bug Something isn't working label Sep 13, 2023
@gdalle gdalle changed the title [BUG] [BUG] clique_percolation never finishes Sep 13, 2023
@wangyi91 wangyi91 changed the title [BUG] clique_percolation never finishes clique_percolation takes enormous memory and never finishes[BUG] Sep 13, 2023
@gdalle gdalle changed the title clique_percolation takes enormous memory and never finishes[BUG] [BUG] clique_percolation takes enormous memory and never finishes Sep 14, 2023
@gdalle gdalle added enhancement New feature or request and removed bug Something isn't working labels Sep 18, 2023
@gdalle gdalle changed the title [BUG] clique_percolation takes enormous memory and never finishes clique_percolation takes enormous memory and never finishes on a large graph Sep 18, 2023
@gdalle
Copy link
Member

gdalle commented Sep 18, 2023

This is an exponential time algorithm because it relies on the search for maximal cliques. Therefore, on large graphs, it is expected to perform badly. However, the original article on clique percolation seems to analyze graphs larger than that.
Do you want to try and dig in, see if you can find the source of inefficiency?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants