d like to suggest adding support for distributed inference, similar to how EXO or LocalAI handle clusters. Right now, there isn't really an APK available that lets you link multiple Android phones into a single compute cluster. Most of us have a number of unused drawer phones that are still powerful but mostly just sit around. If this app could link them over a local network, we could use that collective power to run larger models or speed up generation without relying on the cloud bs, not sure how, not a programmer but seams like a untapped option and currently the only options have cumbersome and annoying termux installs. A simple AI cluster APK would be a swoon IMO
d like to suggest adding support for distributed inference, similar to how EXO or LocalAI handle clusters. Right now, there isn't really an APK available that lets you link multiple Android phones into a single compute cluster. Most of us have a number of unused drawer phones that are still powerful but mostly just sit around. If this app could link them over a local network, we could use that collective power to run larger models or speed up generation without relying on the cloud bs, not sure how, not a programmer but seams like a untapped option and currently the only options have cumbersome and annoying termux installs. A simple AI cluster APK would be a swoon IMO