-
Notifications
You must be signed in to change notification settings - Fork 3
Open
Labels
Description
if you're hosting a local LLM and you're connected to the internet, you should be able to sell inference to ObjectiveAI
it's like mining bitcoin with your Mac Mini
add the way to do it to this repo
btw the problems that may be normally associated with decentralized inference with regards to LLMs such as reliability and early stream failures isn't really relevant for ObjectiveAI vector completions
also the fact that we have a service which actually leverages the might of many tiny LLMs means we can actually use decentralized power
Reactions are currently unavailable