If you remember early bitcoin, some people would say it’s money, some people would say it’s gold. Some people would say it’s this blockchain … The way that I look at Bittensor is as the World Wide Web of AI.
it’s really rude of you to find and quote a paragraph designed to force me to take four shots in rapid succession in my ongoing crypto/AI drinking game!
How does Bittensor work? “When you have a question, you send it out to the network. Miners whose models are suited to answer your question will process it and send back a proposed answer.” The “miners” are rewarded with TAO tokens.
“what do you mean oracle problem? our new thing’s nothing but oracles, we just have to figure out a way to know they’re telling the truth!”
Bittensor is enormously proud to be decentralized, because that’s a concept that totally makes sense with AI models, right? “There is no greater story than people’s relentless and dogged endeavor to overcome repressive regimes,” starts Bittensor’s introduction page.
meme stock cults and crypto scams both should maybe consider keeping pseudo-leftist jargon out of their fucking mouths
also this is all horseshit so I know they haven’t thought this far ahead, but pushing a bit on the oracle problem, how do they think they solved these fundamental issues in their proposed design?
if verifying answers are correct is up to the miners, how do they prevent the miners from just generating any old bullshit using a much less expensive method than an LLM (a Markov chain say, or even just random characters or an empty string if nobody’s checking) and pocketing the tokens?
if verification is up to the requester, why would you ever mark an answer as correct? if you’re forced to pick one correct answer that gets your tokens, what’s stopping you from spinning up an adversarial miner that produces random answers and marking those as correct, ensuring you keep both your tokens and the other miners’ answers?
if answers are verified centrally… there’s no need for the miners or their models, just use whatever that central source of truth is.
and of course this is avoiding the elephant in the room: LLMs have no concept of truth, they just extrude plausible bullshit into a statistically likely shape. there’s no source of truth that can reliably distinguish bad LLM responses from good ones, and if you had one you’d probably be better off just using it instead of an LLM.
edit cause for some reason my brain can’t stop it with this fractally wrong shit: finally, if their plan is to just evenly distribute tokens across miners and return all answers: congrats on the “decentralized” network of /dev/urandom to string converters you weird fucks
another edit: I read the fucking spec and somehow it’s even stupider than any of the above. you can trivially just spend tokens to buy a majority of the validator slots for a subnet (which I guess in normal cultist lingo would be a subchain) and use that to kick out everyone else’s miners:
Only the top 64 validators, when ranked by their stake amount in any particular subnet, are considered to have a validator permit. Only these top 64 subnet validators with permits are considered active in the subnet.
a third edit, please help, my brain is melting: what does a non-adversarial validator even look like in this architecture? we can’t fucking verify LLM outputs like I said so… is this just multiple computers doing RAG and pretending that’s a good idea? is the idea that you run some kind of unbounded training algorithm and we also live in a universe where model overfitting doesn’t exist? help I am melting
you’re right, I’m giving them way too much credit — the full thought is almost definitely “There is no greater story than people’s relentless and dogged endeavor to overcome repressive regimes and replace them with their own repressive regimes, but this time with heroin and sex tourism”