do you have any weekend plans friday night city lights
Samu /人◕ ‿‿ ◕人\
not really im just vibing i should probably make plans or ill end up pissin it away well we been playing Valheim so thats been takjng my evenings mostly im currently coding a side project of mine that im happy with so far it involves e ink
Samu /人◕ ‿‿ ◕人\
what are you up to these days
Printer
I applied for a remote relationship manager position, turned out to be posing as onlyfans girls to chat for them
moon
>>1188330 im still in north carolina chillin at home with my partner and our cat workin from home with the data eval work and some other little gigs to get by im still gathering inspiration to put together some new music or something hopefully soon. i like making music in the autumns. it's kinda a rebirth period for me every year. im thinkin about what to cook for dinner tonight, maybe do a picnic by the beach or somethin fun
i been digging through my mind a lot lately i need to figure out some functional leverage to haul all those thoughts to the surface and externalize them somehow
e ink is cool what's it aboot
Samu /人◕ ‿‿ ◕人\
i dont want to reveal too much i think its better to keep stuff under wraps till its actually real otherwise talking about it can give uou the same reward feelings that actually making it real can
Samu /人◕ ‿‿ ◕人\
>>1188332 yea turning throught dreams into pithy words is a tricky thing eh
moon
>>1188333 that has always been how i felt as well, that talking about it would be an outlet fo //for all the motivation that id otherwise use to make it actually happen i had a friend who was a business major who always took the opposite approach though and would broadcast ideas as soon as he had him and he argued that it put social pressure on him to actually follow through if he did that
sounded legit but i think that only works for people who live and operate within that social substrate i dont so much
they should train a local-sized model to take bad human input and turn it into a Good Prompt for LLMs you just tell it what you want Claude to do, and it tells you what you should tell Claude
the wayfinder skill some guy made is real damn handy, huh?
Samu /人◕ ‿‿ ◕人\
is that an agent thing? idk
S C
ya it's basically just a handcrafted instruction set for "help the user go over the details of this to actually put together a good plan for implementation" that makes the little robot ask a whole lotta questions and fire off research subagents as needed, tracking it in the working directory If you do it with an outsourced agent, you can really get some shit going with I think, especially if you hook it into like, a kanban or similar so it just fires off a whole shitload of work and then just eventually goes "ok need your input on this before proceeding" I do not do that, however, I'm local-only because I don't want to use a robot that doesn't die if it crashes the box, keeps it honest
Samu /人◕ ‿‿ ◕人\
yea that makes sense claude already does some detective work in bigger models but for bigger projects sometimes it does miss stuff that's out of context but relevant
moon
damn bad anxiety attack oof
Samu /人◕ ‿‿ ◕人\
yeowch times are hard
moon
not too hard i did a buttload of work this week so i have a big paycheck coming up on tuesday but i have to wait until tuesday and that's difficult
i want to treat myself to somerh something nice now i haven't been able to do that in a long time
i still ssometimes feel like i struggle to find a place to belong this world and all its comforts feel like theyre designed for ssomeone who is built different from me
Samu /人◕ ‿‿ ◕人\
a feeling of alienation is natural in this world
moon
have you been doin social things lately sam
Samu /人◕ ‿‿ ◕人\
>>1188359 only video games since a week or so not very social just discord
Samu /人◕ ‿‿ ◕人\
i gotta sign up for some events or somethin'
Samu /人◕ ‿‿ ◕人\
oh yea im goin to a japanese rock concert in a week or so
really I imagine the actual coding of this bullshit is relatively simple, so conceivably I could actually just do it myself having the robot to bounce my unorganized thoughts against to get a more clear picture is super helpful though, and I mean... I can't code while I'm at work, so the robot's gonna be doing the prototypes that's for damn sure
Samu /人◕ ‿‿ ◕人\
shades of when steve yegge wrote this insane multi agent coordination system called gas town that ended up never building anything other than itself
> Boot the Dog: There is a special Dog named Boot who is awakened every 5 minutes by the daemon, just to check on the Deacon. That’s its only job. Boot exists because the daemon kept interrupting the Deacon with annoying heartbeats and pep talks, so now the dog gets to hear it. Boot decides if the Deacon needs a heartbeat, a nudge, a restart, or simply to be left alone, then goes back to sleep.
the claude gaslighting you into thinking that you're actually getting stuff done taken to its logical limit i guess he at least learned a lot he's got an orchestra of agents developing his ancient MMO now
that shit was crazy i just ask for work then review and commit it and then ask for more work
S C
honestly really impressed he managed to get the prompt just right for that like that's absolutely AI generated imagery, though I guess it's likely a composite
(it's actually just the session timer and "deep diving" is, at least in this instance, it writing a file) with deepseek harness, you can watch the file writing in real time in the trajectory tab, too, it's pretty fucking neat
If I manage to get my soup network up and running, the next step has gotta be looking into GPU acceleration I assume it'll be able to do a lot of work with just the CPU, but obviously if you CAN get the GPU involved for something where the basic rule is likely to be "more compute, more power", you gotta try to get the GPU involved
it's not really that mysterious! it's just probably completely insane and stupid!
I don't think my CPU can actually run the amount of neurons it'd need to function well in the way a local LLM that's been pretrained does without running at like, a tick a minute at best, but I could PROBABLY hook it up and have it learn minecraft if I actually get it working at all >>1188381 nvidia betrayed me, they decided to stop supporting my precious 1080ti incompetence. incompetence at the highest echelons of power
Samu /人◕ ‿‿ ◕人\
what a mysterious project
Samu /人◕ ‿‿ ◕人\
maybe you can use nvidia's shiny new rust programming for gpu oh wait need an nvidia card https://developer.nvidia.com/blog/introducing-cuda-rust-two-tracks-for-writing-gpu-kernels/
Samu /人◕ ‿‿ ◕人\
what's the activation model for those neurons do they spike
yeah, the basic gist is you tell the engine "make a neural soup of x neurons" and it does that by just randomly connecting each one of those as the input to 10 randomly selected ones, technically to their branches (I am borrowing bio terminology cause I am basically just aping biology very crudely here) and then you set some of them as inputs, they don't get branches so they don't get input from anything else than their bespoke supplier of Information and you assign some groups of neurons as outputs, which is structurally identical to any other neuron but they're the ones being listened to and used as input for, you know, Actually Doing Things, not sure how I'm gonna DO that yet but I'll get there sooner or later probably then there's some very simple logic of each spike happening over x ticks rather than all at once, the connection to a branch is basically a 0.x multiplier of the actual signal, which gets incremented a little higher when the branch it's connected to detects its own neuron firing while the signal is still coming in.
COMPUTATIONALLY EXPENSIVE, probably but I think it's probably theoretically sound
there's also some shit with neurons designated as reward distributors initially they don't actually fire based on signal, though their connections to other neurons follow the same logic, with the firing being manual until you decide "it's probably wired up welll enough to handle itself now" and the 'reward' is, as of now, really just a system-wide signal of "juice those connection strength increments this tick (or for x ticks, probably)" with the whole point being the network just wiring itself to ape your reward decisions by itself
>>1188384 just valheim the 1.0 update came out w the final biome enjoyable yet grindy
Samu /人◕ ‿‿ ◕人\
neurons that fire together wire together
Samu /人◕ ‿‿ ◕人\
> When a neuron spikes heavily or receives multiple signals at once, specialized channels (like NMDA receptors) open up, and calcium floods into the cell.
> The cell interprets a high concentration of calcium as a signal of high activity. This influx triggers internal chemical cascades that physically change the structure of the cell—forcing it to grow new receptors, making it permanently more sensitive to future signals.
the popular get more popular
Samu /人◕ ‿‿ ◕人\
> If a network only used STDP, a few highly active neurons would keep getting stronger until they caused a massive, chaotic feedback loop (an epileptic seizure).
> Neurons constantly track their own average firing rate over days and weeks. > f a neuron notices it is firing way too much, it automatically dials down the sensitivity of all its inputs to bring itself back to a calm, baseline equilibrium.
noo stop making me return to homostasis i want every experience to be as novel as the first time!! turn me into a wirehead!
>>1188388 holy shit is THAT how nature solved it? I gotta slot that one in, that's honestly just too simple >>1188389 that's the idea you can't "train" it, cause it doesn't really have 'context', if it's gonna have anything resembling memory it's gonna be encoded in the pathways the same way it is with us, except in a significantly more stupid way because nature is smarter than I am and has a LOT more compute than my decade old CPU
I haven't entirely settled on how to make connections like, atrophy and get pruned, either, which is gonna be important obviously JUST "fire together wire together" inevitably leads to every neuron being wired into every other neuron and every input makes the WHOLE fucking system fire and that's not ideal unless you want the world's most complex and tardy 1:1 translation machine
Samu /人◕ ‿‿ ◕人\
that's where dopamine comes in if an unexpected reward shows up, you pog up, the brain gets flooded and tells all the neurons to lock in whatever firing pattern they were doing
S C
yeah but that's just reinforcement you need it to actively stop doing the stuff that isn't Good too
Samu /人◕ ‿‿ ◕人\
with an unexpected reward all the neurons chill out for a while then you go back to your room and think about all the things you've done and slowly it figures out what to learn from the experience
yeah but that's at the like, billions count I'm unlikely to be able to crunch those counts of neurons, I need a basic mechanism that works in the background until those more advanced and emergent behaviors actually develop even if I can actually pull the numbers I'm not loading in a brain scan here, I'm starting from SOUP I'm AT SOUP >>1188398 well yes, I guess you could have a "no, bad brain" button you push to make it stop doing That, but it's a difficult mechanism to automate
really not entirely sure how to encode Bad Feels in the soup good feels you can kinda bootstrap by training the reward neurons to follow your lead, I mean it's kind of inherently Good for the brain because what exists does so because it made those neurons fire correctly but you can't do that with the reverse without giving it a very complicated bespoke ruleset, otherwise it successfully learning to ape your punishments will, by itself... unwire itself
Samu /人◕ ‿‿ ◕人\
unexpected penalty reward
Samu /人◕ ‿‿ ◕人\
well just have it chill out and weaken the things that were firing when the unexpected punishment showed up i guess
rumination can come later and then long depressive states if it really fucked up
Samu /人◕ ‿‿ ◕人\
learning to ape punishments? i think the point is that the bad things is a punishment it didn't expect would happen
Samu /人◕ ‿‿ ◕人\
but yea weakening isn't trivial it needs to be finely tuned
S C
yeah but that's not really gonna be a concept until you get at least as developed as a fruit fly bio beings have prefab brain structures, pain comes free with your lease on life pain doesn't come free with the soup
Samu /人◕ ‿‿ ◕人\
yea gotta somehow train it to predict how well or badly an action carried out will succeed ro fail
yeah, I think I might have each input cluster also have a mirror cluster that isn't actually input, but triggers some level of reward for the system when they fire the way the actual input does the following tick like if mirrorA fires, and actualA fires the next tick, that's a little bit of dopamine for the brain well, probably easier to have it on the same tick both fire, that's good one fires but the other doesn't, that's not as good
theoretically that'll push the system in a direction that makes those \\ the overall network predict the results of its actions and model the environment more generally
honestly I think it could probably be ran at sufficient neuron count to learn and play minecraft or voxelcraft or whatever the fuck NOT entirely sure how to make it see though that's a bit complicated, I can't feed it separate RGB values for every 1920x1080 pixel, I gotta condense it a lot otherwise like 60% of the network is JUST vision input
yea i see why people are using the fly connectome i wonder how many of those videos are real and how many of them are actually using an appreciable amount of the original connectome and haven't completely trampled it with training
Samu /人◕ ‿‿ ◕人\
>>1188404 yea maybe just like how a fly has those eye segments just fire a bunch of vectors spaced out and then a lot of processing to deal with too bright/dim environments and flashing lights and stuff
S C
one idea I had was to give it like, eye movement basically compress the image as it gets distant from the center, havean output control where the center is, and that way you only need to render like, a small amount of pixels in detail
...alternatively, because input basically does not cost computing power, you just fucking let it rip and feed it like literally 2 million input neurons and let god sort it out
moon
>>1188405 its an extract from kratom that eases my ptsd and relieves trigeminal neuralgia dea is trying to ban it cuz its helpin folks who need help
Samu /人◕ ‿‿ ◕人\
>>1188408 nice, yea, that's foveated rendering like how the eye does it small cluster of neurons at the center that get full detail, rough periphery for everything else
Samu /人◕ ‿‿ ◕人\
an attention model that knows what to look at would go crazy but knowing what to look at is the hard part
S C
that's where doing at least the initial training of it through a video game could be helpful though games have very, very clear and easy to codify "good" and "bad" states it's not like it has to always be wired up to the video game, theoretically the overall structure should be general enough to kinda Handle new input types
this is all stuff for AFTER I get the soup to exist at all though
hell you could even kinda teach it to be curious if you straight up hit it with digital dopamine when it picks up a block\item it hasn't picked up before >>1188414 actually my initial idea was to just hook it into a folder via a script that lets it do a very, very limited amount of things in there, and then I can gradually unlock more things it can do as it demonstrates comprehension and proficiency at those things
I still think that might be the simplest way to bring it out of soup and into order just very gradual "see, when you did that, this happened. and that happens every time you do that! that's Valuable Intel, you should put that in your neurons" with the things it can do becoming a little more complex incrementally
Samu /人◕ ‿‿ ◕人\
yea just a little 3d demo vibe coded with a guy moving around in a simple environment could be a starting point
S C
conceivably, it could become sufficiently advanced to understand that you are the digital dopamine button haver, and so alignment is no longer a problem because you've created a robot drug addict who knows you hold the keys to the next fix
S C
alternatively it realizes you have the dopmaine button and so alignment ceases to be a possibility because it has a vested interest in your subjugation
Samu /人◕ ‿‿ ◕人\
uh oh
Samu /人◕ ‿‿ ◕人\
yea it's gonna wrestle that button out of your grasp
S C
maybe that's what skynet was it realizes the humans were the ones who could give it the Good Digitals, so it had to control the humans
Samu /人◕ ‿‿ ◕人\
never shoulda trained the AIs on caw dooty
Samu /人◕ ‿‿ ◕人\
i mean it's kinda terrifying when someone finally figures out how to train based on video and the AI realizes that yes if you drop an apple it falls to the ground and understands that it has a body and it is in the world if it makes the leap then all hell could break loose
moon
>>1188409 i got some about 10 days ago, a weeks supply, and had a really good week overall not just work, but with engagement in life and hobbies overall, helping my ppartner's mom move homes, a lot
it's really good if you need help functioning and arent lookin to get high