• You are currently viewing our forum as a guest, which gives you limited access to view most discussions and access our other features. By joining our free community, you will have access to additional post topics, communicate privately with other members (PM), view blogs, respond to polls, upload content, and access many other special features. Registration is fast, simple and absolutely free, so please join our community today! Just click here to register. You should turn your Ad Blocker off for this site or certain features may not work properly. If you have any problems with the registration process or your account login, please contact us by clicking here.

Random AI/Robot Thoughts and News

ygolo

My termites win
Joined
Aug 6, 2007
Messages
6,731
I have wondered if quantum processors will lead to AI sentience. While we don’t understand it in humans, I’ve heard speculative theoretical physicists musing it could be a function of quantum physics.

My understanding is that consciousness is a property of matter that is expressed when the conditions are right. I’ve wondered if that property of matter is what drives evolutionary processes. I find it absurd to assume it’s an accident or anomaly. I don’t see a reason those conditions could not be intentionally created. I don’t see it as spiritual in the magical sense but like an inherent property or force common throughout the universe like any other property of matter.

“We are the universe observing itself”
That's Chalmers "Hard Problem" view. I don't place much credence in it.

I might suggest Anil Seth's book, Being You. It's an extremely fact based deconstruction of consciousness. You'll actually see similarities to what an LLM does.

The issue is that LLMs, even naive multi-modal models with the same architecture are limited. Even those who went hard(many open AI and Anthropic researchers) on the pre-trained scaling "laws" of the transformer architecture are admitting seeing diminishing returns from scaling pre-trained models. They're turning to inference-time compute, tool use(agents), world models, and improved product design.
 

Lark

Well-known member
Joined
Jun 21, 2009
Messages
29,682
What AI revolutions are you anticipating that you personally would be looking forward to?

I would love it if there were a scheduler revolution, like if you could provide a sophisticated AI your schedule information which you have, work, leisure, interests, things you are curious about which have not developed an interest in yet but want to, and it would create a perfect schedule for you pulling in all the information of the web, a lot of the juggling and stress associated with it would disappear and you'd never miss a deadline for a car service, dental appointment or reach the end of the working year with additional annual leave to carry over or anything like that.

It would be cool to see how it would suggest what you could cut and keep in a schedule too in order to optimize different things.

I think until this kind of thing would work on an individual or personal level it wont work on a structural or service management level because it requires a degree of familiarity on the part of both provider and consumer/user for it to work and I think that'd only work if some sort of primary socialisation / familarity with the systems existed already.
 

ygolo

My termites win
Joined
Aug 6, 2007
Messages
6,731
@Lark I think what you want could be done with a recommendation system with proper inputs from you on constraints and preferences.

Part of what I hate about most recommendation systems are that they're controlled by companies and not people. Imagine if the data on you was owned and controlled by you.

 

ygolo

My termites win
Joined
Aug 6, 2007
Messages
6,731
This juxtaposition is why regulations need to be application and domain-specific.

In science, the difference between finding information and publication is huge.


 

Lark

Well-known member
Joined
Jun 21, 2009
Messages
29,682
@Lark I think what you want could be done with a recommendation system with proper inputs from you on constraints and preferences.

Part of what I hate about most recommendation systems are that they're controlled by companies and not people. Imagine if the data on you was owned and controlled by you.


Indeed, I used to talk to a few friends about a sort of alternative to facebook, much more detailed but its within the user discretion what the complete and what is visible or not and then they have a "sell my data" option, I dont know how it would be funded if it wasnt automatically for sale, maybe ads, I dont know but the point of it would be that the "sale" would create revenue for the user, a percentage would be taken for the site in its role as "host", but the idea being that it would be a major data collection source, less of a social network as a life logger to which you own and control, you can use the metrics entirely yourself or you can choose to "share" or "sell" if as you see fit.

It was something I thought of as a good idea to create as a kind of private UBI type thing, everyone creates data these days, just by living and experiencing stress, disease, epigenetics etc.

The benefits to the individual and also socially would be immense.
 

ygolo

My termites win
Joined
Aug 6, 2007
Messages
6,731
 

ygolo

My termites win
Joined
Aug 6, 2007
Messages
6,731
Fever Dreams of electric sheep.
Have you tried using Runway?

I have friends interested in generative art and video. I have used it on occasion, but I haven't been impressed with its ability to give me what I want. The tools are helpful but they still don't fully impress me yet(maybe I haven't experimented with them enough).

I have more use for LLMs, and segmentation models. I customize many of them for my purposes.

Edit:
Here is a video I just made of a cat floating in space:
 
Last edited:

ygolo

My termites win
Joined
Aug 6, 2007
Messages
6,731

ygolo

My termites win
Joined
Aug 6, 2007
Messages
6,731

^^^The scaling law that actually matters.

I have held a belief that the pre-trained emergent capabilities scaling law(a belief held by AGI companies) was always going to cap out due to the entropy of the available training data (especially if you believe the theoretical underpinnings being the existence of lower dimensional manifolds for concepts being more available as dimensions increase)
 

ygolo

My termites win
Joined
Aug 6, 2007
Messages
6,731
I am most interested in world models lately.


I think a lower level of quality can be achieved using good segmentation models.


Humans (and other animals) use things like parallax and combining vision with sound to really understand our environment.
 

ygolo

My termites win
Joined
Aug 6, 2007
Messages
6,731
I think that:

Pre-trained auto-regressive Large Language Models will top about at some point because of the inherent entropy of language.

However, I believe that the transformer architecture (and various efficiency gains on top of it) could be enough to create human-level intelligence. However, multi-modality will be key.

Guessing the next token in vision, touch, movement, sound, and language is, in some sense, the "Cortical Algorithm" proposed by Jeff Hawkins in On Intelligence almost two decades ago.

Only one Tech Mogul has the computing power and data to train such a model. My question to people: "Do you want him to control this?"

Almost every person trying to build such a thing says something like: "I will need to create it because others who build it will misuse it and make it bad."

20231104_WWD000.png


I prefer different people to control various aspects of the new intelligence. If we are using all of human knowledge to create a new intelligence, I feel all humans should have some say.

 
Top