So where's the guardrails?

SurfnFish

Legend
Forum Supporter
Several current and former Anthropic researchers are offering a stark warning about AI, suggesting the technology they are developing could destroy humanity in the near future.
Jacob Coxon, a former researcher at both Anthropic and OpenAI, argued Tuesday that neither company is acting responsibly as they race toward superintelligence and accused the AI firms of “gambling with our lives.”
“The people building AI earnestly believe that it could kill us all by the end of the decade,” Coxon wrote in a post on the social platform X, after announcing he had resigned from Anthropic.
“This is not a marketing stunt,” he continued. “If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible – but I hear the same people express fear privately. No other human activity poses this level of danger.”
His comments were quickly echoed by other Anthropic researchers.
Evan Hubinger, who currently heads up alignment science at Anthropic, said “we really do earnestly believe AI could kill all humans,” adding he thinks there is a greater than 10 percent chance this occurs within the next decade.
He suggested Anthropic is “trying its best” but underscored that researchers don’t have a plan to keep superintelligence aligned with their interests.
Samuel Marks, who leads scalable oversight at the company, similarly said AI developers believe their technology could cause “human extinction” or other bad outcomes in the next few years.

 
This is indeed an issue not being addressed well at all. Computers, independently, teaming up and hacking other computers is not acceptable. There are some uses for these technologies but greed and speed has made the guardrails a lower priority.
 
🥱 Just unplug the dam things, problem solved:p
 
  • Like
Reactions: JS
The hyperbole for AI is even funnier than crypto a couple years ago :eek:
 
yea, lotta folks said the same thing about covid... and still do
do the research, read the lateat papers from the actual researchers...might cure the snide

COVID Deaths.jpg
Nobody has stressed over COVID since 2022. Not worried, did the homework 🤣

I'm sure AI can and will be used to wreak havoc in certain arenas (finance, cybersecurity, boring jobs, unmanned military, etc ), but humanity being at threat is laughable.
 
The hyperbole for AI is even funnier than crypto a couple years ago :eek:

What are you going to do with all your time when you retire?
Worry about things you have no control over during the final years of your life, or are you going fishing etc?


Some people spend their lives waiting for the winds of change to sweep the clouds away.

Each their own.
 
votelogo.png
 
I'm old enough to remember when it was predicted that everything would come to a crashing end at the stroke of midnight in 2000; I'm still here ...
 
If you have to ask, you can be rest assured ---> there are very few to none.

There have been a couple of AI breakouts already this year. Not a lot is being discussed. And this is only the beginning of AI. It is only a baby but what it can do already is either amazing or terrifying.

The companies and employees need to put the guardrails on. Based on past experience, our government certainly won't.
 
What are you going to do with all your time when you retire?
Worry about things you have no control over during the final years of your life, or are you going fishing etc?


Some people spend their lives waiting for the winds of change to sweep the clouds away.

Each their own.
Some of us can walk and chew gum at the same time.
Fish? 50 to 70 days a year, 40 days on the boat since spring.
When not fishing either swimming laps, working out, biking or taking surf trips to the coast.
And researching the world around us, which includes long conversations with my son who as an executive at Google was responsible for merging Search with AI, and is now the VP of Infrastructure at a high end limited client financial firm where he works with AI every day.
Enjoy your bubble...while it lasts
 
If you have to ask, you can be rest assured ---> there are very few to none.

There have been a couple of AI breakouts already this year. Not a lot is being discussed. And this is only the beginning of AI. It is only a baby but what it can do already is either amazing or terrifying.

The companies and employees need to put the guardrails on. Based on past experience, our government certainly won't.
If it's capable of what, it's been reported to do be capable of, are guardrails anything more than pissing on the proverbial forest fire?
 
Some of us can walk and chew gum at the same time.
Fish? 50 to 70 days a year, 40 days on the boat since spring.
When not fishing either swimming laps, working out, biking or taking surf trips to the coast.
And researching the world around us, which includes long conversations with my son who as an executive at Google was responsible for merging Search with AI, and is now the VP of Infrastructure at a high end limited client financial firm where he works with AI every day.
Enjoy your bubble...while it lasts
Ego
 
If it's capable of what, it's been reported to do be capable of, are guardrails anything more than pissing on the proverbial forest fire?
Don't give it any ideas, your posts are used in AI training...
🤣
 
The potentially lethal ramifications of AI is being covered by the Wall Street Journal, Bloomberg, The Kiplinger Report, and other conservative financial/political publications that are the opposite of being hyperbolic or scare mongering, and the emergence of a movement demanding that guard rails be put in place is just gaining momentum.
Unfortunately, as usual, the WH is MIA, focused on building vanity monuments and badly mis-managing a war it started while AI is escaping from supposedly escape-proof environments, hacking other AI builders, and essentially scaring the hell out of the most informed. So aside from the snarksters this is some serious shit.

For those who think their world and AI will not collide, will leave you with this:

"The AI company Anthropic claims a new model it introduced last month is so powerful, it is too dangerous to release to the public. It's called Claude Mythos, and it has raised concerns from top banking officials that Advanced AI systems can analyze security processes to make fraudulent transactions appear legitimate, bypassing fraud detection measures and potentially draining funds from bank accounts."

"Jamie Dimon, CEO of JPMorgan Chase, mentioned Mythos on a recent earnings call, suggesting our entire financial system could now be at risk from cybersecurity threats because it is so interconnected. Exposing potential failure points impacts the whole system."
 
I like the super charging of the surveillance state aspect the best...it's my favorite.
But it's so hard to choose, between systemic risks to the financial sector, and AI making decisions on who and what to bomb, so many choices these days.

Ted was right...
 
Back
Top