Amanpour and Company

IN HIS NEW BOOK "NEXUS: A BRIEF HISTORY OF INFORMATION NETWORKS FROM THE STONE AGE TO A.I.," BEST-SELLING AUTHOR AND HISTORIAN LOOKS AT HOW WE GOT HERE AND WHAT WE NEED TO DO NEXT.

IN AN AGE WHERE ARTIFICIAL INTELLIGENCE POSES UNIQUE CHALLENGES.

HE'S JOINING WALTER ISAACSON NOW.

>> THANK YOU, AND WELCOME BACK TO THE SHOW.

>> THANK YOU.

IT'S GOOD TO BE HERE AGAIN.

>> YOUR BEST-SELLING BOOK "SAPIENS," ABOUT HOW WE, AS A SPECIES, BECAME DOMINANT AND IT'S BASICALLY ABOUT HOW WE WERE ABLE TO FORM NETWORKS OF COOPERATION.

YOUR NEW BOOK "NEXUS," IS ABOUT COMMUNICATIONS AND HOW THEY HELPED TO FORM THOSE NETWORKS, BUT IT'S RATHER PESSIMISTIC.

I THINK THE WAY YOU SAY, THE WAY THESE NETWORKS WERE BUILT PREDISPOSES US TO USE THAT POWER UNWISELY.

TELL ME ABOUT THAT THEME.

>> WELL, THE BASIC QUESTION OF THE BOOK, OF "NEXUS," IS IF HUMANS ARE SO SMART, WHY ARE WE SO STUPID?

WE'VE NAMED OUR SPECIES HOMO SAPIENS.

WHICH MEANS WISE HUMANS, AND WE KNOW A LOT MORE THAN ANY OTHER ANIMAL ON THE PLANET.

WE'VE REACHED THE MOON.

WE CAN SPLIT THE ATOM.

WE CAN DECODE AND WRITE DNA, AND NEVERTHELESS, WE ARE ON THE VERGE OF DESTROYING OURSELVES AND MUCH OF THE ECOSYSTEM.

SO THIS IS THE PARADOX, THE CENTER OF THE BOOK, AND OF COURSE, HUMANS HAVE BEEN CONCERNED WITH THIS PARADOX THROUGHOUT HISTORY, AND MANY MYTHOLOGIES AND THEOLOGIES, THEY BLAME HUMAN NATURE, BUT THERE IS SOMETHING WRONG WITH HUMAN NATURE, WHICH CAUSES US TO BE SO SELF-DESTRUCTIVE.

THE BOOK "NEXUS" GIVES A DIFFERENT ANSWER.

THE PROBLEM IS NOT WITH OUR NATURE.

IT'S WITH OUR INFORMATION.

IF YOU GIVE GOOD PEOPLE BAD INFORMATION, THEY MAKE BAD DECISIONS.

THEY MAKE SELF-DESTRUCTIVE DECISIONS, AND WE ARE NOW SEEING IT ALL AROUND US, YOU KNOW, WE HAVE THE MOST SOPHISTICATED INFORMATION TECHNOLOGY IN HISTORY, AND AT THE SAME TIME, WE ARE LOSING THE ABILITY TO TALK WITH EACH OTHER, TO LISTEN TO EACH OTHER.

YOU KNOW, THERE IS MAYBE ONE THING THAT DEMOCRATS AND REPUBLICANS IN THE UNITED STATES CAN AGREE ON, IS THAT THE DEMOCRATIC CONVERSATION IS BREAKING DOWN.

EVERYBODY ACCUSES THE OTHER SIDE, OF COURSE, BUT THE BASIC FACT IS THAT THIS -- THIS ABILITY, WHICH SUSTAINS DEMOCRACY TO HOLD REASONABLE CONVERSATION, IT IS BREAKING DOWN AT EXACTLY THE SAME MOMENT THAT WE HAVE SUPPOSEDLY, THE BEST INFORMATION TECHNOLOGY IN HISTORY.

>> YOU SAY THE FLAWS AREN'T IN OUR NATURE.

IT'S IN OUR COMMUNICATIONS NETWORKS.

>> YES.

>> WHAT ARE THE FLAWS IN THOSE COMMUNICATION NETWORKS?

>> THE BASIC MISUNDERSTANDING IS ABOUT WHAT INFORMATION DOES, WHAT INFORMATION IS.

INFORMATION ISN'T TRUTH.

THIS NAIVE VIEW WHICH DOMINATES IN PLACES LIKE SILICON VALLEY, THAT YOU JUST NEED TO FLOOD THE WORLD WITH MORE AND MORE INFORMATION AND AS A RESULT, WE WILL HAVE MORE KNOWLEDGE AND MORE WISDOM, THIS IS SIMPLY NOT TRUE BECAUSE MOST INFORMATION IS JUNK.

THE TRUTH IS A VERY RARE AND COSTLY KIND OF INFORMATION.

THE BASIC FUNCTION OF INFORMATION IN MOST CASES, IS NOT TO REVEAL THE TRUTH.

THE BASIC FUNCTION IS TO CONNECT.

THE EASIEST WAY TO CONNECT LARGE NUMBERS OF PEOPLE IS NOT WITH THE TRUTH.

IT IS WITH FICTIONS AND FANTASIES AND MASS DELUSIONS.

>> AND WHAT SHOULD BE DONE ABOUT THAT?

SHOULD GOVERNMENTS ACTUALLY STEP IN WHILE WATCHING THAT HAPPEN A BIT?

>> TWO THINGS THAT SHOULD BE DONE AT THE GOVERNMENT LEVEL, AND THERE IS SOMETHING TO BE DONE ON THE INDIVIDUAL LEVEL.

ON THE GOVERNMENTAL LEVEL, THE TWO MOST OBVIOUS THINGS TO DO IS TO BAN FAKE HUMANS THAT WE DON'T WANT ALGORITHMS PRETENDING TO BE HUMANS, AND THEREBY DISTORTING OUR INFORMATION SYSTEMS.

IF YOU GO ONLINE, LET'S SAY TO TWITTER, AND YOU SEE THAT THE STORY HAS A LOT OF TRACTION, A LOT OF TRAFFIC, AND YOU THINK, OH.

A LOT OF HUMANS ARE INTERESTED IN THIS.

SO I SHOULD ALSO GET INVOLVED, BUT ACTUALLY IT'S NOT HUMANS.

IT'S BOTS AND ALGORITHMS.

THIS SHOULD BE BANNED.

SO WE SHOULDN'T HAVE A SITUATION WHEN ALGORITHMS PRETEND TO BE HUMANS, AND THEY ARE RUNNING OUR CONVERSATIONS.

THE OTHER THING IS THAT CORPORATIONS SHOULD BE LIABLE FOR THE ACTIONS OF THEIR ALGORITHMS.

WHENEVER YOU TALK ABOUT IT WITH THE BIG TECH COMPANIES, THEY IMMEDIATELY RAISE THE FLAG OF FREEDOM OF SPEECH.

WE DON'T WANT TO CENSOR OUR USERS.

THE PROBLEM IS NOT WITH THE HUMAN USERS.

HUMANS PRODUCE ENORMOUS AMOUNTS OF CONTENT.

SOME OF IT IS HATE AND GREED, BUT THERE IS ALSO A LOT OF OTHER GOOD CONTENT.

THE PROBLEM IS THAT THE CORPORATE ALGORITHMS OF TWITTER AND FACEBOOK AND TIKTOK AND SO FORTH, THEY DELIBERATELY SPREAD THE HATE AND THE FEAR AND THE GREED BECAUSE THIS IS GOOD FOR THEIR BUSINESS INTERESTS, AND THIS IS WHAT THEY SHOULD BE LIABLE FOR, FOR THE DECISIONS AND ACTIONS OF THEIR ALGORITHMS, NOT FOR WHAT THE HUMAN USERS ARE DOING.

>> YOU'VE TALKED ABOUT HUMANS HAVING SOME MISINFORMATION, AND THEN YOU'VE TALKED ABOUT THE WAY THE ALGORITHMS WORK.

IS THERE A DIFFERENCE BETWEEN AN ORGANIC INFORMATION SYSTEM, MEANING HUMAN INFORMATION SYSTEM, AND AN INORGANIC ONE?

>> YES.

THERE ARE MANY DIFFERENCES.

ONE IS THAT ORGANIC ENTITIES LIKE US, LIKE HUMAN BEINGS, WE WORK IN CYCLES.

THERE IS DAY AND NIGHT, WINTER AND SUMMER.

SOMETIMES WE ARE ACTIVE.

SOMETIMES WE NEED REST AND SLEEP.

THE OTHERS ARE TIRELESS.

THEY NEVER NEED TO REST.

THEY ARE NOT ORGANIC, AND WHAT WE SEE IN THE WORLD NOW IS THAT THEY INCREASINGLY FORCE US TO WORK ACCORDING TO THEIR PACE.

THERE IS NEVER ANY TIME TO REST.

THE NEWS CYCLES IS ALWAYS ON.

THE MARKETS ARE ALWAYS ON.

THE POLITICAL GAME IS ON ALWAYS, AND IF YOU FORCE AN ORGANIC ENTITY TO BE ON ALL THE TIME, TO BE ALWAYS ACTIVE, ALWAYS EXCITED, IT EVENTUALLY COLLAPSES AND DIES, AND, YOU KNOW, THE MOST MISUNDERSTOOD AND ABUSED WORDS IN THE ENGLISH LANGUAGE TODAY IS THE WORD EXCITED.

A LOT OF PEOPLE MISTAKE THE WORD EXCITED FOR HAPPY, LIKE, THEY MEET SOMEBODY, LIKE, THEY SAY I'M SO EXCITED TO MEET YOU.

THEY PUBLISH A NEW BOOK.

OH, THIS IS SO EXCITING.

EXCITEMENT IS NOT ALWAYS GOOD.

EXCITEMENT FOR AN ORGANIC BEING LIKE A HUMAN BEING MEANS THAT YOUR NERVOUS SYSTEM AND YOUR BRAIN ARE VERY ENGAGED, VERY ACTIVE.

NOW IF YOU KEEP AN ORGANIC SYSTEM VERY EXCITED, ALL THE TIME, IT BREAKS DOWN, COLLAPSES, AND EVENTUALLY DIES, AND THIS IS WHAT HAPPENS NOW TO DEMOCRACIES ALL OVER THE WORLD.

THIS IS WHAT IS HAPPENING TO HUMANITY.

WE ARE FAR TOO EXCITED.

WE NEED TIME TO REST.

WE NEED TO KIND OF SLOW DOWN, AND BECAUSE WE GIVE INCREASING CONTROL OF THE WORLD TO TIRELESS, NONORGANIC ALGORITHMS THAT NEVER NEED TO REST AND CAN JUST INCREASE THE EXCITEMENT ALL THE TIME, WE ARE BREAKING DOWN.

WE NEED MORE REST AND NOT EXCITEMENT.

IN POLITICS, IN ECONOMICS, IN MANY FIELDS.

>> WHEN WE TALK ABOUT ARTIFICIAL INTELLIGENCE, AND WE SAY HOW IT'S GOING TO CHANGE THE WAY WE DISTRIBUTE INFORMATION AND EITHER EMPOWER PEOPLE OR EMPOWER TYRANNIES, SOMETIMES PEOPLE REFLECT BACK ON THE LAST HUGE ADVANCE IN INFORMATION TECHNOLOGY SPREAD WHICH WAS GUTENBERG 500 YEARS AGO DOING THE PRINTING PRESS.

YOU DEBUNKED THAT.

YOU SAY ARTIFICIAL INTELLIGENCE IS VERY INSIDIOUS COMPARED TO THE PRETTY GOOD THINGS THAT COME OUT OF THE PRINTING PRESS.

>> WELL, THERE IS A MYTH THAT, YOU KNOW, GUTENBERG BROUGHT PRINT TO EUROPE AND AS A RESULT, HE GOT A SCIENTIFIC REVOLUTION AND ALL THE WONDERS OF MODERN SCIENCE.

THIS IS A VERY, VERY INACCURATE AND MISLEADING VIEW OF HISTORY.

ALMOST 200 YEARS PASSED FROM THE INVENTION OF PRINT UNTIL THE FLOWERING OF THE SCIENTIFIC REVOLUTION.

DURING THESE 200 YEARS, THE MAIN EFFECTS OF PRINT ON EUROPE WAS A WAY OF RELIGION AND WITCH HUNTS AND THINGS LIKE THAT BECAUSE THE BIG BEST-SELLERS OF EARLY MODERN EUROPE WERE NOT COPERNICUS AND GALILEO.

THE BIGGEST BEST-SELLERS WERE RELIGIOUS TRACKS AND WITCH-HUNTING MANUALS.

>> AND ALSO THE BIBLE, AND INDIVIDUAL RELIGION.

>> IT BROKE THE CATHOLIC CHURCH, BUT NOT IN FAVOR OF SCIENCE, BUT IN FAVOR OF MORE AND MORE EXTREME RELIGIOUS SECTS, AND YOU GOT, AGAIN, THE WARS OF RELIGION IN EUROPE CULMINATING IN THE 30 YEARS WAR WHICH WAS ARGUABLY THE MOST DESTRUCTIVE WAR IN EUROPEAN HISTORY, AT LEAST UNTIL THE TWO WORLD WARS OF THE 20th CENTURY.

FOR THE SAME REASONS THAT WE SEE THE SPREAD OF FAKE NEWS AND THE CONSPIRACY THEORIES AND SO FORTHRIGHT NOW, WHEN YOU MAKE THE PRODUCTION OF INFORMATION EASIER, WHAT YOU GET IS NOT NECESSARILY FACTS.

WHAT YOU GET IS A LOT OF JUNK INFORMATION, A LOT OF FAKE NEWS AND CONSPIRACY THEORIES, AND THINGS LIKE THAT.

IF YOU WANT THE TRUTH, IT'S NOT ENOUGH TO HAVE THE TECHNOLOGY OR PRODUCE INFORMATION.

YOU NEED INSTITUTIONS, COSTLY INSTITUTIONS THAT MAKE THE EFFORT TO SEPARATE, RELIABLE INFORMATION WHICH IS RARE KIND OF INFORMATION FROM THE FLOOD OF UNRELIABLE INFORMATION, AND IN EARLY MODERN EUROPE, IT TOOK 200 YEARS TO CREATE SUCH INSTITUTIONS LIKE NEWSPAPERS, LIKE SCIENTIFIC ASSOCIATIONS.

YOU KNOW, SCIENTIFIC JOURNALS, THEY DON'T RUN AFTER USER ENGAGEMENT.

THE ALGORITHMS TODAY ON SOCIAL MEDIA ARE EXACTLY LIKE THE FIRST WAVE OF PUBLISHERS IN THE 15th AND 16th CENTURY.

IN THE 16th CENTURY, THEY ALSO RAN AFTER USER ENGAGEMENT.

WE WANT USER ENGAGEMENT, AND IF YOU PRODUCE A BOOK BY COPERNICUS ABOUT THE MOVEMENT OF THE PLANET, NOBODY BUYS IT.

IT'S BORING, BUT IF YOU PUBLISH A WITCH-HUNTING MANUAL THAT TELLS YOU THAT THERE IS A WORLDWIDE CONSPIRACY OF WITCHES LED BY SATAN, AND THEY HAVE ORGIES AND CANNIBALISM AND CHANT SACRIFICE, AND THEY TRY TO TAKE OVER THE WORLD, AND THEY ARE PART OF THIS CONSPIRACY, AND THESE ARE A FEW SIGNS HOW YOU CAN IDENTIFY THESE WITCHES IN YOUR TOWN, IN YOUR VILLAGE AND KILL THEM.

THESE WERE THE BIG BEST-SELLERS, AND THIS LED TO THIS CRAZE OF THE -- OF THE WITCH HUNTS WHICH WAS NOT A MEDIEVAL PHENOMENON.

IN MEDIEVAL, WITCH HUNTING WAS A VERY RARE -- PEOPLE DIDN'T CARE SO MUCH ABOUT WITCHES IN MEDIEVAL EUROPE.

THE WITCH HUNTS WERE A MODERN PHENOMENON, IGNITED IN PART BY THE PRINT REVOLUTION AND BY THIS FLOOD OF WITCH-HUNTING MANUALS WHICH WERE GOOD FOR USER ENGAGEMENT, AND VERY BAD FOR EVERYTHING ELSE.

>> ONE OF THE THINGS YOU SAY ABOUT ARTIFICIAL INTELLIGENCE THAT MAKES IT FUNDAMENTALLY DIFFERENT FROM EVERY PREVIOUS PART OF THE INFORMATION REVOLUTION IS YOU SAY THAT ARTIFICIAL INTELLIGENCE, A.I., ARE GOING TO BE FULL-FLEDGED MEMBERS OF OUR INFORMATION NETWORKS POSSESSING THEIR OWN AGENCY.

IN OTHER WORDS, THEY'RE GOING TO HAVE THEIR OWN WILL.

>> YES.

>> THEY'RE GOING TO DECIDE WHAT THEY WANT TO DO.

ARE THEY GOING TO HAVE CONSCIOUSNESS?

ARE THEY GOING TO HAVE PLANNING?

ARE THEY GOING TO HAVE FREE WILL?

>> YOU DON'T NEED CONSCIOUSNESS AND FEELINGS IN ORDER TO HAVE GOALS AND AIMS.

WHEN OPENAI MADE GPT 4, THEY WANTED TO TEST WHAT THIS NEW A.I.

COULD DO.

THEY GAVE IT THE TASK OF SOLVING CAPCHA PUZZLES.

IT'S THE PUZZLES YOU ENCOUNTER ONLINE WHEN YOU TRY TO ACCESS A WEBSITE AND THE WEBSITE NEEDS TO DECIDE WHETHER YOU'RE A HUMAN OR A ROBOT.

NOW GPT 4 COULD NOT SOLVE THE CAPCHA, BUT IT ACCESSED A WEBSITE WHERE YOU CAN HIRE PEOPLE ONLINE TO DO THINGS FOR YOU, AND IT WANTED TO HIRE A HUMAN WORKER TO SOLVE THE CAPCHA PUZZLE FOR IT.

NOW THE HUMAN GOT SUSPICIOUS.

IT WROTE TO GPT 4 ONLINE, WHAT'S HAPPENING?

WHY DO YOU NEED SOMEBODY TO SOLVE CAPCHA PUZZLES FOR YOU?

ARE YOU A ROBOT?

THE HUMAN ASKED, ARE YOU A ROBOT?

AND GPT 4 SAID, NO.

I'M NOT A ROBOT.

I'M A HUMAN, BUT I HAVE A VISION IMPAIRMENT, WHICH IS WHY I HAVE DIFFICULTY WITH THESE CAPCHA PUZZLES.

THIS IS WHY I WANT TO HIRE YOU, AND THE HUMAN WAS DUPED AND SOLVED THE CAPCHA PUZZLE FOR GPT 4.

NOW GPT 4 HAS NO CONSCIOUSNESS.

IT HAS NO FEELINGS.

IT DIDN'T FEEL ANXIOUS WHEN THE HUMAN KIND OF QUESTIONED IT.

IT DIDN'T FEEL HAPPY WHEN IT MANAGED TO FOOL THE HUMAN.

IT WAS GIVEN A GOAL, AND IT PURSUED THIS GOAL BY MAKING UP, FOR INSTANCE, EXCUSES THAT NOBODY TOLD IT WHAT TO DO.

THAT'S THE KIND OF REALLY AMAZING AND FRIGHTENING THING ABOUT THESE SITUATIONS.

WHEN FACEBOOK GAVE THE ALGORITHM THE AIM OF INCREASED USER ENGAGEMENT, THE MANAGERS OF FACEBOOK DID NOT ANTICIPATE THAT IT WILL DO IT BY SPREADING HATE-FILLED CONSPIRACY THEORIES.

THIS IS SOMETHING THE ALGORITHM DISCOVERED BY ITSELF.

THE SAME WITH THE CAPCHA PUZZLE, AND THIS IS THE BIG PROBLEM WE ARE FACING WITH A.I.

>> YOU CONCLUDE "NEXUS," YOUR BOOK, WITH A STATEMENT THAT THE DECISIONS WE ALL MAKE IN THE COMING YEARS WILL DETERMINE WHETHER SUMMONING THIS ALIEN INTELLIGENCE, MEANING A.I., THE BEGINNING OF A HOPEFUL NEW CHAPTER IN THE EVOLUTION OF LIFE.

SO I HAVE THAT QUESTION.

WHAT DO YOU MEAN BY WE?

I MEAN, YOU SAID THAT IT'S JUST IN THE HANDS OF A VERY FEW PEOPLE.

HOW DO WE AS PEOPLE WHO DON'T RUN TWITTER, FACEBOOK, HOW DO WE GET INVOLVED?

>> IT STARTS FROM VOTING FOR THE RIGHT PEOPLE IN ELECTIONS THAT WILL REIN IN THE IMMENSE POWER OF THESE TECH GIANTS WHO ARE NOT ELECTED BY ANYBODY, OR NOT REALLY ACCOUNTABLE TO ANYBODY, AND THESE CRUCIAL DECISIONS ABOUT SHAPING THE FUTURE OF HUMANITY NEEDS TO BE MADE BY PEOPLE WHO REPRESENT THE MAJORITY OF US AND NOT JUST BY A FEW BILLIONAIRES AND ENGINEERS.

SECONDLY, IT'S CHOICES WE -- EACH OF US MAKES EVERY DAY.

THE KEY THING IS TO AVOID THE TRAP OF TECHNOLOGICAL DETERMINISM.

THE IDEA THAT ONCE YOU DEVELOP A CERTAIN TECHNOLOGY, IT CAN ONLY GO ONE WAY AND THERE IS NOTHING FOR US BESIDES YOU.

THAT IS NEVER THE CASE.

TECHNOLOGY CAN BE USED IN A LOT OF DIFFERENT WAYS.

YOU CAN USE A KNIFE TO MURDER SOMEBODY OR TO SAVE THEIR LIFE IN SURGERY.

IN THE 20th CENTURY, WE SAW THAT ELECTRICITY AND STEAM POWER AND CARS CAN BE USED TO CREATE TOTALITARIAN DICTATORSHIPS OR DEMOCRACIES.

IT'S THE SAME TECHNOLOGY.

ALSO THE 21st CENTURY WITH A.I.

IT HAS ENORMOUS POSITIVE POTENTIAL, TO CREATE THE BEST HEALTH CARE SYSTEMS IN HISTORY, TO HELP SOLVE THE CLIMATE CRISIS, AND IT CAN ALSO LEAD TO THE RISE OF DYSTOPIAN TOTALITARIAN REGIMES AND NEW EMPIRES, AND ULTIMATELY EVEN THE DISRUPTION OF HUMAN CIVILIZATION, AND THE CHOICE WHICH WAY IT WILL GO, IT'S THE CHOICE THAT ALL OF US NEEDS TO TAKE PART IN.

>> THANK YOU SO MUCH FOR JOINING US.

>> THANK YOU.