This article is about the Economist's summary of a journal article so we have a (AI?) summary of a summary. Not very helpful. Here are a couple of better references:
Guess what this is probably fine. AI helps people do their work on a daily basis and probably makes them memorize less things. That’s how the world is moving. You don’t need to be able to memorize something for an exam to show mastery of a topic. And we shouldn’t organize our society around memorizing things for exams.
This is too simplistic. There are disciplines, like Anatomy, where you're basically just memorizing bones, glands, and other parts of the human body. For organic chemistry, students need to memorize most of the krebs cycle diagram for their exams (because doing so and drawing it lets them reference it later).
Thinking is infinitely more complex than "critical thinking" vs. rote functions. You want students to get to critical, eventually, but the lower orders on bloom's taxonomy serve important roles, too.
Course design built around multiple choice questions, essays, and a lot of the historical assessments that we're used to are largely not great for learning in the first place—–they're used because they can be auto-graded or score assigned quickly. AI, conversely, is kind of revealing the limitations of these outmoded learning design practices.
Think of the meme going around right now from Milennials to Gen Z: "I wrote a 5 page essay on a book I never read!" <- They're saying this to AI generated essays as if there's any difference in the critical thinking that comes out of an exercise like that (read: absolutely none).
AI is a new tech—so of course people are still figuring out the limits of it. In 10 years a lot of the paradigm will be set. Until then, students are unfortunately kind of in the thick of it.
What is a doctor? The person recommending next course of action based on best practices. What is the best practice? Is it a globally decided on thing, a locally tested thing that has proven to be better? Is the global thing just the most popular because someone wrote it on reddit and it got millions of views (but isn't actually good).
If our society is organized on just delegating all authority to "the best answer" we can drop all jobs - and only the surgeon has some authority over the machine. When we have a surgery robot, then they can go to. And at some point we'll be recommending and forcing surgery for athletes foot because some kind of best practice or viral post going out of control and a bunch of openclaw bots randomly decide to make tons of recommendations online for amputation for athletes foot and GPT 8.6 agrees this is the way to go.
OR we can somehow decide there is a boundary, there is some room for human memory and decisions.
I actually think having a single source of truth would not be terrible.
Let me explain.
All podiatrists are not the same. All physicians in their specialties are often specializing in their own niche and are up-to-date on that niche.
I've had lisfranc ligament injury. My podiatrist wanted to perform a surgery quickly, which in 90% of cases is advised. I decided to seek a 2nd opinion because I realized she did the X-rays wrong, as she did them non-weight bearing, which is useless if there are no fractures.
The specialist was excited to see me, and up to date on all the lisfranc research. I've had a really bad sprain and he said conservative treatment should be sufficient. It took months but I healed up.
I've had quite a few injuries from playing sports and often found doctors to be "wrong" simply because their knowledge was out of date.
How do you differentiate between mastery of a topic and mastery of using an AI in an exam setting?
Open book tests and allowed cheat sheets already solve the memorization-is-not-required gap. It seems like allowing use of AI pushes that closer to thinking-is-not-required. And if no thinking is required, then how can you prove personal mastery?
It's critical to understand the fundamentals on your own and that is different from AI being used in public. Sure school doesn't have as much value as it used to but it was always more about social credit or a certification that you took the time and effort to understand the world under pressure (obviously not true for all disciplines) or goals attached preferably in group settings.
This is something that AI cannot replace. Viewing things as memorizing is the wrong take.
Memorizing stuff is good for understanding. Of course memorizing without understanding doesn't really help, which is what a lot of student last-minute "cramming" boils down to. But without concrete and memorized knowledge, any abstract reasoning skills become quickly impossible.
Homework is boring. I had a tough enough time focusing on it in the 90s when computers and video games were still a drag to get going... Imagine explaining to a child today that they need to sit down and do an hour of math homework every other night?
Homework isn't boring.....its the social media and addictive games that completely are destroying our attention span.
After I detox from online games, I can go back to learning new "boring" stuff. There are nerds(myself included) who find learning fun, and using AI boring because it doesn't scratch the learning itch.
Meetings are still like exams, if you can't craft a line of thinking on the spot it doesn't come off well.
You don't need a final answer but you can't just answer "I don't know" otherwise you risk being slimed (shout out to anyone who still remembers "You Can't Do That on Television")
I can see that. Personally, I use that for people who like to go down tedious rabbit holes and want to free up the rest of the attendees to go back to work.
Every conversation you have with a person is an "exam." Not being able to extemporaneously express yourself or reason analytically without running to Claude seems undesirable.
In my professional career, my clients value the depth of ready knowledge that helps me use my tools with particular insight and finesse -- a kind of knowledge that exams demonstrated far more effectively than homework when I was back in school.
> The social aspects are more important than the exam sitting most of the time.
To spell it out more clearly: every single aspect of your career is an exam. The interview is an exam, quite literally. The day-to-day responsibilities (meetings, planning, problem-solving, collaborating) are parts of the exam. If you're failing at those or automating them away, then what is your role? The assignments (solve X bug or add Y feature) are parts of the exam too. Failing to do these things will mean that, yes, you are failing the exam.
This is the answer. Many (all?) European schools don’t give homework (this is partly because of the way the grad programs work). It’s on the students to study in order to pass the (difficult) exams.
Seems like they effectively did abolish homework if AI is now doing it all for them. The result is that fewer students pass the exams, not more.
As with any skill, practice is necessary to achieve competence. If homework is no longer a viable way to force students to practice, you'll need to find some replacement, you can't just abolish it and expect there to be no negative consequences.
Yeah, obviously. We also don't know how to use flint and steel to start fires any more. You wouldn't outlift a crane, why would you want to outhomework an AI? And you can't even argue that this toil is going to help in the workplace, because the workplace is now AI-native, and you can offload everything to AI.
These are students aged 12-18. Even if we ignore all the other negative externalities of AI and assume it will be ubiquitous and cheap, kids need repetition and exercises to make inferences and develop intuition.
Sure - you can ask AI to, for instance, calculate how much money you'll have given a fixed principal and a compounding interest rate. But we need to get a kid to the point where they even understand what the question to be answered is. If they're using AI all along the way, they are developing less understanding of what fractions and exponential growth are.
Will it stop the really smart and motivated kids? Of course not. But at population scale there will be big consequences.
The important thing is that I could learn to use a flint and steel pretty easily if I wanted to. I don't need to carry out that particular task, but my ability to adapt to new problems means I can carry out more relevant tasks when needed. The most useful part of school and university for me wasn't that I learned the difference between a cirrocumulus and a cirrostratus cloud in geography class. It's that I learned how to learn.
If we let children cheat their way through school and justify it by saying they don't really need to think for themselves anymore, then we're going to end up with a generation of adults who struggle to take on any difficult tasks at all. I suppose your counter-argument to that will be "but we can just hand over everything to the AI" but that's an essentially an argument that humans should be considered obsolete altogether. I sincerely hope that that's not a path we end up going down (although I'm genuinely scared that it is).
> I hope we'll figure out some equitable society before that, but I'm not going to bet on it, so I'll do what I can to be on the side of the winners.
Obviously people care if they think they might lose out.
Is it going to be this hopes-and-prayers about egalitarianism/ah screw it I hope I get to oppress and dominate the majority? Or all of us sipping wine on the beach for eternity?
Sure. Let's not think too hard about what it means that general thinking and creativity are the skills we've stopped practicing this time. It will be fine.
(You may be making the same point as me or the opposite point, I can't tell what's sarcasm anymore. I try to make mine obvious.)
This article is about the Economist's summary of a journal article so we have a (AI?) summary of a summary. Not very helpful. Here are a couple of better references:
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=6868618
https://archive.is/w1eng
Also note the findings are more nuanced than may appear on the surface.
Appreciate your summary of this summary of the economist’s summary of the paper.
Guess what this is probably fine. AI helps people do their work on a daily basis and probably makes them memorize less things. That’s how the world is moving. You don’t need to be able to memorize something for an exam to show mastery of a topic. And we shouldn’t organize our society around memorizing things for exams.
This is too simplistic. There are disciplines, like Anatomy, where you're basically just memorizing bones, glands, and other parts of the human body. For organic chemistry, students need to memorize most of the krebs cycle diagram for their exams (because doing so and drawing it lets them reference it later).
Thinking is infinitely more complex than "critical thinking" vs. rote functions. You want students to get to critical, eventually, but the lower orders on bloom's taxonomy serve important roles, too.
Course design built around multiple choice questions, essays, and a lot of the historical assessments that we're used to are largely not great for learning in the first place—–they're used because they can be auto-graded or score assigned quickly. AI, conversely, is kind of revealing the limitations of these outmoded learning design practices.
Think of the meme going around right now from Milennials to Gen Z: "I wrote a 5 page essay on a book I never read!" <- They're saying this to AI generated essays as if there's any difference in the critical thinking that comes out of an exercise like that (read: absolutely none).
AI is a new tech—so of course people are still figuring out the limits of it. In 10 years a lot of the paradigm will be set. Until then, students are unfortunately kind of in the thick of it.
What is a doctor? The person recommending next course of action based on best practices. What is the best practice? Is it a globally decided on thing, a locally tested thing that has proven to be better? Is the global thing just the most popular because someone wrote it on reddit and it got millions of views (but isn't actually good).
If our society is organized on just delegating all authority to "the best answer" we can drop all jobs - and only the surgeon has some authority over the machine. When we have a surgery robot, then they can go to. And at some point we'll be recommending and forcing surgery for athletes foot because some kind of best practice or viral post going out of control and a bunch of openclaw bots randomly decide to make tons of recommendations online for amputation for athletes foot and GPT 8.6 agrees this is the way to go.
OR we can somehow decide there is a boundary, there is some room for human memory and decisions.
I actually think having a single source of truth would not be terrible. Let me explain.
All podiatrists are not the same. All physicians in their specialties are often specializing in their own niche and are up-to-date on that niche.
I've had lisfranc ligament injury. My podiatrist wanted to perform a surgery quickly, which in 90% of cases is advised. I decided to seek a 2nd opinion because I realized she did the X-rays wrong, as she did them non-weight bearing, which is useless if there are no fractures.
The specialist was excited to see me, and up to date on all the lisfranc research. I've had a really bad sprain and he said conservative treatment should be sufficient. It took months but I healed up.
I've had quite a few injuries from playing sports and often found doctors to be "wrong" simply because their knowledge was out of date.
How do you differentiate between mastery of a topic and mastery of using an AI in an exam setting?
Open book tests and allowed cheat sheets already solve the memorization-is-not-required gap. It seems like allowing use of AI pushes that closer to thinking-is-not-required. And if no thinking is required, then how can you prove personal mastery?
Good exams don't just test memorization
It's critical to understand the fundamentals on your own and that is different from AI being used in public. Sure school doesn't have as much value as it used to but it was always more about social credit or a certification that you took the time and effort to understand the world under pressure (obviously not true for all disciplines) or goals attached preferably in group settings.
This is something that AI cannot replace. Viewing things as memorizing is the wrong take.
Memorizing stuff is good for understanding. Of course memorizing without understanding doesn't really help, which is what a lot of student last-minute "cramming" boils down to. But without concrete and memorized knowledge, any abstract reasoning skills become quickly impossible.
One more step towards eliminating the value of labor entirely. What "work" will people be doing on a daily basis, and what makes it valuable?
Definitely not fine. People are graduating from Computer Science programs literally unable to write a line of code without AI assistance.
These people have fallen into OpenAI and Anthropic's trap and are illiterate without the assistance of coin-operated slop generators.
Yup this is the devious plan.
Thank god for china!
Learning in school is so broken.
Homework is boring. I had a tough enough time focusing on it in the 90s when computers and video games were still a drag to get going... Imagine explaining to a child today that they need to sit down and do an hour of math homework every other night?
I just can't see it happening.
It's too boring.
I don't have a solution to this problem.
Homework isn't boring.....its the social media and addictive games that completely are destroying our attention span.
After I detox from online games, I can go back to learning new "boring" stuff. There are nerds(myself included) who find learning fun, and using AI boring because it doesn't scratch the learning itch.
So your complaint is...it's boring?
The point is to train the brain via repitition and iteration.
If your goal is entertainment, I'm not sure what you are looking for.
This site is flush with C students who are upset that they graduated before AI had the opportunity to destroy their learning experience.
Yep, learning is hard work.
I don't like doing anything hard, which is why I outsource all of my thoughts to for-profit slop generators.
Don't make any commentary on my intelligence or I'll get you banned.
In my professional career, my employers give me a lot more assignments than exams.
Meetings are still like exams, if you can't craft a line of thinking on the spot it doesn't come off well.
You don't need a final answer but you can't just answer "I don't know" otherwise you risk being slimed (shout out to anyone who still remembers "You Can't Do That on Television")
“I don’t know but after this meeting I will find out and get back to you”
Is an acceptable answer.
It's only an acceptable answer when used sparingly. The more often it's used, the more questions arise about your role in that meeting.
I can see that. Personally, I use that for people who like to go down tedious rabbit holes and want to free up the rest of the attendees to go back to work.
Every conversation you have with a person is an "exam." Not being able to extemporaneously express yourself or reason analytically without running to Claude seems undesirable.
In my professional career, my clients value the depth of ready knowledge that helps me use my tools with particular insight and finesse -- a kind of knowledge that exams demonstrated far more effectively than homework when I was back in school.
The exams aren't the thing that matter, they're an experiment to measure the thing that matters. Which, presumably, still matters at work!
Your employer gave you your job based on your exam results.
Your career is a continual exam and the assignments are just parts of it.
Fortune cookie ass statement.
Your career is more akin to the totality of school than it is to any specific facet of it imo.
The social aspects are more important than the exam sitting most of the time.
> Fortune cookie ass statement.
> The social aspects are more important than the exam sitting most of the time.
To spell it out more clearly: every single aspect of your career is an exam. The interview is an exam, quite literally. The day-to-day responsibilities (meetings, planning, problem-solving, collaborating) are parts of the exam. If you're failing at those or automating them away, then what is your role? The assignments (solve X bug or add Y feature) are parts of the exam too. Failing to do these things will mean that, yes, you are failing the exam.
Disagree. School exams test for academia-readiness too. And sometimes the schools and lecturers are filled with ideology irrelevant to real work.
Career exams tend to be a mix but a lot less ideology.
One of the main reasons safety standards are written in blood.
abolish homework
This is the answer. Many (all?) European schools don’t give homework (this is partly because of the way the grad programs work). It’s on the students to study in order to pass the (difficult) exams.
Seems like they effectively did abolish homework if AI is now doing it all for them. The result is that fewer students pass the exams, not more.
As with any skill, practice is necessary to achieve competence. If homework is no longer a viable way to force students to practice, you'll need to find some replacement, you can't just abolish it and expect there to be no negative consequences.
We cannot be boosting AI slop like this
Yeah, obviously. We also don't know how to use flint and steel to start fires any more. You wouldn't outlift a crane, why would you want to outhomework an AI? And you can't even argue that this toil is going to help in the workplace, because the workplace is now AI-native, and you can offload everything to AI.
These are students aged 12-18. Even if we ignore all the other negative externalities of AI and assume it will be ubiquitous and cheap, kids need repetition and exercises to make inferences and develop intuition.
Sure - you can ask AI to, for instance, calculate how much money you'll have given a fixed principal and a compounding interest rate. But we need to get a kid to the point where they even understand what the question to be answered is. If they're using AI all along the way, they are developing less understanding of what fractions and exponential growth are.
Will it stop the really smart and motivated kids? Of course not. But at population scale there will be big consequences.
The important thing is that I could learn to use a flint and steel pretty easily if I wanted to. I don't need to carry out that particular task, but my ability to adapt to new problems means I can carry out more relevant tasks when needed. The most useful part of school and university for me wasn't that I learned the difference between a cirrocumulus and a cirrostratus cloud in geography class. It's that I learned how to learn.
If we let children cheat their way through school and justify it by saying they don't really need to think for themselves anymore, then we're going to end up with a generation of adults who struggle to take on any difficult tasks at all. I suppose your counter-argument to that will be "but we can just hand over everything to the AI" but that's an essentially an argument that humans should be considered obsolete altogether. I sincerely hope that that's not a path we end up going down (although I'm genuinely scared that it is).
It’s not ‘even the learned how to learn’.
It’s the exposure to feeling under pressure, creativity of the mind etc - the less you expose a human to ‘suffering’ the more useless they become.
Why one would care? Look at your comment from two days ago.
https://news.ycombinator.com/item?id=49363319
> I hope we'll figure out some equitable society before that, but I'm not going to bet on it, so I'll do what I can to be on the side of the winners.
Obviously people care if they think they might lose out.
Is it going to be this hopes-and-prayers about egalitarianism/ah screw it I hope I get to oppress and dominate the majority? Or all of us sipping wine on the beach for eternity?
https://news.ycombinator.com/item?id=49366313
You gotta pick a lane with your rah-rah-ism.
Sure. Let's not think too hard about what it means that general thinking and creativity are the skills we've stopped practicing this time. It will be fine.
(You may be making the same point as me or the opposite point, I can't tell what's sarcasm anymore. I try to make mine obvious.)
you know we let social media companies cause massive harm over 2 decades; but clearly, this will be deifferent!