Automation Without Understanding

(arxiv.org)

29 points | by root-parent 1 hour ago

7 comments

  • titzer 40 minutes ago
    AIs should be forced to show their work. Every tool they use, every program they generate and run in the background, and every logical inference. They should be forced to produce Lean or Rocq proofs or execution traces for all the computation they use. For facts, they should be able to produce sources. For any abstract reasoning, they should be able to break it down into explainable steps.

    Then, on top of that, they should be able to explain any of that, at any level of detail, whether talking to an expert or a layperson.

  • sachaa 30 minutes ago
    What worries me isn’t AI replacing experts, it’s that we may stop producing people who know enough to notice when AI is confidently wrong.
  • MSkill1 1 hour ago
    I'm not exactly sure how you would go about grading mathematical proficiency. I went through calculus two and discrete mathematics, but I'm sure that there are things I have forgotten now even though I would be considered familiar with most leading edge AI technology. If I'm being honest, I'm not sure I could pass the final exams I took to get my CS degree right now.
  • browski 37 minutes ago
    Yeah how many of us know how to build an ICE engine or shoes of any meaningful quality

    We set upon end of human craftsmanship decades ago

    Math is probably the easiest to reclaim given its right in front our faces going about daily life. The syntax of math is not that important; real world quantification the syntax is meant to represent will still exist. Our biochemistry implicitly operates on senses of enough food and water, etc.

    Such measures are so embedded in the daily routines we live an intuition will always exist

    No one is born knowing how to make a computer as we know them today. A cup half filled is obvious

  • h2aichat 28 minutes ago
    I see many people reacting with fear towards IA and many of them do not feel the same level of danger in other places which are clear to me (and I think that what they fear most is the unknown, as it has to be bad, for sure). I like the quote of the other message from Whitehead !!

    Let's enjoy the ride. It might be last one!

    • koof 5 minutes ago
      Learning and understanding is enjoying the ride.
  • wwweston 30 minutes ago
    See also Bill Thurston’s classic Math Overflow answer to a student wondering where they fit compared to a Gauss or Euler:

    https://mathoverflow.net/questions/43690/whats-a-mathematici...

    “The product of mathematics is clarity and understanding. Not theorems, by themselves. [Their importance is not just in their specific statements], but their role in challenging our understanding, presenting challenges that led to mathematical developments that increased our understanding.

    The world does not suffer from an oversupply of clarity and understanding (to put it mildly)… In short, mathematics only exists in a living community of mathematicians that spreads understanding and breaths life into ideas both old and new. The real satisfaction from mathematics is in learning from others and sharing with others. All of us have clear understanding of a few things and murky concepts of many more. There is no way to run out of ideas in need of clarification. The question of who is the first person to ever set foot on some square meter of land is really secondary. Revolutionary change does matter, but revolutions are few, and they are not self-sustaining --- they depend very heavily on the community of mathematicians.”

    • lioeters 13 minutes ago
      Curious to see if that can map to what's happening in the software industry/community.

      > The product of software engineering (or computer science) is clarity and understanding. Not programs, by themselves. Their importance is not just in their specific statements (lines of code in a specific language), but their role in challenging our understanding, presenting challenges that led to computational (?) developments that increased our understanding.

      > ..In short, software only exists in a living community of developers that spreads understanding and breaths life into ideas both old and new. The real satisfaction from computers is in learning from others and sharing with others.

      That seems to work. What about other areas of human activity that are currently being consumed by automation and "AI"? Like writing, the arts, or the sciences.

  • measurablefunc 1 hour ago
    "Civilization advances by extending the number of important operations which we can perform without thinking about them." - A. N. Whitehead
    • dehsge 2 minutes ago
      “It is the first step in sociological wisdom, to recognize that the major advances in civilization are processes which all but wreck the societies in which they occur:—like unto an arrow in the hand of a child. The art of free society consists first in the maintenance of the symbolic code; and secondly in fearlessness of revision, to secure that the code serves those purposes which satisfy an enlightened reason. Those societies which cannot combine reverence to their symbols with freedom of revision, must ultimately decay either from anarchy, or from the slow atrophy of a life stifled by useless shadows.” A. N. Whitehead
    • titzer 39 minutes ago
      Yes, now we can do thinking without thinking. Good job.
      • measurablefunc 30 minutes ago
        Computers can not think & that is why they are useful. Thinking computers would become very problematic very quickly.
        • em-bee 18 minutes ago
          but people thinking that computers and specifically AI are thinking and therefore their answers are thought through is equally problematic i think.