This AI just passed a science test and may be smarter than an eighth grader

[steven36]

WWE star John Cena currently hosts a game show on Nickelodeon that asks one question: “Are you smarter than a 5th grader?” At least one AI can affirmatively say yes. In fact, it may be smarter than a sixth grader, a seventh grader, and an eighth grader, too.

 

 

The artificial intelligence system, called Aristo, just passed an eighth-grade science test, a benchmark in AI development that scientists had been aiming to reach for four years, The New York Times reports.

 

Aristo didn’t just squeak by the test, either. It got an A on the quiz, correctly answering more than 90% of the questions on the test designed for New York students, and then it went on to answer questions on an exam for 12th graders, earning a solid B (80%).

 

The AI’s science prowess shows how far artificial intelligence has come at mimicking human logic, language, and decision-making. Unlike your average eighth grader, the AI, which was designed by the Allen Institute—the lab founded by the late Microsoft cofounder Paul Allen—was built solely to take multiple-choice tests. According to the Times, the researchers view standardized science tests as a more meaningful AI benchmark than the machine’s ability to play chess, and Aristo passed with flying colors. It’s just a matter of time until researchers create an AI that can go to MIT and create itself, kickstarting some sort of rift in the very fabric of the universe.

 

Now some savvy eighth grader just needs to harness the power of the AI to ace their science test and prove to those clever machines who is really the boss.

 

Source

 

[Jogs]

This is not AI at all, real AI will be one that can pass real world test.

Tests designed for students are limited to certain curriculum.

If 100 questions are asked then must be part of some 1000 questions or so. Its actually the programmers intelligence by which he /she can guess whats going to be questions.

[steven36]

1 hour ago, Jogs said:

This is not AI at all, real AI will be one that can pass real world test.

Tests designed for students are limited to certain curriculum.

If 100 questions are asked then must be part of some 1000 questions or so. Its actually the programmers intelligence by which he /she can guess whats going to be questions.

What you say don't make a bit of sense because real world test means field test ,final product test , beta test.

https://www.thesaurus.com/browse/real-world test

 

From 'F' to 'A' on the N.Y. Regents Science Exams: An Overview of the Aristo Project

 

AI has achieved remarkable mastery over games such as Chess, Go, and Poker, and even Jeopardy, but the rich variety of standardized exams has remained a landmark challenge. Even in 2016, the best AI system achieved merely 59.3% on an 8th Grade science exam challenge.

This paper reports unprecedented success on the Grade 8 New York Regents Science Exam, where for the first time a system scores more than 90% on the exam's non-diagram, multiple choice (NDMC) questions. In addition, our Aristo system, building upon the success of recent language models, exceeded 83% on the corresponding Grade 12 Science Exam NDMC questions. The results, on unseen test questions, are robust across different test years and different variations of this kind of test. They demonstrate that modern NLP methods can result in mastery on this task. While not a full solution to general question-answering (the questions are multiple choice, and the domain is restricted to 8th Grade science), it represents a significant milestone for the field.

https://arxiv.org/abs/1909.01958

 

A few years ago no AI could even pass these test now Aristo can . Every Human takes test in School  in order  for AI  to be more like humans they must be able to past the same kind of test humans take, In order  to graduate from High school In New York you must past this test.  

 

You may be talking about a Turning test? were the AI can fool humans into thinking it's real,  While  and AI could fool a human on the internet  or TV as real the only reason it can is because it's on the internet and videos and sound are just live or recorded transmissions . In order to pass such a test in the real world the AI  would have to a be split clone of a human . 

1st lesson of using the internet,  dont believe everything on the internet . research  it yourself to see if it real if you cant  figure it out when 1st said the truth will revel itself sooner or latter... even if it's years latter and everyone forgot about.it .So keep searching for the truth. That's why i love history because history reviles the truth no matter how much people in the present be in denial of the truth .  .