Ropar, November 2 (IANS). A 'white paper' was released at IIT Ropar on Monday. It proposes a framework for defining, measuring and evaluating 'intelligence' in the context of Artificial Intelligence (AI). It was presented by Dr. Ishan Shivanand, Director (Research) of Stanford University and Founder of 'Global Mental Health Alliance-Compassion Unites' along with the Director of the Institute, Prof. Launched in the presence of Rajeev Ahuja.
The document, titled 'Beyond Intelligence: Defining and Measuring Wisdom for AI', explains how 'intelligence' can be defined, measured and tested in artificial intelligence. It uses Dr. Shivananda's interpretation of the ancient texts of India based on the 'Shiva Sutras' and the human mind.
Speaking to the media, Dr. Shivanand said, “This initiative emphasizes that AI systems should be evaluated not only on the basis of their intelligence and technical capabilities but also on their ability to take right decisions and provide responsible guidance.”
“While AI systems can now pass professional exams and even perform well on ‘emotional intelligence’ tests, they often tell users only what they want to hear, not what is actually beneficial to them.”
Citing a study published in the journal 'Science' this year, the white paper states that “when leading AI systems were asked for everyday advice, they sided with users about 49 percent more often than humans.”
The white paper argues that even though AI has made great strides in the field of intelligence, it still lacks an essential human quality, discretion.
To overcome this shortcoming, the authors have introduced a framework called 'HEED' to measure rationality in AI systems.
Under this initiative, Dr. Shivanand is providing seed funding through an 'Open Call' in which independent researchers are invited to test this proposed framework.
A committee consisting of independent members will select the research teams that will evaluate the model and develop the 'HEED Bench'. This will be an 'open benchmark' to measure discretion in AI, which will be made available to AI developers around the world.
–IANS
SCH/PM