小蓝视频

Credit: Rokas - stock.adobe.com

Every day, AI plays a greater role in our lives鈥攑owering search engines and social media, optimizing Uber routes and Waze directions, enhancing health diagnostics, fortifying cybersecurity, and streamlining supply chains. The list goes on. But as companies race to integrate AI into their products and services, rigorous evaluation has become essential鈥攂ecause when AI fails, the consequences can be severe.

鈥淓valuating machine learning models is crucial in today's world because AI influences so many aspects of daily life,鈥� says 小蓝视频 Computer Science Professor Nathalie Japkowicz. 鈥淚f these systems aren鈥檛 carefully checked for accuracy, fairness, or even basic common sense, they can do real harm. That鈥檚 why AI evaluation isn鈥檛 just important鈥攊t鈥檚 necessary.鈥�

Japkowicz and fellow Data Science Professor Zois Boukouvalas teamed up to publish a timely book on this subject, titled . The book brings together information from research papers, blogs, and other sources into one easy-to-use guide for anyone who is concerned about responsible AI鈥攁nd it looks at ways to measure how machine learning systems perform, including how to ensure fairness, avoid bias, and ensure that results are easy to understand. 听

鈥淲ith this book,鈥� Boukouvalas says, 鈥渙ur goal is to make evaluation tools widely accessible to everyone working with AI, empowering them to assess and enhance AI systems effectively and in a fair manner.鈥�

When AI Goes Wrong: Bias and Equity Issues

Artificial Intelligence systems may seem neutral and objective, but they can produce biased or inaccurate results because they learn from human-generated data, which can reflect existing prejudices. As Boukouvalas points out, flawed AI systems can reinforce inequities in surprising and troubling ways. In 2015, Google Photos faced backlash when its AI, trained on biased data, misidentified people of color with offensive labels. In response, Google expanded its dataset diversity and introduced rigorous bias audits to improve accuracy and fairness. A similar issue occurred during the COVID-19 pandemic when early vaccine distribution algorithms unintentionally favored wealthier areas. By reassessing these models with fairness metrics, researchers were able to ensure that the vaccines reached underprivileged communities. It was a correction that saved lives, says Boukouvalas.

Another example is facial recognition technology, in everything from unlocking phones to security systems. 鈥淚f these systems are trained with biased or incomplete data, they might struggle to recognize faces of certain demographics, leading to false identifications or failures in critical applications,鈥� Japkowicz says. 鈥淭here have been real-life instances where facial recognition systems misidentified people of color at alarming rates, causing unjust accusations and tarnished reputations.鈥�

Life-Threatening Consequences

Sometimes, when AI makes mistakes, it can be fatal. In healthcare, where AI promises to revolutionize patient care, the stakes are incredibly high, like in hospitals that use AI to help prioritize patients in emergency rooms. 鈥淚f the model behind this system is not properly evaluated, it might make life-or-death decisions based on flawed assumptions,鈥� Japkowicz says.

Perhaps the most well-publicized issue is self-driving cars, which rely on AI to make split-second decisions about when to brake or accelerate. 鈥淚f the AI has not been rigorously tested under all sorts of real-world conditions,鈥� Japkowicz explains, 鈥渋t might fail to recognize a pedestrian at night or misinterpret a traffic signal, leading to tragic accidents.鈥� 听

The bottom line is that machine learning models are like decision-making engines, and their decisions could affect real people. 鈥淚f we do not evaluate these models thoroughly, we risk letting AI perpetuate biases, make unfair choices, or even cause harm,鈥� Boukouvalas says. 鈥淏y prioritizing rigorous evaluation, we can help ensure that AI systems not only work but work responsibly, making life better for everyone.鈥�

A Guide for Beginners and Experts

Machine Learning Evaluation: Towards Reliable and Responsible AI covers a wide range of topics like these, including how machine learning works with different types of data, how to check if the training data is fair, and how to make sure the results are reliable. The book explores more advanced topics like unsupervised learning, image processing, and detecting unusual patterns. Plus, it discusses key issues like fairness, responsible AI, and how to build high-quality machine learning products. Implementations using Python and scikit-learn are available on the book's website. Readers will also find a large variety of evaluation tools and easy-to-use software implementations. 听Boukouvalas and Japkowicz believe that everyone鈥攆rom casual ChatGPT users to software engineers鈥攏eeds to know about AI evaluation, and she incorporates evaluation into her courses at 小蓝视频. 鈥淢ost of our computer science and data science students get exposed to at least one course dealing with AI during the course of their study program at 小蓝视频,鈥� Boukouvalas says. 鈥淢any students take a series of AI classes, and some do capstone projects and independent research on AI.鈥澨�