The message is very simple, from the book "Weapons of math destruction", by Cathy O'Neil - our current models used to cut through the data deluge are efficient but biased. People modelling them are biased and there is no incentive to improve them, even if there is collateral damage. Companies selling AI tools are not incentivized on making the "magic-formula" public, open to debate. The users discover the defects after years and after people's life are affected. For the majority there is no feed-back mechanism, or no way to correct the wrong-doing. The book does not offer a solution to the existent AI used in crunching data. We are biased, but there is hope: openness, dialog and analysis of the results, especially for people who are affected by the algorithms. Reading the book I remember reading about Google - where they did not know how to use the interviews and post-mortem analysis of the people hired in order to get the right formula of picking the...
This blog is about life events and reflections of an IT consultant, intersections with culture and personal life events. Toronto is my home.