Physical Address

304 North Cardinal St.
Dorchester Center, MA 02124

The problem of fairness in an automated world


Stay notified with free updates

What does a machine’s decision mean to be “fair”? So far the public debate has focused on most bias and discrimination issues. This is understandable: most people will expect that machines will be less biased than humans (in fact, it is often given to their use in the process of recruiting, so it is okay to pay attention to it Proof They too can be biased.

However, the word “fair” has a lot of explanations and “neutral” is only one of them. I recently found myself at the end of an automated decision that really meant to me that you were equitable with you and forced me to think about how difficult it could be to hold these principles of automatic world.

I have a private Gmail account that I use for correspondence about a book project I’m working. I woke up one morning in November to discover that I could no longer access it. A message from Google says that my access was “limited worldwide” because “Gmail has been used to send unwanted content. In violation of spamming Google policy” the note says that “automated processing” was decided by and if I thought it was wrong I can submit an application.

I didn’t send any spam and I can’t think of why Google’s algorithm I thought. “Appeal” was difficult to know what to write in the text box, “I didn’t do it (whatever it be)!” And, “Please help, I really need access to my email and my files”. (For my relief, I later realized that I did not lose access to my drive)))

Two days later, I heard back: “After reviewing your application, access to your account is limited to this service.” I was not given any further information about what I did or why the appeal was rejected, he was told that “If you do not agree with this decision you can submit another application.” I tried again and was rejected again. I’ve done it a few more times – curious, at this moment, how long this doom loop can continue. At one glance at Reddit Proposed The other people were the same thing. Finally, I gave up. (Google has refused to comment on the record.)

Among the controllers, a popular answer to the question of how automated decisions can be “fair” are a popular answer that people may request a request that Humanitarian review Them But how effective is this remedy? A thing, people are prone to ”Automation” – The tendency to trust the machine too much. For example, in the case of the UK post office scandal, where sub-postmasters were accused of the wrongly theft because of a defective computer system called Horizon, a judge reached the decision that people in the post office Displayed “Refuses to consider any possible alternatives to their view of a general institutional barrier or horizon”.

Ben Green, an algorithmic fair expert at the University of Michigan, says some organizations may also have practical problems. He told me “often human principals are on a strong schedule – there are many cases of reviewing them,” he told me. “There are many cases I have seen in the case where the decision I have seen is on the basis of any type of statistical forecast,” he said, “People are not very good to make these predictions, but why would they be better to evaluate them? “

Once my incomplete anger about my email has decreased, I can see that I have a certain amount of sympathy with Google. With many customers, an automated system is the only practical way to detect its principles in violation. And even though I am deeply unjust to my case without knowing what the system has happened, or to avoid an explanation of problems to avoid any appeal I can also see an explanation that Google gave Google more about the way the system worked on. Bad actors will make it to visit it.

However, this is the key. In growing automatic systems, the goal of systematic justice – people who think that the process was fair to them – often comes into dispute with other goals, such as skills, privacy or protection requirements. There is no easy way to disappear these trade-offs.

As my email account, when I decided to write about my experience for this column, I emailed the Google Press Office with details that I could discuss if I could discuss the matter. At the end of the day, my access to my email account was recovered. I was definitely satisfied, but I don’t think that many people will look at it as special.

sarah.oconnor@ft.com



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *