It takes a lot of automation to make the nation's largest city run, but it's easy for that kind of automation to perpetuate existing problems and fall unevenly on the residents it's supposed to serve. So to mitigate the harms and ideally increase the benefits, New York City has created a high-level city government position essentially to manage algorithms.
Mayor Bill de Blasio created the job, formally titled the Algorithms Management and Policy Officer, with an executive order he signed last week. The person who ultimately holds the role will be responsible for, basically, ethics management, which entails developing guidelines and best practices to make the city's automated decision-makers make more equitable, fair, and transparent decisions.
Why now?
The mayor's office announced the creation of the position following the publication of a report (PDF) by a city panel called the Automated Decision Systems Task Force, which spent about 18 months assessing the city's use of what it calls automated decision systems, or ADS.
"The use of ADS is increasing both within New York City government and in municipalities across the United States," the report notes, "as cities continue to see value in delivering services more quickly and effectively to residents who depend on them, streamlining decision-making processes, expanding their abilities to help their residents, and attempting to identify and remove any human bias from their work."
The panel's top recommendation was the creation of a single entity in the city government to standardize baseline principles to be applied by all other agencies within the city government that rely on automated decision-making. The report also suggests principles the manager should incorporate into that baseline framework when it is developed.
A strong public education and transparency program should be among those considerations, the report says. The city should not only explain in plain language what algorithmic systems are in place but also create processes in which individuals can request more information about the decisions made by those systems, why those decisions are made, and potentially challenge those decisions.
Bigger than the Big Apple
In some ways, the city may prove a test bed for the rest of the nation. With a population of about 8.6 million, New York City has more residents squeezed into its square miles than the majority of US states. The city's five boroughs, standing alone, would be the 12th largest state by population, squeezing in after New Jersey and just ahead of Virginia.
Decisions in every department of every state are increasingly being handed over to software systems that often prove both opaque and biased. Entire Read More – Source
