jmetaB037a63b4b28cfac6a4eef9f38a214bffc793a1b6a91b941b8a48552a3150a5d7f7@631ad085bb5f3d4e7077c362fe9bc47b8532fb5ae611165bcb7ddb8845e682eerss.item metarss.netM[e<item><title>Shiptâs Algorithm Squeezed Gig Workers. They Fought Back</title><link>https://spectrum.ieee.org/shipt</link><description><![CDATA[ <img src="https://spectrum.ieee.org/media-library/image.png?id=52511774&width=1200&height=600&coordinates=0%2C996%2C0%2C997"/><br/><br/><p> <strong>In early 2020, </strong>gig workers for the app-based delivery company <a href="https://www.shipt.com/" target="_blank">Shipt</a> noticed something strange about their paychecks. The company, which had been acquired by Target in 2017 for US $550 million, offered same-day delivery from local stores. Those deliveries were made by Shipt workers, who shopped for the items and drove them to customersâ doorsteps. Business was booming at the start of the pandemic, as the COVID-19 lockdowns kept people in their homes, and yet workers found that their paychecks had becomeâ¦unpredictable. They were doing the same work theyâd always done, yet their paychecks were often less than they expected. And they didnât know why. </p><p> On Facebook and Reddit, workers compared notes. Previously, theyâd known what to expect from their pay because Shipt had a formula: It gave workers a base pay of $5 per delivery plus 7.5 percent of the total amount of the customerâs order through the app. That formula allowed workers to look at order amounts and choose jobs that were worth their time. But Shipt had changed the payment rules without alerting workers. When the company finally issued a press release about the change, it revealed only that the new pay algorithm paid workers based on âeffort,â which included factors like the order amount, the estimated amount of time required for shopping, and the mileage driven. </p><p class="shortcode-media shortcode-media-rebelmouse-image rm-resized-container rm-resized-container-25 rm-float-left" data-rm-resized-container="25%" style="float: left;"> <img alt="A flow chart shows how a text-based tool parsed the data from workers\u2019 screenshots and drew out the relevant information." class="rm-shortcode rm-resized-image" data-rm-shortcode-id="742a74f88d1525f7e24bd5fdb6a275a7" data-rm-shortcode-name="rebelmouse-image" id="30f0a" loading="lazy" src="https://spectrum.ieee.org/media-library/a-flow-chart-shows-how-a-text-based-tool-parsed-the-data-from-workers-u2019-screenshots-and-drew-out-the-relevant-information.png?id=52516591&width=980" style="max-width: 100%"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">The Shopper Transparency Tool used optical character recognition to parse workersâ screenshots and find the relevant information (A). The data from each worker was stored and analyzed (B), and workers could interact with the tool by sending various commands to learn more about their pay (C). </small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Dana Calacci</small> </p><p> The company claimed this new approach was fairer to workers and that it better matched the pay to the labor required for an order. Many workers, however, just saw their paychecks dwindling. And since Shipt didnât release detailed information about the algorithm, it was essentially a black box that the workers couldnât see inside. </p><p> The workers could have quietly accepted their fate, or sought employment elsewhere. Instead, they banded together, gathering data and forming partnerships with researchers and organizations to help them make sense of their pay data. Iâm a data scientist; I was drawn into the campaign in the summer of 2020, and I proceeded to build an SMS-based toolâthe Shopper Transparency Calculatorâto collect and analyze the data. With the help of that tool, the organized workers and their supporters essentially audited the algorithm and found that it had given 40 percent of workers substantial pay cuts. The workers showed that itâs possible to fight back against the opaque authority of algorithms, creating transparency despite a corporationâs wishes.<br/> </p><h2>How We Built a Tool to Audit Shipt</h2><p> It started with a Shipt worker named Willy Solis, who noticed that many of his fellow workers were posting in the online forums about their unpredictable pay. He wanted to understand how the pay algorithm had changed, and he figured that the first step was documentation. At that time, every worker hired by Shipt was added to a Facebook group called the Shipt List, which was administered by the company. Solis posted messages there inviting people to join a different, worker-run Facebook group. Through that second group, he asked workers to send him screenshots showing their pay receipts from different months. He manually entered all the information into a spreadsheet, hoping that heâd see patterns and thinking that maybe heâd go to the media with the story. But he was getting thousands of screenshots, and it was taking a huge amount of time just to update the spreadsheet. </p><p class="shortcode-media shortcode-media-youtube"> <span class="rm-shortcode" data-rm-shortcode-id="e4c700c5140ddaa1f8b4809b3b318744" style="display:block;position:relative;padding-top:56.25%;"><iframe frameborder="0" height="auto" lazy-loadable="true" scrolling="no" src="https://www.youtube.com/embed/naOKu92aiig?rel=0" style="position:absolute;top:0;left:0;width:100%;height:100%;" width="100%"></iframe></span> <small class="image-media media-caption" placeholder="Add Photo Caption...">The Shipt Calculator: Challenging Gig Economy Black-box Algorithms with Worker Pay Stubs</small> <small class="image-media media-photo-credit" placeholder="Add Photo Credit..."> <a href="https://youtu.be/naOKu92aiig?si=DsQudCLxyxlRJ8I4" target="_blank">youtu.be</a> </small> </p><p> Thatâs when Solis contacted <a href="https://home.coworker.org/" target="_blank">Coworker</a>, a nonprofit organization that supports worker advocacy by helping with petitions, data analysis, and campaigns. <a href="https://www.linkedin.com/in/drewambrogi/" target="_blank">Drew Ambrogi</a>, then Coworkerâs director of digital campaigns, introduced Solis to me. I was working on my Ph.D. at the <a href="https://www.media.mit.edu/" target="_blank">MIT Media Lab</a>, but feeling somewhat disillusioned about it. Thatâs because my research had focused on gathering data from communities for analysis, but without any community involvement. I saw the Shipt case as a way to work with a community and help its members control and leverage their own data. Iâd been reading about the experiences of delivery gig workers during the pandemic, who were suddenly considered essential workers but whose working conditions had only gotten worse. When Ambrogi told me that Solis had been collecting data about Shipt workersâ pay but didnât know what to do with it, I saw a way to be useful. </p><p class="shortcode-media shortcode-media-rebelmouse-image rm-resized-container rm-resized-container-25 rm-float-left" data-rm-resized-container="25%" style="float: left;"> <img alt="A photo of a woman putting a bag in the trunk of a car. " class="rm-shortcode rm-resized-image" data-rm-shortcode-id="72e17e8e25072bcbc5531c6af24b4579" data-rm-shortcode-name="rebelmouse-image" id="045b9" loading="lazy" src="https://spectrum.ieee.org/media-library/a-photo-of-a-woman-putting-a-bag-in-the-trunk-of-a-car.png?id=52516673&width=980" style="max-width: 100%"/> </p><p class="shortcode-media shortcode-media-rebelmouse-image rm-resized-container rm-resized-container-25 rm-float-left" data-rm-resized-container="25%" style="float: left;"> <img alt="A photo of a smiling man kneeling in a cleaning aisle of a store. " class="rm-shortcode rm-resized-image" data-rm-shortcode-id="a3a794e43586d53248108abfdae5d6aa" data-rm-shortcode-name="rebelmouse-image" id="cdff6" loading="lazy" src="https://spectrum.ieee.org/media-library/a-photo-of-a-smiling-man-kneeling-in-a-cleaning-aisle-of-a-store.png?id=52516669&width=980" style="max-width: 100%"/> </p><p class="shortcode-media shortcode-media-rebelmouse-image rm-resized-container rm-resized-container-25 rm-float-left" data-rm-resized-container="25%" style="float: left;"> <img alt="A series of glossy photographs produced by Shipt shows smiling workers wearing Shipt t-shirts happily engaged in shopping and delivering groceries. " class="rm-shortcode rm-resized-image" data-rm-shortcode-id="8e9d1ba8537b1da2f24a07be6bf45957" data-rm-shortcode-name="rebelmouse-image" id="c7d70" loading="lazy" src="https://spectrum.ieee.org/media-library/a-series-of-glossy-photographs-produced-by-shipt-shows-smiling-workers-wearing-shipt-t-shirts-happily-engaged-in-shopping-and-de.png?id=52516655&width=980" style="max-width: 100%"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Throughout the worker protests, Shipt said only that it had updated its pay algorithm to better match payments to the labor required for jobs; it wouldnât provide detailed information about the new algorithm. Its corporate photographs present idealized versions of happy Shipt shoppers. </small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Shipt</small> </p><p> Companies whose business models rely on gig workers have an interest in keeping their algorithms opaque. This âinformation asymmetryâ helps companies better control their workforcesâthey set the terms without divulging details, and workersâ only choice is whether or not to accept those terms. The companies can, for example, vary pay structures from week to week, experimenting to find out, essentially, how little they can pay and still have workers accept the jobs. Thereâs no technical reason why these algorithms need to be black boxes; the real reason is to maintain the power structure. </p><p> For Shipt workers, gathering data was a way to gain leverage. Solis had started a community-driven research project that was collecting good data, but in an inefficient way. I wanted to automate his data collection so he could do it faster and at a larger scale. At first, I thought weâd create a website where workers could upload their data. But Solis explained that we needed to build a system that workers could easily access with just their phones, and he argued that a system based on text messages would be the most reliable way to engage workers. </p><p> Based on that input, I created a textbot: Any Shipt worker could send screenshots of their pay receipts to the textbot and get automated responses with information about their situation. I coded the textbot in simple Python script and ran it on my home server; we used a service called <a href="https://www.twilio.com/en-us" target="_blank">Twilio</a> to send and receive the texts. The system used <a href="https://en.wikipedia.org/wiki/Optical_character_recognition" target="_blank">optical character recognition</a>âthe same technology that lets you search for a word in a PDF fileâto parse the image of the screenshot and pull out the relevant information. It collected details about the workerâs pay from Shipt, any tip from the customer, and the time, date, and location of the job, and it put everything in a Google spreadsheet. The character-recognition system was fragile, because Iâd coded it to look for specific pieces of information in certain places on the screenshot. A few months into the project, when Shipt did an update and the workersâ pay receipts suddenly looked different, we had to scramble to update our system. </p><p class="pull-quote"> In addition to fair pay, workers also want transparency and agency. </p><p> Each person who sent in screenshots had a unique ID tied to their phone number, but the only demographic information we collected was the workerâs metro area. From a research perspective, it would have been interesting to see if pay rates had any connection to other demographics, like age, race, or gender, but we wanted to assure workers of their anonymity, so they wouldnât worry about Shipt firing them just because they had participated in the project. Sharing data about their work was technically against the companyâs terms of service; astoundingly, workersâincluding gig workers who are classified as âindependent contractorsââ <a href="https://www.dcalacci.net/static/12d31050a16465e11dceb24a8c4f6727/calacci-stein-ell-202305.pdf" target="_blank">often donât have rights</a> to their own data. </p><h3></h3><br/><div class="rblad-ieee_in_content"></div><p> Once the system was ready, Solis and his allies spread the word via a mailing list and workersâ groups on Facebook and WhatsApp. They called the tool the Shopper Transparency Calculator and urged people to send in screenshots. Once an individual had sent in 10 screenshots, they would get a message with an initial analysis of their particular situation: The tool determined whether the person was getting paid under the new algorithm, and if so, it stated how much more or less money theyâd have earned if Shipt hadnât changed its pay system. A worker could also request information about how much of their income came from tips and how much other shoppers in their metro area were earning. </p><h2>How the Shipt Pay Algorithm Shortchanged Workers </h2><p> By October of 2020, we had received more than 5,600 screenshots from more than 200 workers, and we paused our data collection to crunch the numbers. For the shoppers who were being paid under the new algorithm, we found that 40 percent of workers were earning more than 10 percent less than they would have under the old algorithm. Whatâs more, looking at data from all geographic regions, we found that about one-third of workers were earning less than their stateâs minimum wage. </p><p> It wasnât a clear case of wage theft, because 60 percent of workers were making about the same or slightly more under the new scheme. But we felt that it was important to shine a light on those 40 percent of workers who had gotten an unannounced pay cut through a black box transition.</p><div class="rm-embed embed-media"><div class="flourish-embed flourish-chart" data-src="visualisation/18471418?820658"> <script src="https://public.flourish.studio/resources/embed.js"> </script> </div></div><p>In addition to fair pay, workers also want transparency and agency. This project highlighted how much effort and infrastructure it took for Shipt workers to get that transparency: It took a motivated worker, a research project, a data scientist, and custom software to reveal basic information about these workersâ conditions. In a fairer world where workers have basic data rights and regulations require companies to disclose information about the AI systems they use in the workplace, this transparency would be available to workers by default.<br/></p><p> Our research didnât determine how the new algorithm arrived at its payment amounts. But a July 2020 <a href="https://shipt.tech/shop-time-and-the-area-of-a-square-dcc9cb055368" target="_blank">blog post</a> from Shiptâs technical team talked about the data the company possessed about the size of the stores it worked with and their calculations for how long it would take a shopper to walk through the space. Our best guess was that Shiptâs new pay algorithm estimated the amount of time it would take for a worker to complete an order (including both time spent finding items in the store and driving time) and then tried to pay them $15 per hour. It seemed likely that the workers who received a pay cut took more time than the algorithmâs prediction. </p><p class="shortcode-media shortcode-media-rebelmouse-image rm-resized-container rm-resized-container-25 rm-float-left" data-rm-resized-container="25%" style="float: left;"> <img alt="A photograph showing protesters gathered in front of a Target store with signs bearing messages about Shipt\u2019s treatment of its workers." class="rm-shortcode rm-resized-image" data-rm-shortcode-id="de6f22aca3dc22131c715978a726eba2" data-rm-shortcode-name="rebelmouse-image" id="60086" loading="lazy" src="https://spectrum.ieee.org/media-library/a-photograph-showing-protesters-gathered-in-front-of-a-target-store-with-signs-bearing-messages-about-shipt-u2019s-treatment-of.png?id=52516818&width=980" style="max-width: 100%"/> </p><p class="shortcode-media shortcode-media-rebelmouse-image rm-resized-container rm-resized-container-25 rm-float-left" data-rm-resized-container="25%" style="float: left;"> <img alt="Two photographs show protesters gathered in front of a Target store with signs bearing messages about Shipt\u2019s treatment of its workers." class="rm-shortcode rm-resized-image" data-rm-shortcode-id="02363db2c9099fda8746767dcc9328af" data-rm-shortcode-name="rebelmouse-image" id="bda3e" loading="lazy" src="https://spectrum.ieee.org/media-library/two-photographs-show-protesters-gathered-in-front-of-a-target-store-with-signs-bearing-messages-about-shipt-u2019s-treatment-of.png?id=52516812&width=980" style="max-width: 100%"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Shipt workers protested in front of the headquarters of Target (which owns Shipt) in October 2020. They demanded the companyâs return to a pay algorithm that paid workers based on a simple and transparent formula. </small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">The SHIpT List</small> </p><p> Solis and his allies <a href="https://www.shiptlist.org/" target="_blank">used the results</a> to get <a href="https://gizmodo.com/shipts-effort-based-model-is-cutting-pay-for-40-of-wor-1845374119" rel="noopener noreferrer" target="_blank">media</a> <a href="https://techcrunch.com/2020/09/29/shipt-shoppers-are-organizing-a-walkout-in-protest-of-new-pay-model/" target="_blank">attention</a> as they organized strikes, boycotts, and a protest at Shipt headquarters in Birmingham, Ala., and Targetâs headquarters in Minneapolis. They asked for a meeting with Shipt executives, but they never got a direct response from the company. Its <a href="https://techcrunch.com/2020/09/29/shipt-shoppers-are-organizing-a-walkout-in-protest-of-new-pay-model/" target="_blank">statements</a> to the media were maddeningly vague, saying only that the new payment algorithm compensated workers based on the effort required for a job, and implying that workers had the upper hand because they could âchoose whether or not they want to accept an order.â </p><p> Did the protests and news coverage have an effect on worker conditions? We donât know, and thatâs disheartening. But our experiment served as an example for other gig workers who want to use data to organize, and it raised awareness about the downsides of algorithmic management. Whatâs needed is wholesale changes to platformsâ business models. </p><h2>An Algorithmically Managed Future?</h2><p> Since 2020, there have been a few hopeful steps forward. The European Union recently came to an agreement about a rule aimed at improving the conditions of gig workers. The so-called <a href="https://www.osborneclarke.com/insights/eu-agrees-watered-down-platform-workers-directive-what-will-platforms-and-staffing" target="_blank">Platform Workers Directive</a> is considerably watered down from the original proposal, but it does ban platforms from collecting certain types of data about workers, such as biometric data and data about their emotional state. It also gives workers the right to information about how the platform algorithms make decisions and to have automated decisions reviewed and explained, with the platforms paying for the independent reviews. While many worker-rights advocates wish the rule went further, itâs still a good example of regulation that reins in the platformsâ opacity and gives workers back some dignity and agency. </p><p> Some debates over gig workersâ data rights have even made their way to courtrooms. For example, the <a href="https://www.workerinfoexchange.org/" target="_blank">Worker Info Exchange</a>, in the United Kingdom, <a href="https://www.workerinfoexchange.org/post/uber-ordered-to-pay-584-000-for-failure-to-comply-with-court-order-in-robo-firing-case" target="_blank">won a case against Uber</a> in 2023 about its automated decisions to fire two drivers. The court ruled that the drivers had to be given information about the reasons for their dismissal so they could meaningfully challenge the robo-firings. </p><p> In the United States, New York City passed the countryâs <a href="https://www.nyc.gov/office-of-the-mayor/news/405-23/mayor-adams-dcwp-commissioner-mayuga-nation-s-first-minimum-pay-rate-app-based#/0" target="_blank">first minimum-wage law for gig workers</a>, and last year the law <a href="https://www.nrn.com/news/new-york-city-s-minimum-wage-law-delivery-workers-upheld-courts" target="_blank">survived a legal challenge</a> from DoorDash, Uber, and Grubhub. Before the new law, the city had determined that its 60,000 delivery workers were earning about $7 per hour on average; the law raised the rate to about $20 per hour. But the law does nothing about the power imbalance in gig workâit doesnât improve workersâ ability to determine their working conditions, gain access to information, reject surveillance, or dispute decisions. </p><p class="shortcode-media shortcode-media-rebelmouse-image rm-resized-container rm-resized-container-25 rm-float-left" data-rm-resized-container="25%" style="float: left;"> <img alt="A man in a green shirt and white baseball cap looks into the camera. He\u2019s in the aisle of a grocery store." class="rm-shortcode rm-resized-image" data-rm-shortcode-id="b0f2246572d3d52e84f2b69b4318c72b" data-rm-shortcode-name="rebelmouse-image" id="18221" loading="lazy" src="https://spectrum.ieee.org/media-library/a-man-in-a-green-shirt-and-white-baseball-cap-looks-into-the-camera-he-u2019s-in-the-aisle-of-a-grocery-store.png?id=52516831&width=980" style="max-width: 100%"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Willy Solis spearheaded the effort to determine how Shipt had changed its pay algorithm by organizing his fellow Shipt workers to send in data about their payâfirst directly to him, and later using a textbot.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Willy Solis</small> </p><p> Elsewhere in the world, gig workers are coming together to <a href="https://platform.coop/" target="_blank">imagine alternatives</a>. Some delivery workers have started worker-owned services and have joined together in an international federation called <a href="https://coopcycle.org/en/" target="_blank">CoopCycle</a>. When workers own the platforms, they can decide what data they want to collect and how they want to use it. In Indonesia, couriers have created â<a href="https://pulitzercenter.org/stories/gig-workers-fighting-back-against-algorithms" target="_blank">base camps</a>â where they can recharge their phones, exchange information, and wait for their next order; some have even set up <a href="https://logicmag.io/distribution/mutual-aid-stations/" target="_blank">informal emergency response services</a> and insurance-like systems that help couriers who have road accidents. </p><p> While the story of the Shipt workersâ revolt and audit doesnât have a fairy-tale ending, I hope itâs still inspiring to other gig workers as well as shift workers whose <a href="https://www.vice.com/en/article/g5xwby/heres-what-happens-when-an-algorithm-determines-your-work-schedule" target="_blank">hours are increasingly controlled by algorithms</a>. Even if they want to know a little more about how the algorithms make their decisions, these workers often lack access to data and technical skills. But if they consider the questions they have about their working conditions, they may realize that they can collect useful data to answer those questions. And there are researchers and technologists who are interested in applying their technical skills to <a href="https://digitalworkerinquiry.com/project.html" target="_blank">such projects</a>. </p><p> Gig workers arenât the only people who should be paying attention to algorithmic management. As artificial intelligence creeps into more sectors of our economy, white-collar workers find themselves subject to automated tools that define their workdays and judge their performance. </p><p> During the COVID-19 pandemic, when millions of professionals suddenly began working from home, some employers rolled out software that captured screenshots of their employeesâ computers and algorithmically scored their productivity. Itâs easy to imagine how the current boom in generative AI could build on these foundations: For example, large language models could digest every email and Slack message written by employees to provide managers with summaries of workersâ productivity, work habits, and emotions. These types of technologies not only pose harm to peopleâs dignity, autonomy, and job satisfaction, they also create information asymmetry that limits peopleâs ability to challenge or negotiate the terms of their work. </p><p> We canât let it come to that. The battles that gig workers are fighting are the leading front in the larger war for workplace rights, which will affect all of us. The time to define the terms of our relationship with algorithms is right now. <span class="ieee-end-mark"></span> </p>]]></description><pubDate>Mon, 01 Jul 2024 13:00:02 +0000</pubDate><guid>https://spectrum.ieee.org/shipt</guid><category>Algorithmic management</category><category>Artificial intelligence</category><category>Gig workers</category><category>Shipt</category><category>Transparency</category><category>Workplace</category><dc:creator>Dana Calacci</dc:creator><media:content medium="image" type="image/png" url="https://spectrum.ieee.org/media-library/image.png?id=52511774&width=980"/></item>
https://whatsonchain.com/tx/9eb53537b11f3b8a4c78fdfd4d1160d4cfe1f04eb9d7ceb943aa76cfd0504706