Comcast's data-usage meter gave thousands of customers inaccurate readings for two months because of a software bug, causing the broadband provider to incorrectly charge about 2,000 users for exceeding their monthly data caps. Comcast has admitted the error and told Ars it is giving refunds and additional credits of $50 each to customers who paid data overage fees that shouldn't have been assessed.
We contacted Comcast two weeks ago after we heard from a customer in Duluth, Georgia, who found that Comcast was recording major data usage on his account even when he wasn't using the Internet. The customer, Michael, supposedly had exceeded his 1TB monthly data cap. But when he unplugged his modem overnight, Comcast recorded another 40GB of usage during a 15-hour stretch in which he couldn't have used any data.
Our inquiry to Comcast and complaints from other customers on social media caused the company to investigate. A Comcast spokesperson told us what the investigation discovered yesterday.
Comcast engineers found that the problem began after the company started rolling out a new billing system in early August. The data meter was apparently still collecting accurate data, but the numbers were being reported in the new billing system incorrectly.
Comcast said it's still trying to figure out if the bug is in the meter software, the billing software, or in the interaction between the two. What Comcast knows for certain, the spokesperson said, is that the problem was fixed when it rolled back to the previous version of its billing software.
Comcast's statement to Ars said:
While updating our data usage meter to a new system, a software error occurred resulting in a small number of our customers being billed incorrectly. We're very sorry for inconveniencing our customers and here's what we're doing to address it: We fixed the technical issue, we're proactively crediting the accounts affected, and we're giving those customers an additional $50 credit to make it right.
Comcast enforces data cap in 27 states
The back-end software upgrade was rolling out gradually, one CMTS (cable modem termination system) at a time, so the data-meter bug didn't affect most customers. Comcast enforces a 1TB monthly data cap in 27 of its 39 states and charges $10 for each additional block of 50GB, up to a maximum of $200 per month. Customers can get unlimited data for an extra $50 a month.
Comcast told us that a couple thousand customers were incorrectly charged for overages, but the total number of customers who were given inaccurate data readings was likely significantly higher. That's because the problem caused inaccurate readings in both directions, with some customers getting a number that was too high and others getting a number that was too low. Also, customers who had readings that were too high wouldn't necessarily have been hit with overage fees because the readings might still have been under the 1TB cap, and Comcast allows two courtesy months before billing for overages.
Comcast said the inaccurate readings affected a fraction of 1% of its customers, but it declined to provide a more specific number. Because Comcast has 27.8 million broadband subscribers, a fraction of 1% could be tens of thousands of customers.
Comcast told Ars that it was able to identify the customers who were wrongly billed overage fees and is proactively applying the bill credits and $50 additional credits to those customers' accounts. Customers don't have to contact Comcast in order to get the credits, and the company will reach out to people who were inaccurately billed to explain what happened, Comcast said.
The problem wasn't isolated to one state, as Comcast said it affected customers in states from the company's Central and Western US divisions. Comcast doesn't enforce data caps in the Northeastern US, where it generally faces stronger competition.
Comcast still has work to do. Even customers who weren't overcharged might see inaccurate data counts or the words "not applicable" instead of a specific number if they check their accounts today. Some customers may see higher-than-actual data readings while others may see lower-than-actual data readings, Comcast said. But the company told us it will be able to update customer accounts with accurate readings for the August-September period.
Comcast also needs to figure out how to deploy its new billing software without triggering the problem again. Comcast said it purchased the software from a vendor and that it is supposed to be an upgrade over its current billing system.
While the company is still investigating the exact nature of the bug, Comcast told us that the bug "redistributed" the data counts in an inaccurate way, perhaps meaning that some people's data usage was wrongly applied to other people's Comcast accounts. The decision to roll back to the old software on October 2 gives Comcast engineers time to figure out exactly what happened and do further testing before attempting to reinstall the new software.
Customers have been discussing the problem on Reddit, Twitter, and a Comcast customer forum.
Some customers are already seeing changes in their data usage readings. Michael's data usage readings went back to normal after a Comcast technician swapped his modem for a new one. That occurred before Comcast discovered that the problem was in its billing software, and it's not clear why a modem switch would have had any effect on his problem.
Trusting Comcast
This isn't the first time Comcast has incorrectly counted data usage. In December 2015, we wrote about Oleg, a programmer from Tennessee who was accused of using 120GB of data while he was overseas on vacation. Comcast insisted that someone must have hacked into his Wi-Fi network and used the data. But when Oleg subsequently disconnected his cable modem for a week, Comcast's meter kept counting data that wasn't being used. Comcast finally admitted its mistake and said the company had entered his modem's MAC address incorrectly into their billing system.
We detailed other problems in our September 2016 feature "Tales from Comcast's data cap nation: Can the meter be trusted?" In one case, Comcast admitted to Ars that a "table display bug" caused inaccurate data readings for a customer.
The process of disputing data-meter readings is tedious and often infuriating for customers because Comcast offers no way for users to verify that individual data readings are correct. Comcast customer service reps are also quick to blame customers and insist that Comcast's data meter is infallible, even when customers measure their own usage and find possible mistakes in the Comcast meter.
Michael Goldsberry, who has been helping his parents in Hinesville, Georgia, deal with a Comcast data-meter problem, told Ars that Comcast offered his parents a credit after weeks of insisting that the meter readings were accurate and that his parents might have been hacked.
"What really gets my blood boiling is during the entire process, even with executive complaints filed twice, Comcast employees were extremely dismissive," Goldsberry told Ars. Comcast employees took the pRead More – Source