janalsncm 11 hours ago

Every time you see a little banner ad at the bottom of an app, there’s an instantaneous auction to show you that ad space. Google forwards info to bidders, who calculate how much they will spend to show you the ad. This means even the losers of the auction get a firehose of data. There are companies set up right now whose purpose is to lose that auction but collect the data anyways.

It should not surprise you to learn, then, that In-Q-Tel (the non classified investment arm of the CIA) has invested in some of these analytics (read: digital surveillance) companies.

  • doctorpangloss 8 hours ago

    The ads customers do not see data. A handful of exchanges do.

    Participating in header bidding gives you data similar to what you would see from operating a popular mobile website.

    I don't know. It doesn't surprise me that In-Q-Tel makes investments in good arbitrage businesses like exchanges. I'm sure many good investors make good investments. It isn't some kind of cynical surveillance play.

    • tveita 4 hours ago

      > Participating in header bidding gives you data similar to what you would see from operating a popular mobile website.

      A popular mobile website can only geolocate its own visitors based on IP and will have no idea what apps they have installed and what they do whenever they are not visiting that website.

      The ad exchange gets information any time the users opens any of thousands of apps, without them ever interacting with the exchange.

      "This device opened Grindr at this exact GPS coordinate, then Candy Crush at the church wifi, then a month later played Yahtzee for three hours near a military base in Afghanistan"

      Then they package up that historical data and sell it. You can have years of location data for whatever purpose you can think of.

      A thread on using this for surveillance from about a year ago:

      https://news.ycombinator.com/item?id=38289337

      As I commented there, while the antitrust case against Google is well-deserved, one effect of breaking their ad monopoly is opening up for even more actors to receive real-time header bidding data.

      A look at the resolution of position data you can get:

      https://nrkbeta.no/2020/12/03/my-phone-was-spying-on-me-so-i...

      This will be correlated and joined with the geoip data from the apps without location data.

    • zoul 7 hours ago

      It isn't some kind of cynical surveillance play.

      The overwhelming experience of the contemporary internet says it always is.

  • iJohnDoe 8 hours ago

    This link specifically says they get the data even if they don’t win the auction.

    https://www.ftc.gov/news-events/news/press-releases/2024/12/...

    > When Mobilewalla bid to place an ad for its clients on a real-time advertising bidding exchange, it unfairly collected and retained the information in the bid request, even when it didn’t have a winning bid, according to the complaint. The FTC’s complaint alleges that from January 2018 to June 2020, Mobilewalla collected more than 500 million unique consumer advertising identifiers paired with consumers’ precise location data. The raw location data Mobilewalla collected was not anonymized and the company doesn’t have policies to remove sensitive locations from the data set, meaning that such data could be used to identify individual consumers’ mobile devices and the sensitive locations they visited. The company sold access to this raw data to third-parties, including advertisers, data brokers and analytic firms.

    • rgbrenner 7 hours ago

      That doesn't mention Google anywhere in it that I can find.

    • janalsncm 8 hours ago

      I think you meant to reply to someone who replied to me.

      • iJohnDoe 8 hours ago

        It was meant to reinforce your comment. :)

  • jillyboel 10 hours ago

    How does one sign up for such a firehose? I was naively under the impression google did this bidding internally.

  • add-sub-mul-div 10 hours ago

    > There are companies set up right now whose purpose is to lose that auction but collect the data anyways.

    Which is against Google's terms, but of course they don't police it because it's their way of selling user data without explicitly selling user data.

    • divbzero 8 hours ago

      If I understand this right, Google isn’t actually selling user data to auction losers because auction losers are collecting the data without spending any money.

      • add-sub-mul-div 8 hours ago

        They leak data that enables the marketplace they run and profit from. That's the indirection. They count on this obfuscation (lack of an explicit transaction for the bid request data) to keep people from thinking of them as selling data.

        Collectively the participants use this data to optimize their future bids and other surveillance/marketing efforts outside the Google ecosystem.

        I'm sure Google would prefer there not be any parties involved that are purely leeches. But they may not be able to or may not care enough to tell the difference between leeches and parties that are still working out their infrastructure and bidding strategy and will begin bidding eventually. Or perhaps making a certain number of low bids you don't intend to win is what keeps you in the game.

supriyo-biswas 12 hours ago

One point I do not see addressed in the article is how the location is collected.

It'd be a little bit of a stretch to call IP geolocation as collecting location data as it is usually no more accurate than just procuring the geolocation yourself, so there's no need to get it from a broker. However, on an Android for example, both ACCESS_COARSE_LOCATION and ACCESS_FINE_LOCATION require permission dialogs, so how does it exactly work?

  • mikeiz404 7 hours ago

    At least some, if not the majority, is likely derived from the IP address used in the ad bidding process.

    > Franaszek also says that “a significant amount of this geolocation dataset appears to be inferred by IP address to geolocation lookups, meaning the vendor or their source is deriving the user's geolocation by checking their IP address rather than by using GNSS [Global Navigation Satellite System]/GPS data. That would suggest that the data is not being sourced entirely from a location data SDK.”

  • _DeadFred_ 9 hours ago

    It's a stretch to call out a game for tracking every IP use use and trying to location track you using that? A game should not be trying to track my location at all, not get a pass because technically it's not very accurate.

  • ajsnigrutin 11 hours ago

    Tinder is location based, so probably through that.

    Not sure about other apps.

smarx007 12 hours ago

    comm -12 <(cat gravy_app_list\ -\ count.csv| uvx --from csvkit csvcut -c 2 | rg '\.' | sort) <(adb shell pm list packages -3 | cut -f 2 -d ":" | sort)
where the CSV is downloaded from https://docs.google.com/spreadsheets/d/1Ukgd0gIWd9gpV6bOx2pc... in order to check the apps on your phone for any match.

Two questions from looking at my list:

1. What do you replace PodcastAddict with? Will all ads traffic (not just the display of the ads on the screen) cease on a paid version?

2. How would MS Outlook get on the list in the first place?

  • oAlbe 12 hours ago

    > 1. What do you replace PodcastAddict with? Will all ads traffic (not just the display of the ads on the screen) cease on a paid version?

    AntennaPod

    • LordShredda 10 hours ago

      I love AntennaPod. One app that does its job perfectly

  • gruez 11 hours ago

    This list is suspect. PodcastAddict doesn't even request location permissions[1]. How can it possibly get access to your location? If you read the article carefully, it caveats that the location might not even be sourced from gravy apps. At best, it's getting your ip location, which you're broadcasting to every website you visit anyways.

    >Although this dataset came from an apparent hack of Gravy, it is not clear whether Gravy collected this location data itself or sourced it from another company, or which location company ultimately owns it or is licensed to use it.

    [1] https://play.google.com/store/apps/details?id=com.bambuna.po...

    • dceddia 10 hours ago

      Can it get the wifi SSID? Is that a permissioned property on Android/iOS? I believe there are companies that build databases of SSIDs and their locations by driving around, so if an app can get wifi info it could be pinpointed to a pretty specific location.

      • gruez 10 hours ago

        >Can it get the wifi SSID? Is that a permissioned property on Android/iOS?

        It requires location permissions since forever ago, specifically because of the risk you described.

        • ale42 4 hours ago

          What about Bluetooth? I think it there are enough intentional and unintentional beacons around that it's possible to have some localization info with their MACs. Does this require permission?

          • gruez 27 minutes ago

            Yes

  • aembleton 5 hours ago

    Easier just to block the ad servers at the DNS level. I use NextDNS [1] as it lets me configure it, but AdGuard [2] DNS probably also works well.

    1. https://nextdns.io/

    2. https://adguard-dns.io/en/welcome.html

    • chneu 3 hours ago

      Even better if you have the hardware/bandwidth, setup a wireguard vpn and use adblocking on your home network. Then all your stuff is at least mildly encrypted while out and about, plus you get robust adblocking protection.

      This also has the added benefit of encrypting DNS if you set that up. It's all relatively easy to setup. If your hardware is running linux there are simple configuration scripts you can run to get everything going in 5 minutes or so.

    • treetalker 4 hours ago

      NextDNS is great.

      I'm also a fan of 1Blocker on iOS (and macOS). It's another subscription, but it's not that expensive; updates its blocking lists frequently; and blocks trackers in apps.

drawkward 13 hours ago

Advertising is a virus that will infect every ecosystem

  • __MatrixMan__ 7 hours ago

    There are still many mysteries to unravel about viruses, they may be more important to a functioning ecosystem than we realize, and there are useful tricks which only they can do.

    I think it's more like lead poisoning.

  • alganet 12 hours ago

    It's more like the ideal vector for some nasty stuff. There's nothing inherently wrong with it but folks doing evil stuff love it.

    • jazzyjackson 12 hours ago

      Watch "the economics of happiness" if you think there's nothing wrong with advertising. Sure, maybe it can be done without manipulating people's self-image into thinking they're not good enough, not beautiful enough, not wealthy enough, but if you're into maximizing revenue you're not going to simply advertise "here's our invention, take it or leave it"

      https://m.imdb.com/title/tt1687905/

      • alganet 12 hours ago

        I believe there's nothing _inherently_ wrong with advertising.

        > but if you're into maximizing revenue

        In the space of ideas, there is a way for advertisement to exist without revenue. Even without money!

        > manipulating people's self-image into thinking they're not good enough, not beautiful enough, not wealthy enough

        You can do all of that _without_ advertising.

        • _factor 8 hours ago

          I can’t think of any positives of advertising that are not solely to the benefit of the advertiser.

          That knife you bought because it looked cool, not the sharpest or most suited for your tasks. Cheerios aren’t really good for your heart. Dentists don’t universally recommend your flavored grain-infused fluoride paste.

          It’s legalized lying where high end marketing companies are so good at it you might as well not try with a small budget. It’s not just bad from any angle, it’s also entrenched.

        • SllX 11 hours ago

          > You can do all of that _without_ advertising.

          I want to double-emphasize this. Most advertising sucks, but the effect it has on people is not unique to advertising. Given your five senses, you are being consistently and constantly blasted with information people want to put in front of you in the hopes of effecting your future behavior in a way that makes you think that you’ve talked yourself into it.

          But given a non-intrusive ad that isn’t trying to also surveil you and isn’t making demands on your attention, they can be informative. The problem is that non-intrusive ads that don’t make demands on your time and attention don’t support advertising-reliant companies with market caps as big as TV broadcasters, and if you want to also be as big as Google or Facebook, you also need the surveillance aspect of it, so if we ever get our shit together as a society and do something about that and they haven’t diversified their revenue streams sufficiently, they’re in for a very bad time.

      • BrenBarn 7 hours ago

        > Sure, maybe it can be done without manipulating people's self-image into thinking they're not good enough, not beautiful enough, not wealthy enough, but if you're into maximizing revenue you're not going to simply advertise "here's our invention, take it or leave it"

        Well, yes, that's it exactly. The problem is not advertising, it's trying to maximize revenue. That is the virus that is killing our world.

      • listenallyall 10 hours ago

        > manipulating people's self-image into thinking they're not good enough, not beautiful enough, not wealthy enough

        Unfortunately, social media is much more effective at ruining people's self-image and happiness than advertisers could ever dream to be

    • __MatrixMan__ 10 hours ago

      I think there's something inherently wrong with it. At it's core is a fundamental disregard for consent which harms people after prolonged exposure. The consequences of turning control of over our technology to people with an incentive to degrade our sense of dopamine hygiene have been very bad and continue to worsen.

      Whatever legitimate needs ads can meet we can find better ways to meet. That is, if we could only get a break from life in a Skinner box.

      • alganet an hour ago

        Language offers the same risks. People can talk stuff to me without my consent. That alone doesn't make it evil.

        The goal of separating, conceptually, the vector from the virus, is to better understand how the virus works.

        The greed and manipulation that took over the advertisement industry was not born from it and will not die with it. It's a thing that uses it, I want to make this thing more visible.

      • mvkel 10 hours ago

        Imagine there is a cause, mission, or vision that you care deeply about.

        And you want larger numbers of people to care about it, too.

        And you're willing to pay someone to help you distribute the message that will persuade those people to care.

        That's advertising.

        There's a tobacco lobby. There's also an anti-tobacco lobby.

        • __MatrixMan__ 8 hours ago

          I understand that, but what's your point? It doesn't get less sleazy when it happens to be a cause that I like. Maybe I have terrible taste. Why should I be allowed to subject people to my terrible taste without their consent? Why should being rich increase my ability to do so?

          If it's actually such a good idea it should be possible to spread it consensually--that is, unless the intervening space was weaponized against us by advertisers.

        • gausswho 9 hours ago

          And that person you pay fakes the numbers on your invoice, because everyone else does.

        • add-sub-mul-div 10 hours ago

          Imagine you're a small burger place that opened somewhere other than the center of town and you want people to at least know there's a new option besides slop from McDonald's.

          • __MatrixMan__ 8 hours ago

            In our world, where the advertisers are already making so much noise that the only way to be heard is to pay an advertiser to shout louder than the others... yes, that's probably what you have to do.

            But in the absence of all of that noise in the first place, I think we could design something that does a much better job than ads do. As it is you have to pit your bank account against McDonald's and compete for attention, but think about how much money you could save (or spend on tastier things) if it was instead the quality of your burger that determined how widely known you ended up being.

            I don't have the game theoretic secret sauce that would make that happen, but I believe that it's out there and that it would be cheaper and more effective than what we're doing if we just collectively stopped tolerating ads of any kind and focused on solving the where-can-I-get-a-good-burger type problems directly.

          • yetihehe 3 hours ago

            Stand on a corner and approach some people holding a big plate with tasty things. If those things are tasty enough, you will have some free advertising to their friends (almost like influencers, but more organic).

          • AngryData 8 hours ago

            In my experience nearly every decent product ive ever wanted I either sought out myself first or found through word-of-mouth, almost none of it through marketing materials which these days I completely disregard because it is 99.99% bullshit. And I believe word-of-mouth would be even more effective and useful if mass advertising simply didn't exist to pollute peoples thoughts and preferences with a bunch of deceptive marketing garbage. I firmly believe over 99% of marketing could be easily replaced by simple word-of-mouth if it wasn't drowned out by marketing materials and advertisements.

    • JumpCrisscross 11 hours ago

      > more like the ideal vector for some nasty stuff

      Advertising is mosquitoes. Fits.

bluechair 13 hours ago

Do I understand correctly that these apps are able to bypass OS permissions of whether to allow location data?

  • redserk 12 hours ago

    I wonder if apps are abusing background app refresh to do this on iOS.

    My understanding is that it isn't difficult to create a background task that can periodically make network requests. Just have a background task make a HTTP request including some unique identifier to some ad network server, then have the server handle IP geolocation.

    While the accuracy won't be great on a lot of mobile networks, you can get pretty granular on wifi as some ISPs have their IPs as granular as a neighborhood.

    I disable background app refresh for almost all apps in anticipation of this and haven't had a degredation in app experience.

    I noticed something when using 1Blocker on iOS, which creates a dummy on-device VPN to block tracker IP requests. After I turned off background app refresh, I noticed that the number of blocked requests went down a lot. While some were innocuous diagnostics, like Sentry, the vast majority were not.

    I'd appreciate if someone familiar with iOS development could weigh in on if this would be practical or not, given the all of the execution limits of background tasks.

    • codetrotter 12 hours ago

      > you can get pretty granular on wifi as some ISPs have their IPs as granular as a neighborhood

      I’ve heard that this might be the case in some places in the USA. Meanwhile, I have not seen that level of granularity for residential IP addresses in Norway for example.

      The MaxMind GeoIP databases include information about how accurate (granular) the location data is for each entry in their db according to https://support.maxmind.com/hc/en-us/articles/4407630607131-...

      Has anyone done analysis on the MaxMind GeoIP data to see how the granularity of the data differs between different cities and countries and published anything about that online?

      • redserk 12 hours ago

        I'm in the US and my current IP address puts me in an area about 30 miles away currently. However, last year up until a few weeks ago my IP would place me in my current ZIP code (using ipinfo).

        My city is comprised of several ZIP codes so you could have figured out where I live within a ~1.5 mile radius.

        The granularity may not matter that much though. You can infer a fair bit of data. If you remove mobile network IP addresses, which tend to be quite vague here, you can sort of tell how often someone leaves the house, goes on vacation, or if they visit a friend/family member often.

        • gruez 11 hours ago

          >I'm in the US and my current IP address puts me in an area about 30 miles away currently. However, last year up until a few weeks ago my IP would place me in my current ZIP code (using ipinfo).

          >My city is comprised of several ZIP codes so you could have figured out where I live within a ~1.5 mile radius.

          How do you know that it accurately knows your location down to the zip code level, and not just that your zip code just happened to match up? After all, a broken clock is right twice a day.

          >The granularity may not matter that much though. You can infer a fair bit of data. If you remove mobile network IP addresses, which tend to be quite vague here, you can sort of tell how often someone leaves the house, goes on vacation, or if they visit a friend/family member often.

          That might be useful for stalker-ish reasons, but it requires work to implement, and it's unclear why advertisers would care about this sort of stuff. You go to work 9-5 and visit your friends on weekends, how can you turn that into money? "people with a job and friends" isn't exactly a very lucrative marketing demographic.

        • notarealllama 12 hours ago

          Meanwhile, working on legitimate GPS requests in an app, my fiber optic ISP has the GPS of my IP about 2 streets up from where I live. I took a stroll and sure enough there's a big ol' grey communications box there.

          • dylan604 12 hours ago

            You know, I'm totally okay with that.

  • tveita 12 hours ago

    "a significant amount of this geolocation dataset appears to be inferred by IP address to geolocation lookups, meaning the vendor or their source is deriving the user's geolocation by checking their IP address rather than by using GNSS [Global Navigation Satellite System]/GPS data. That would suggest that the data is not being sourced entirely from a location data SDK."

    Probably it would use the location if the permission was enabled, otherwise fall back to IP geolocation

    Real-time bidding is a privacy nightmare - basically spraying your actions in real-time to every ad provider, with a pinky promise that they won't abuse it.

    • unyttigfjelltol 10 hours ago

      Pinky promises from scoundrels. Pretty much with that group asking the pinky promise is to provoke abuse of it.

p3rls 6 hours ago

Personally I can't wait until tinder is hit by the government, absolutely ridiculous the sort of monopoly power their amalgamation of dating apps has.

People bitch and moan about negative externalities on society from the rise of the internet but for me it's hard to imagine few variables more imperative to a state's success over the longterm.

udev4096 6 hours ago

The truth is, majority of the population doesn't care. Telling people to value their privacy is exhausting because of a stupid argument of "I have nothing to hide". You deserve your data to be up for sale (let's also not forget data breaches) if you are too reckless to calculate the consequences of using these apps

xnx 13 hours ago

> Candy Crush, Tinder, MyFitnessPal: See the Thousands of Apps Hijacked to Spy on Your Location

This seems like a very misleading headline. These apps were (often for no user-beneficial reason) collecting location data. This code was put there deliberately by the app authors. The app authors are accomplices in leaking this data , they are not victims.

  • zoul 7 hours ago

    As I understand it, the story is not the advertising network getting the private data — we have all known that for a long time. The news is that even the unsuccessful real-time auction bidders can get a lot of this data.

cadamsau 13 hours ago

Actually, location tracking was added on purpose..

It is capitalism that has been hacked.

  • dylan604 12 hours ago

    Capitalism hasn't been hacked, it's working as designed. If there's a way to make money, it will be monetized. Decency and morality does not matter if it gets in the way of making more money.