A feature Google demoed at its I/O confab yesterday, using its generative AI technology to scan voice calls in real time for conversational patterns associated with financial scams, has sent a collective shiver down the spines of privacy and security experts who are warning the feature represents the thin end of the wedge. They warn that, once client-side scanning is baked into mobile infrastructure, it could usher in an era of centralized censorship.

Apple abandoned a plan to deploy client-side scanning for CSAM in 2021 after a huge privacy backlash. However, policymakers have continued to heap pressure on the tech industry to find ways to detect illegal activity taking place on their platforms. Any industry moves to build out on-device scanning infrastructure could therefore pave the way for all-sorts of content scanning by default — whether government-led or related to a particular commercial agenda.

Meredith Whittaker, president of the U.S.-based encrypted messaging app Signal, warned: “This is incredibly dangerous. It lays the path for centralized, device-level client side scanning.

“From detecting ‘scams’ it’s a short step to ‘detecting patterns commonly associated w[ith] seeking reproductive care’ or ‘commonly associated w[ith] providing LGBTQ resources’ or ‘commonly associated with tech worker whistleblowing.’”

  • downpunxx@fedia.io
    link
    fedilink
    arrow-up
    7
    arrow-down
    13
    ·
    7 months ago

    If it stops the possibility of being bothered by robocallers, I will give up all my data, my privacy, and the keys to my home, I will even throw in my children

    • IamAnonymous@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      ·
      7 months ago

      Don’t answer unknown numbers and let it ring all the way through. Eventually it stops. If you cut the call or answer it, they will know there is a human being on the other end.

      If they are real they will leave you a voicemail. No need to sacrifice your children 😂