I just started using this myself, seems pretty great so far!

Clearly doesn’t stop all AI crawlers, but a significantly large chunk of them.

      • That’s not proof of work, though.

        git is performing hashes to generate identifiers for versions of files so it can tell when they changed. It’s like moving rocks to build a house.

        Proof of work is moving rocks from one pile to another and back again, for the only purpose of taking up your time all day.

        • lime!@feddit.nu
          link
          fedilink
          English
          arrow-up
          7
          ·
          edit-2
          1 day ago

          okay, git using the same algorithm may have been a bad example. let’s go with video games then. the energy usage for the fraction of a second it takes for the anubis challenge-response dance to complete, even on phones, is literally nothing compared to playing minecraft for a minute.

          if you’re mining, you do billions of cycles of sha256 calculations a second for hours every day. anubis does maybe 1000, once, if you’re unlucky. the method of “verification” is the wrong thing to be upset at, especially since it can be changed

          • 𝕽𝖚𝖆𝖎𝖉𝖍𝖗𝖎𝖌𝖍@midwest.social
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            2
            ·
            22 hours ago

            Oh, god, yes. Video games waste vast amounts of energy while producing nothing of value. For sufficient definitions of “value,” of course. Is entertainment valuable? Is art? Does fiction really provide any true value?

            POW’s only product is proving that you did some task. The fact that it’s energy expensive and produces nothing of value except the verifiable fact that the work was done, is the difference.

            Using the video game example: the difference is the energy burned by the GPU while you were playing and enjoying yourself; cycles were burned, but in addition to doing the rendering there was additional value - for you - in entertainment. POW is like leaving your game running in demo mode with the monitor off. It’s doing the same work, only there’s no product.

            This point is important to me. Cryptocurrencies aren’t inherently bad, IMO; there are cryptocurrencies based on Proof of Stake, which have less environmental impact than your video game. And there’s BOINC, where work is being done, but the results of the work are valuable scientific calculations - it’s not just moving rocks from one pile to another and back again.

            • lime!@feddit.nu
              link
              fedilink
              English
              arrow-up
              2
              ·
              22 hours ago

              in the case of anubis one could argue that the goal is to save energy. if too much energy is being spent by crawlers they might be configured to auto-skip anubis-protected sites to save money.

              also, i’d say the tech behind crypto is interesting but that it should never have been used in a monetary context. proof of stake doesn’t help there, since it also facilitates consolidation of capital.

              • 𝕽𝖚𝖆𝖎𝖉𝖍𝖗𝖎𝖌𝖍@midwest.social
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                13 hours ago

                I think decentralized currency is the best part of crypto. Much of US strong-arm policy has been through leveraging control over the dollar? Remember a few years ago when OPEC were making noises about maybe tying oil prices to something other than the dollar? The US government has a collective shit fit, and although I never heard it reported how the issue was resolved, but it stopped being news and oil is still tied to the dollar. It’s probably one of the reasons why the Saudis were about to kidnap, torture, and murder of Jamal Kashogi in the US.

                I am 100% in support of a currency that is not solely controlled by one group or State. For all of its terrible contribution to global warming, Bitcoin has proven resistant to an influential minority (e.g. Segwit2x) forcing changes over the wishes of the community. I especially like anything that scares bankers, and usury scabs.

                Satoshi made two unfortunate design choices with Bitcoin: he based it on proof of work, which in hindsight was an ecological disaster; and he didn’t seize the opportunity to build in depreciation, a-la Freigeld, which addresses many problems in capitalism.

                We’re all on Lemmy because we’re advocates of decentralization. Most of Lemmy opposes authoritarianism. How does that square with being opposed to a decentralized monetary system? Why are “dollars” any more real than cryptocoins? Why does gold have such an absurdly high value?

                • lime!@feddit.nu
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  5 hours ago

                  this reads like a mad rant.

                  first of all, bitcoin in its original form was meant to be used as a transaction log between banks. it was never meant to be a currency on its own, which can be seen in the fact that efforts in scaling up to more than a few million users consistently fail.

                  in practice, all cryptocurrencies result in a centralisation of power by default, whether they use proof of work or proof of stake, because they are built so that people with more resources outside the network can more easily get sway over the system. by either simply buying more hardware than anyone else (for pow) or pooling more of the limited resource (for pos) they can control the entire thing.

                  cryptocurrencies are a libertarian solution to the problem of capitalism, which is to say, a non-solution. the actual solution is to limit the use of financial incentives. i’d wager most people on lemmy would rather abolish currency altogether than go to crypto.

                  • It’s a rant, for sure

                    first of all, bitcoin in its original form was meant to be used as a transaction log between banks.

                    Satoshi Nakamoto, they guy who invented Bitcoin, was motivated by a desire to circumvent banks. Bitcoin is the exact opposite of what you claim:

                    A purely peer-to-peer version of electronic cash would allow online payments to be sent directly from one party to another without going through a financial institution. … Commerce on the Internet has come to rely almost exclusively on financial institutions serving as trusted third parties to process electronic payments. … What is needed is an electronic payment system based on cryptographic proof instead of trust, allowing any two willing parties to transact directly with each other without the need for a trusted third party.

                    https://www.bitcoin.com/satoshi-archive/whitepaper/

                    My comment is a rant, because I constantly see these strongly held opinions about systems by people who not only know nothing about the topic, but who believe utterly false things.

                    cryptocurrencies result in a centralisation of power by default, whether they use proof of work or proof of stake, because they are built so that people with more resources outside the network can more easily get sway over the system

                    Ok, now I have to wonder if you’re just trolling.

                    Bitcoin, in particular, has proven to be resilient against such takeovers. They’ve been attempted in the past several times, and successfully resisted.

        • Cethin@lemmy.zip
          link
          fedilink
          English
          arrow-up
          4
          ·
          1 day ago

          Proof of work is just that, proof that it did work. What work it’s doing isn’t defined by that definition. Git doesn’t ask for proof, but it does do work. Presumably the proof part isn’t the thing you have an issue with. I agree it sucks that this isn’t being used to do something constructive, but as long as it’s kept to a minimum in user time scales, it shouldn’t be a big deal.

          Crypto currencies are an issue because they do the work continuously, 24/7. This is a one-time operation per view (I assume per view and not once ever), which with human input times isn’t going to be much. AI garbage does consume massive amounts of power though, so damaging those is beneficial.

          • 𝕽𝖚𝖆𝖎𝖉𝖍𝖗𝖎𝖌𝖍@midwest.social
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            1
            ·
            12 hours ago

            I’m not sure where you’re going with the git simile. Git isn’t performing any proof of work, at all. By definition, Proof of Work is that “one party (the prover) proves to others (the verifiers) that a certain amount of a specific computational effort has been expended.” The amount of computational power used to generate hashes for git is utterly irrelevant to its function. It doesn’t care how many cycles are used to generate a hash; therefore it’s in no way proof of work.

            This solution is designed to cost scrapers money; it does this by causing them to burn extra electricity. Unless it’s at scale, unless it costs them, unless it has an impact, it’s not going to deter them. And if it does impact them, then it’s also impacting the environment. It’s like having a door-to-door salesman come to your door and intentionally making them wait while their car is running, and there cackling because you made them burn some extra gas, which cost than some pennies and also dumped extra carbon monoxide into the atmosphere.

            Compare this to endlessh. It also wastes hacker’s time, but only because it just responds very slowly with and endless stream of header characters. It’s making them wait, only they’re not running their car while they’re waiting. It doesn’t require the caller to perform an expensive computation which, in the end, is harmful to more than just the scraper.

            Let me make sure I understand you: AI is bad because it uses energy, so the solution is to make them use even more energy? And this benefits the environment how?

            • Cethin@lemmy.zip
              link
              fedilink
              English
              arrow-up
              2
              ·
              11 hours ago

              I’m not the person who brought git up. I was just stating that work is work. Sure, git is doing something useful with it. This is arguably useful without the work itself being important. Work is the thing you’re complaining about, not the proof.

              This solution is designed to cost scrapers money; it does this by causing them to burn extra electricity. Unless it’s at scale, unless it costs them, unless it has an impact, it’s not going to deter them.

              Yeah, but the effect it has on legitimate usage is trivial. It’s a cost to illegitimate scrapers. Them not paying this cost also has an impact on the environment. In fact, this theoretically doesn’t. They’ll spend the same time scraping either way. This way they get delayed and don’t gather anything useful for more time.

              To use your salesman analogy, it’s similar to that, except their car is going to be running regardless. It just prevents them from reaching as many houses. They’re going to go to as many as possible. If you can stall them then they use the same amount of gas, they just reach fewer houses.

              Compare this to endlessh. It also wastes hacker’s time, but only because it just responds very slowly with and endless stream of header characters. It’s making them wait, only they’re not running their car while they’re waiting.

              This is probably wrong, because you’re using the salesman idea. Computers have threads. If they’re waiting for something then they can switch tasks to something else. It protects a site, but it doesn’t slow them down. It doesn’t actually really waste their time because they’re performing other tasks while they wait.

              Let me make sure I understand you: AI is bad because it uses energy, so the solution is to make them use even more energy? And this benefits the environment how?

              If they’re going to use the energy anyway, we might as well make them get less value. Eventually the cost may be more than the benefit. If it isn’t, they spend all the energy they have access to anyway. That part isn’t going to change.

              • I’m not the person who brought git up.

                Then I apologize. All I can offer is that it’s a weakness of my client that it’s difficult and outside the inbox workflow to see any history other than the comment to which you’re replying. Not an excuse; just an explanation.

                Work is the thing you’re complaining about, not the proof.

                If given the option, I’d prefer all computing to have zero cost; sure. But no, I’m not complaining abou t the work. I’ll complain about inefficient work, but the real issue is work for work’s sake; in particular, systems designed specifically where the only important fact us proving that someone burned X pounds of coal to get a result. Because, while exaggerated and hyperbolically started, that’s exactly what Proof-of-Work systems are. All PoW systems care about is that the client provably consumed a certain amount of CPU power. The result is the work is irrelevant for anything but proving that someone did work.

                With exceptions like BOINC, the work itself from PoW systems provides no other value.

                Compare this to endlessh.

                This is probably wrong, because you’re using the salesman idea.

                It’s not. Computer networks can open only so many sockets at a time; threading on a single computer is finite, and programmers normally limit the amount of concurrency because high concurrency itself can cause performance issues.

                If they’re going to use the energy anyway, we might as well make them get less value.

                They’re going to get their value anyway, right? This doesn’t stop them; it just makes each call to this more expensive. In the end, they do the work and get the data; it just cost them - and the environment - more.

                Do you think this will stop scrapers? Or is it more of a “fuck you”, but with a cost to the planet?

                Honey pots are a better solution; they’re far more energy efficient, and have the opportunity to poison the data. Poisoned data is more like what you suggest: they’re burning the energy anyway, but are instead getting results that harm their models. Projects like Nepenthes go in the right direction. PoW systems are harmful - straight up harmful. They’re harmful by preventing access to people who don’t use JavaScript, and they’re harmful in exactly the same way crypto mining is.