User Tools

Site Tools


blog:pushbx:2026:0616_update_on_the_anti-scraping_measures_for_our_hgweb

Update on the anti-scraping measures for our hgweb

As of 2025 October, we required password sign in for the hgweb service. The idea was to instruct users on what username and password to enter but have malicious automated scrapers fail to enter the correct sign in. This did work, but it wasn't a very nice change to communicate to users.

On 2026-01-06, I came across a blog post that described Anubis, a "Web AI Firewall Utility". Our hgweb was quickly fitted with it, replacing the password sign-in way.

This is annoying and may worsen access from some tools. But as before, the backups.hg directory contains at least 1 recent lzipped backup tarball that ships all of the hgweb repos with their entire histories.

You could leave a comment if you were logged in.
blog/pushbx/2026/0616_update_on_the_anti-scraping_measures_for_our_hgweb.txt · Last modified: 2026-06-16 12:47:55 +0200 Jun Tue by ecm