Sadly, most AI/LLM scraper bots completely ignore website ToS and/or robots.txt.
For those struggling to block those bots on their k8s clusters (using ingress-nginx), here's a handy oneliner I just built. It takes Ichido's blocklist (https://github.com/anthmn/ai-bot-blocker) and transforms it correctly to be used by the ingress controller.
---
echo -en " block-user-agents: |\n "; curl -fsSl https://files.ichi.do/recommended-nginx-block-ai-bots.conf | grep -Ev '^#|Uptime-Kuma' | awk -F "\"" 'ORS="," {print "\"~*"$2".*" "\""}' | sed 's/\(.*\),/\1\n /'
---
PS: something similar could be created from https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/blob/master/_generator_lists/bad-user-agents.list , depending on your preference. YMMV.
#FediAdmin #FediTips #k8s #kubernetes #ingress
@ohmu @h2onolan it is an instance emoji that the awesome @vmstan added for us here on #vmstio. The process to add (steal/copy them from other instances) is pretty easy for #fediadmin folks, check w/ whoever runs yours?
#Peertube #Yunohost #fediadmin
Moin ihr Lieben,
ich war mal wieder im Backend von video-cave-v2.de und habe dort neben ein paar kleineren Updates das große Upgrade auf Peertube v7 gemacht😃
Damit gibt's auch erneutes UI.
Changelog findet ihr hier:
https://github.com/Chocobozzz/PeerTube/releases/tag/v7.0.0
LG
Euer Admin
Random #fediadmin gubbins, but I've noticed that my instance won't download the avatars for certain users of other instances.
It'll do custom emoji, profile headings, and seemingly everything but avatars. It's a bit weird.
Not sure if it's because those instances have limited federation with non-whitelisted servers or something, as I can't see anything particular on my end.
5 years in Fediverse feels good
May next year bring more features to your favourite servers and apps, content may be even easier to moderate, users - friendlier, bots and scrapers - efficiently blocked, and corporate social media - even less powerful.
Happy 2025
🧵🇫🇷 : Petite annonce sur l'évolution de mes toots.
Comme le rappelle souvent beaucoup de #fediadmin faire tourner une instance demande du temps, de l'énergie et de l'argent.
Ne pouvant me résoudre à demander du soutien sans rien offrir en retour, j'ai réfléchi au cours des mois passés a trouver un moyen "passif" / "opt in" pour soutenir mon travail.
Le résultat de cette réflexion : des messages #sponsorisés. Toutefois pas de panique, voici les règles que je m'imposerais pour en poster
🇬🇧🧵: A small PSA for upcoming changes in my toots.
As others #fediadmin have mentioned running an instance cost time, energy and money. Since I can't wrap my head around the idea of asking people's money without providing anything in return, I spent the last few months trying to find "passive" / "opt-in" ways to support me/my work.
In the near future, I will start posting #sponsored links. Since I don't plan on transforming your timelines into an abyss of add, here's the rules I will follow
Good morning Fedi friends!
I've got an etiquette question for you.
I'm in the process of setting up my #GoToSocial self-hosted instance. I'm excited about the idea of using custom #emojis.
I read @stefan's post on this topic (https://stefanbohacek.com/blog/custom-fediverse-emoji/), looked up custom emojis from several instances and saved a bunch (see screenshot).
My question: is it ok to copy custom emojis from other instances and use them on your own? (There doesn't seem to be attribution for it)
#fediAsk #fediVers #fediAdmin
@amro
The "snitching" issue is becoming a real thing in this day and time, it doesn't actually matter if it's about a single user instance or any kind of simple user.
What is the difference between "snitching", exposing and pointing out?
What is the difference between "währet den Anfängen" und "Denunziantentum"?
Many have dreamed of profile portability on the fediverse, but the technical and social barriers to this are nearly insurmountable 😞
Good news!! There is a solution that the techy and non can take advantage of 🎉
I have boosted/posted a lot about #Posty over the past few weeks, but if you read just one make it this detailed overview:
https://writer.oliphant.social/oliphant/posty-this-is-how-you-take-your-posts-with-you
@oliphant@writer.oliphant.social @oliphant@oliphant.social #Posty #Fediverse #Mastodon #Archive #StaticSite #Memorial #Admin #FediAdmin
#fediAdmin #mastoAdmin Since I keep getting requests from various instances that aren't aware, my domain (collins-corner.cc) and it's subdomains are no longer hosting any Fediverse services. They have in the past, but haven't been for a couple months now.
Please feel free to purge all data from these instances from your data stores.
If a Mastodon server closes down, members can download offline post archives, but there's currently no official way to display these archives online.
A proposed solution by @oliphant is a static website generator they have created called "Posty", which turns Mastodon public post archives into standalone static public websites:
➡️ https://codeberg.org/oliphant/posty
It could be useful for servers that are closing down, admins could perhaps offer this as a service to their members.