BSDForAll.Org | Forums
Problematic visitors? - Printable Version

+- BSDForAll.Org | Forums (https://bsdforall.org/forum)
+-- Forum: About BSDforAll.org (https://bsdforall.org/forum/forumdisplay.php?fid=8)
+--- Forum: Feedbacks, Suggestions (https://bsdforall.org/forum/forumdisplay.php?fid=48)
+--- Thread: Problematic visitors? (/showthread.php?tid=67)

Pages: 1 2

Problematic visitors? - LemonYellow - 02-12-2024

When I had a look at the little area that shows who is currently browsing the forum I noticed this:

   

What is Facebook and Twitter doing here? Do they crawl the web the same way Google does? Is it possible to prevent them from visiting?

RE: Problematic visitors? - monsieur - 02-12-2024

I am not sure, I will try to search the answer on web for this

RE: Problematic visitors? - monsieur - 02-12-2024

I've created a group bots and added all spiders/web crawlers there, and disabled ability to view forum earlier.

RE: Problematic visitors? - monsieur - 02-12-2024

They shouldn't show up anymore.

RE: Problematic visitors? - LemonYellow - 02-12-2024

(02-12-2024, 01:18 PM)fifi Wrote: They shouldn't show up anymore.

Nice. Thank you! I suspect they are crawling the web with malicious intents. At least looking for content to be used in various not-so-ethical stuff (AI-related work, for example).

RE: Problematic visitors? - monsieur - 02-12-2024

(02-12-2024, 01:28 PM)LemonYellow Wrote:
(02-12-2024, 01:18 PM)fifi Wrote: They shouldn't show up anymore.

Nice. Thank you! I suspect they are crawling the web with malicious intents. At least looking for content to be used in various not-so-ethical stuff (AI-related work, for example).

Yeah, they do
I found a suggestion earlier on mybb forums, to create a group bots, and then add all spiders/crawlers to group bots, revoke all permissions to view forums and stuff, and voila.
However this option was still on
Code:
Yes, show users of this group on the member list
So I unticked that, they shouldn't show up anymore in the members list.

Let's wait if their names disappear Smile

RE: Problematic visitors? - monsieur - 02-12-2024

So I disabled them from viewing the forum, but it looks like they still show up in online list...

RE: Problematic visitors? - monsieur - 02-12-2024

Quote:Who's Online Displays Spiders?
Display spiders in the online list. Note: This setting only takes effect on the portal and index pages.

Ok they also won't show up anymore :-).
Bye bye crawlers Smile

RE: Problematic visitors? - LemonYellow - 02-14-2024

(02-12-2024, 02:51 PM)FilipM Wrote:
Quote:Who's Online Displays Spiders?
Display spiders in the online list. Note: This setting only takes effect on the portal and index pages.

Ok they also won't show up anymore :-).
Bye bye crawlers Smile

Is this because they really cannot view the forum now, or because their visits are no longer displayed to us, the users. The whole thing looked a bit troubling to me. This was the first time I actually saw Facebook and Twitter visiting/crawling and possibly scraping websites. They are not search engines.

Do we have any widgets or buttons that connect to those sites? For example, "share" or "like" buttons that uses a Facebook or Twitter login? That could be counted as a way of inviting them to collect data.

But if there is no such thing in place, they may be doing something against the law in some parts of the world. Unethical altogether.

RE: Problematic visitors? - monsieur - 02-14-2024

Hey, I am not able to write back right now. Os on my laptop crashed and I am not able to boot, how nice.

I think I am going to get back to openBSD

there's a spider/crawlers list in the admin panel, I added all of them to the group bots and disabled the ability to view the forum. They probably still come here but can't see anything. I will post some screenshots later, I haven't got my usb stick with me.right now.