SMF2.0:Search engines: Difference between revisions

From this area you can decide in how much detail you wish to track search engines as they index your forum, as well as review search engine logs. To view this area, you must enable it via the Core Features page. Search Engines administration may be found under the "Members" button of the Administration Center menu (or under the "Members" heading if the Administration Center sidebar is used).

Stats

View statistics that pertain to search engines indexing your forum.

Spider Log

Spider log (term)

Viewing Search Engine Logs

Spider - The name of the spider that indexed your forum, as according to the name given in the Spiders section.
Time - The date and time when the spider viewed the page for the current page view it is associated with.
Viewing - The section the spider was viewing during the current page view. This will show Disabled if the Search Engine Tracking is set to High instead of Very High.

Delete Entries

At the bottom of this page is an input value that allows you to delete all search engine logs older than the specified amount of days. Once you enter a numeric value, select the Delete button to go through with the pruning of the logs older than the specified amount of days.

Spiders

Lists all the spiders added to your forum that you are tracking the indexing of. You can view some details about the spider as well as add new ones and delete existing ones.

Settings

You can change settings for spider tracking from this page. Note, if you wish to enable automatic pruning of the hit logs you can set this up from logs#Log_Pruning.

Search Engine Tracking Level - Determines the level at which spider activity is logged. Be aware that higher tracking level increases server resource requirement.
- Disabled - Spider activity is not logged.
- Standard - Minimal spider activity is logged.
- High - More accurate statistics about spider activity are logged.
- Very High - The same as high, but logs data for each page visited.
Apply restrictive permissions from group - Enables you to prevent spiders indexing some pages.
- Disabled - Spiders do not belong to a restrictive group.
- List of groups - By selecting a restrictive group, when a guest is detected as a search crawler it will automatically be assigned any deny permissions of this group, in addition to the normal permissions of a guest. You can use this to provide lesser access to a search engine than you would a normal guest. You might for example wish to create a new group called "Spiders" and select that here. You could then deny permission for that group to view profiles to stop spiders indexing your members profiles. Note that spider detection is not perfect and can be simulated by users so this feature is not guaranteed to restrict content only to those search engines you have added.
Show spiders in the online list - Determines whether spiders are displayed in the online list, and which members can see them.
- Not at all - Spiders will simply appear as guests to all users.
- Show spider quantity - The Board Index will display the number of spiders currently visiting the forum.
- Show spider names - Each spider name will be revealed, so users can see how many of each spider is currently visiting the forum - this takes effect in both the Board Index and Who's Online page.
- Show spider names - admin only - As above except that only administrators can see spider status. To all other users spiders appear as guests.

As an administrator

Main

Configuration

Forum

Members

Maintenance

Miscellaneous

@@ Line 9: / Line 9: @@
 ==Spider Log==
 {{:Spider log (term)}}
 ===Viewing Search Engine Logs===
 * '''Spider''' - The name of the spider that indexed your forum, as according to the name given in the [[Spiders]] section.

Navigation

Search

Tools