RE: [PHPLIB] Problems when submiting a PHPLib site to Altavista From: Vibol Hou (grid <email protected>)
Date: 01/28/00

Claes,

That's actually a pretty good idea. Can you post your code snippet so we
can take a look at it and possibly use it also? What I do suggest is that
the code look for users coming from a particular host, somewhat like the way
Analog does it's checking for host engines...

-Vibol

-----Original Message-----
From: phplib-owner <email protected>
[mailto:phplib-owner <email protected>]On Behalf Of Claes Mensson
Sent: Friday, January 28, 2000 5:48 AM
To: phplib <email protected>
Subject: Re: [PHPLIB] Problems when submiting a PHPLib site to Altavista

Donncha O Caoimh skrev:
>
> I'd suggest disabling the fallback mode in local.inc
> It's set to "get" normally (AFAIK) but set it to "" and the session id
> doesn't appear in the URL.

Well. I've been experimenting with coding a new mode in session.inc, that I
call
"robot". Basically, it matches the $HTTP_USER_AGENT against a list of
"known"
robots, such as the ones from Altavista, Inktomi, Northernlight and so on.
The
"robot" mode doesn't set a cookie, nor does it send a redirect header.
Although
a session id is still generated, since there is no way of propagating it
(neither cookie or GET variables), it is forgotten immediately after
page_close().

While still toying with this mode, I can't see any major problems. The only
drawback, is that you would have to maintain a list of "known" robots...

Has anyone else got any thoughts about this? Pitfalls? Is my "robot" mode a
definite no-no for some reason? Has anyone tried to do this before?

Regards
/Claes

>
> Donncha.
>
> garyb <email protected> wrote:
> >
> > I've checked out this url. I don't think it will solve my problem
because
> > robots.txt will act on directories and files . What i want is to avoid
to be
> > indexed with a session id in my url...
> >
> > Generally, but not certainly, search engines will not index URLs with a
GET
> > variable string. Altavista seems to be the major exception.
> -
> PHP3 Base Library Mailing List. Send messages to <phplib <email protected>>.
> To unsubscribe, send "unsubscribe" to <phplib-request <email protected>> in
> the body, not the subject, of your message.
-
PHP3 Base Library Mailing List. Send messages to <phplib <email protected>>.
To unsubscribe, send "unsubscribe" to <phplib-request <email protected>> in
the body, not the subject, of your message.

-
PHP3 Base Library Mailing List. Send messages to <phplib <email protected>>.
To unsubscribe, send "unsubscribe" to <phplib-request <email protected>> in
the body, not the subject, of your message.