LIVEJOURNAL WHY IS MY JOURNAL ON GOOGLE
Sep. 27th, 2009 01:51 pm![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
ans99i just found something disturbing....
when i search for "ansate" and "digitalis" together in google guess what my second result is?
freyja.livejournal.com/data/foaf
wtf? i thought we got to check off a box in livejournal settings that "minimize(d) inclusion in search results" for browsers? so ken checked the following url http://freyja.livejournal.com/robots.txt (which he tells me is my journal's own personal settings for what search engines to allow to spider my journal).
this is what it says:
User-Agent: Mediapartners-Google*
Disallow:
User-Agent: *
Disallow: /
and what that means, fair readers?
google is not disallowed at all. GOOGLE. you know, the only search engine around, effectively.
anyone else think this is an egregious breach of trust? has anyone else noticed this? i think we need to be made aware of this and possibly do something about fixing it. ken thinks it's some oversight, especially since the html in my journal disallows "googlebot" everything. robots.txt is not doing its job!!!
i mean, i realize that online privacy is a myth, but i'd really not like my lj to be my SECOND search result.
when i search for "ansate" and "digitalis" together in google guess what my second result is?
freyja.livejournal.com/data/foaf
wtf? i thought we got to check off a box in livejournal settings that "minimize(d) inclusion in search results" for browsers? so ken checked the following url http://freyja.livejournal.com/robots.txt (which he tells me is my journal's own personal settings for what search engines to allow to spider my journal).
this is what it says:
User-Agent: Mediapartners-Google*
Disallow:
User-Agent: *
Disallow: /
and what that means, fair readers?
google is not disallowed at all. GOOGLE. you know, the only search engine around, effectively.
anyone else think this is an egregious breach of trust? has anyone else noticed this? i think we need to be made aware of this and possibly do something about fixing it. ken thinks it's some oversight, especially since the html in my journal disallows "googlebot" everything. robots.txt is not doing its job!!!
i mean, i realize that online privacy is a myth, but i'd really not like my lj to be my SECOND search result.
