Google and RSS Part II

[Stecyk]

Hi Folks,

I think I might have made more sense out of Google's prior response where Google indicated that someone had linked to my RSS feed and that was why it was scanning it frequently.

From my server logs today, I see that Google has a new "Feedfetcher-Google; +http://www.google.com/feedfetcher.html)".

If we follow the link, we learn that:

Feedfetcher is how Google grabs RSS or Atom feeds when users choose to add them to their Google homepage. Feedfetcher collects and periodically refreshes these user-initiated feeds, but does not index them in Blog Search or Google's other search services (feeds only appear in our search results if they've been crawled by Googlebot). Find answers below to some of the most commonly asked questions about how this user-controlled feed grabber works.

Okay, so that explains the link to my RSS feed. Some(one) have added my RSS to their Google homepage. Okay fine.

As we continue reading Google's information, we learn that:

Feedfetcher shouldn't retrieve feeds from most sites more than once every hour on average. Some frequently updated sites may be refreshed more often. Note, however, that due to network delays, it's possible that Feedfetcher may briefly appear to retrieve your feeds more frequently.

So far today, Google has resumed its RSS updates from my site and its frequency is about 4 times per hour, almost to the minute. This frequency is a bit higher than its stated policy.

I began to write Google another polite e-mail asking them to turn down the frequency, but I held off. Given that I had just corresponded with them last week and we didn't come to full understanding and mutual solution, I am reluctant to go back again so quickly. If given a choice between no Google and an overactive Google, I chose the overactive Google.

And I am thinking I can't be the only one. Perhaps they are fine tuning their system and will resolve this issue shortly?

Anyone have any thoughts. Georgeek, you seem to have your fingers in the search world, so I would appreciate getting your thoughts on this matter. Everyone else is encouraged to participate as well.

I look forward to hearing from you.

Best regards,
Kevin

[Wassercrats]

If given a choice between no Google and an overactive Google, I chose the overactive Google.It looks like that's the choice you have to make. Google says one thing here (http://www.google.com/feedfetcher.html) and is doing something else. I wouldn't trust personal correspondence with Google much more than what they say on their website. At least it's just the RSS bot that's bothering you, so it's not like you have to consider disallowing indexing.

[Stecyk]

Hi Wassercrats,

At least it's just the RSS bot that's bothering you, so it's not like you have to consider disallowing indexing.

True enough. It's not a big headache. I suppose in time they will figure it out. Perhaps I will just sit back and wait a while to see if the situation course corrects on its own. If it doesn't, then decide if another email is warranted.

Thanks Wassercrats.

Best regards,
Kevin

[georgeek]

Georgeek, you seem to have your fingers in the search world, so I would appreciate getting your thoughts on this matter.Four times an hour is well within normal limits for Feedfetcher. The frequency is determined algorithmically and Feedfetcher is in the process of determining a suitable value for your particular feed.

- George

Google says one thing here (http://www.google.com/feedfetcher.html) and is doing something else.What are you talking about?

- George

[kitchin]

Maybe you have multiple domains?

[Stecyk]

Four times an hour is well within normal limits for Feedfetcher. The frequency is determined algorithmically and Feedfetcher is in the process of determining a suitable value for your particular feed.

- George

Great, I won't sweat it then. It's still at its 4X per hour. I'll give it a few weeks. I also hope that it recognizes the permanent redirect.

Thanks for your help George.

Best regards,
Kevin

[Stecyk]

Hi kitchin,

Maybe you have multiple domains?

No, just one domain with a couple IROs. But the feedfetcher is always going to the same location. First, to the prior old now defunct RSS feed. And then to the permanent redirect.

Best regards,
Kevin

[Wassercrats]

What are you talking about?I was referring to Stecyk's comment that "So far today, Google has resumed its RSS updates from my site and its frequency is about 4 times per hour, almost to the minute. This frequency is a bit higher than its stated policy." I didn't even read that page I linked to, but Stecyk quoted Google saying "Feedfetcher shouldn't retrieve feeds from most sites more than once every hour on average."

[Stecyk]

Thanks everyone for your comments. If Google maintains its current pace during the next few weeks, I will comment back.

Thanks again.

Best regards,
Kevin