[jacktheking]

So I was creating a PHP scraper script to learn to scrap website. And I noticed that some site don't have keywords tag. One example is Facebook. Another example is ... FourmCoin. In fact, I noticed that FourmCoin does not have both keywords and description tags and I am curios to know the reason. The two lines of code below are from ForumCoin.

Code: Select all

<meta name="keywords" content=""/>
<meta name="description" content=""/>


Another thing that caught my attention is that ForumPromotion does not have the keywords and description tag. However, Google spider managed to scrape the data the user want and show it as the site description on result page. How do they know that is the description when it is not in the meta tag?

Code: Select all

Forum Promotion is a webmaster forum that focuses on internet marketing to support webmasters and admins to make their website successful. On Forum ...

I am really interested with how the search engine crawler works ...

[oldbuddy]

For obvious reasons, that kind of information is top secret and anything you read to the contrary is conjecture. If Google disclosed what they were doing in detail, it would be too easy for people to cheat.

[IcyFirefly]

I don't have keywords and description meta for my sites either. At one point, everyone scramble to add them in so search engines can find them. I had a friend that believe in this heavily, but she has niche websites, so it helps her. My websites are just general, and I have no keywords or description metal, but for some reasons I had more offers than she did. So for me, it is not necessary.

[Blue5]

google. google chooses them for you

[sherryinutah]

I don't know everything about this but I am learning. I read that sometimes it makes more sense to let Google select keywords for us so we don't accidentally limit ourselves.

Personally, I want to write a meta/search description for my post. For me, it satisfies my need to be thorough. Hopefully, I'm not taking measures that would work against me. Time will tell.

[oldbuddy]

One thing to keep in mind, is the description you put in the meta tag is what shows in the search results, so write it to attract people to click.

[walash]

So I was creating a PHP scraper script to learn to scrap website. And I noticed that some site don't have keywords tag. One example is Facebook. Another example is ... FourmCoin. In fact, I noticed that FourmCoin does not have both keywords and description tags and I am curios to know the reason. The two lines of code below are from ForumCoin.

Code: Select all

<meta name="keywords" content=""/>
<meta name="description" content=""/>


Well, some websites like Facebook as you pointed out do not rely on organic traffic for ranking, since are already very well known and well placed. That's why they don't bother placing meta tags and meta descriptions. I'm not sure, but I guess Forum Coin's main traffic source isn't organic as well. Maybe direct and referral traffic, since people either already know the forum and have it on favorites or give other people their links in order to earn FC through the referral program.

Another thing that caught my attention is that ForumPromotion does not have the keywords and description tag. However, Google spider managed to scrape the data the user want and show it as the site description on result page. How do they know that is the description when it is not in the meta tag?

Code: Select all

Forum Promotion is a webmaster forum that focuses on internet marketing to support webmasters and admins to make their website successful. On Forum ...

I am really interested with how the search engine crawler works ...

That's just a random snippet. Google grabs the first few lines of content of each page and sets as meta description when you don't complete your website's tags and descriptions for the SERPs.

Best Regards,
Wal

[blair]

For me that is an extra step to take and I also noticed in one of my blog posts, Google showed the first few lines below the title and not the meta tag. I wonder what I was doing wrong