Advertisement:

Author Topic: [Tip] How to remove expired,inactive,spam ads from search results pages (SERP)  (Read 6103 times)

Helpto

  • Newbie
  • *
  • Posts: 45
Hello Friends,

As you know, the latest google algorithm update (Google Panda 4.0 and Spam (Pay Day Loan)) is targeting low quality,spammy websites with duplicate contents.
Your search performance will be affected if you have lot of duplicate contents. Check the Google Webmaster Tools==> 'HTML Improvements' to see the list of Duplicate meta descriptions and Duplicate title tags .

Manually removing all duplicate entries via WMT ==>'Remove URL' is not good, if you have a very large number of duplicate ads, as Google don't like many 404 'Not Found Error' pages in your website (User Experience Problem) and it will not remove those 404 (Deleted Ads) URLs quickly from their search index.

At the moment, Google will index all ads posted in your website even if you marked it as a 'Spam' or 'Inactive' in the Admin panel and now Osclass has no option to repost the expired ads.So it is better to remove those ads from Google search results inorder to maintain the quality of your website.

Use the following steps to remove those ads from search results page.

Find the below code in your theme folder==> head.php

Code: [Select]
<meta name="robots" content="index,follow"/>

<meta name="googlebot" content="index,follow"/>

Replace it with the below code.

Code: [Select]
<?php if ( osc_is_ad_page() ) { ?>
 
 <?php if( osc_item_is_spam() || osc_item_is_inactive() || osc_item_is_expired () ) { ?>
        <meta name="robots" content="noindex, nofollow" />
        <meta name="googlebot" content="noindex, nofollow" />

        <?php } else if (osc_item_is_active()) { ?>
        <meta name="robots" content="index, follow" />
        <meta name="googlebot" content="index, follow" />
        <?php ?>
       
  <?php } else { ?>
 
  <meta name="robots" content="index,follow"/>

  <meta name="googlebot" content="index,follow"/>

  <?php ?>

Now only the Active ads will be indexed.
Check the Google Webmaster Tools guidelines here : https://support.google.com/webmasters/answer/93710?hl=en

You can now mark those duplicate ads shown in WMT as spam and can remove it from Google Search index. All 'noindex' ads will be removed from the Search Engine's index next time when they crawl your website.

let me know if it works for you.

Regards
Helpto
www.helptobuynsell.in/item/new
« Last Edit: June 06, 2014, 06:14:49 am by Helpto »

keerthi

  • Hero Member
  • *****
  • Posts: 505
anything for the duplicate ads.

keerthi

  • Hero Member
  • *****
  • Posts: 505
pls somebody give me php trick for this to deindex duplicate meta description and title.

Aficionado

  • Guest
I can't really understand how google will INDEX a item post ad, if it is expired or inactive.

It is not possible, since Google bot FOLLOWS a link. And while expired ads are not hidden if you know the url, if that page is NOT linked from anywhere in the website (not externaly) it will be removed from google index.


Helpto

  • Newbie
  • *
  • Posts: 45
@Aficionado

According to Google, a web page's content will be removed from Google web index if there is a 'noindex' meta tag present in the <head> section of the page.

Check it here : https://support.google.com/webmasters/answer/93710?hl=en
http://googlewebmastercentral.blogspot.in/2007/03/using-robots-meta-tag.html

I'm using Real Estate theme & the following function in the item.php adding noindex meta tag to expired ads.

But Spam & Inactive ads have an 'index, follow' meta tags. So they will be indexed and Google will not drop these pages from search results. Check the real estate theme header.php here : https://github.com/osclass/theme-realestate/blob/master/realestate/header.php

Code: [Select]
    function itemCustomHead(){
        if( osc_item_is_expired () ) {
        $echo = "<meta name=\"robots\" content=\"noindex, nofollow\" /><meta name=\"googlebot\" content=\"noindex, nofollow\" />";
        } else {
        $echo = "<meta name=\"robots\" content=\"index, follow\" /><meta name=\"googlebot\" content=\"index, follow\" />";
        }
       
    }


I could not find a similar function(itemCustomHead()) in the modern_3.0.3 & minimalist theme's item.php,head.php and header.php pages. Instead there is an 'index, follow' meta tag.

Code: [Select]
<meta name="robots" content="index, follow" />
          <meta name="googlebot" content="index, follow" />

So all expired,Spam & Inactive ads will be indexed by the search engine bolt if 'noindex' meta tag is not present in the head section of the page.

I've not checked it in other themes.

Check the page source to see 'noindex' meta tag is added for expired,spam & inactive ads. If it is not present there, add the meta tags in the head.php conditionally for removing the expired,spam & inactive ads from SERP.

« Last Edit: June 07, 2014, 10:45:50 am by Helpto »

Aficionado

  • Guest
Are we talking here about DEindexing of ALREADY indexed ads ?

Or we are talking about NEW ads not to be indexed ?


Helpto

  • Newbie
  • *
  • Posts: 45
@Aficionado

In both context it is applicable.

Aficionado

  • Guest
@Aficionado

In both context it is applicable.

So as i said, if some page is not linked from anywhere anymore, it is removed from google index. No need for all that.

« Last Edit: June 08, 2014, 06:37:56 pm by Aficionado »

Veromon

  • Guest
Aficionado - but if the link has a reference from another site? google will follow for sure! thank you Helpto, is a good tip. I have a few companies that publish ads in my site, and after this, they save and report links to their clients. Ex: http://topanunt.com/masini-de-inchiriat-bucuresti-aeroport/  - in this case, 159) chilipirim. ro /afaceri-servicii/alte-servicii/masini-de-inchiriat-bucuresti-aeroport/1427 adablabla is my link from my website, if i delete/spam or whatever, google will find this link from   http://topanunt.com/masini-de-inchiriat-bucuresti-aeroport/ and mark as 404,  true Aficionado?

Aficionado

  • Guest
Aficionado - but if the link has a reference from another site? google will follow for sure! thank you Helpto, is a good tip. I have a few companies that publish ads in my site, and after this, they save and report links to their clients. Ex: http://topanunt.com/masini-de-inchiriat-bucuresti-aeroport/  - in this case, 159) chilipirim. ro /afaceri-servicii/alte-servicii/masini-de-inchiriat-bucuresti-aeroport/1427 adablabla is my link from my website, if i delete/spam or whatever, google will find this link from   http://topanunt.com/masini-de-inchiriat-bucuresti-aeroport/ and mark as 404,  true Aficionado?

I said "if the page is not linked". If it is linked, then your "nofollow" is not the best solution since many bots do not respect any nofollow directives.

I'm not sure WHY Osclass keeps an expired ad online....


keerthi

  • Hero Member
  • *****
  • Posts: 505
Pretty bad logic. Its not needed.

Helpto

  • Newbie
  • *
  • Posts: 45
« Last Edit: June 17, 2014, 12:50:22 pm by Helpto »