搜外网>搜外问答>问答页面

麻烦帮我看一下我的robots.txt是否屏蔽了蜘蛛抓取内页内容

是利用WordPress搭建的:www.cznxb.com
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-content/
Disallow: /wp-includes/
Disallow: /data/*
Disallow: /article_author/*
Disallow: /author/*/page/*
Disallow: /*/page/*
Disallow: /author/*
Disallow: /admin/*
Disallow: /config/*
Disallow: /inc/*
Disallow: /*/trackback
Disallow: /feed
Disallow: /*/feed
Disallow: /comments/feed
Disallow: /attachment/
Disallow: /tag/*/page/
Disallow: /category/*/page/
Disallow: /tag/*
Disallow: /tag
Disallow: /api/*
Disallow: /people/*
Disallow: /plus/*
Disallow: /*plus/*
Disallow: /?s=*
Disallow: /*/?s=*\
Disallow: /*?*
Disallow: /?r=*
Disallow: /?p=*
Disallow: /*.jpg$
Disallow: /*.jpeg$
Disallow: /*.gif$
Disallow: /*.png$
Disallow: /*.bmp$
Disallow: /*/comment-page-*
Disallow: /*?replytocom=*
Disallow: /?p=*&preview=true
Disallow: /?page_id=*&preview=true
Disallow: /wp-login.php
Disallow: /zhanghaoshezhi*
Disallow: /zhanghaoshezhi/*
Disallow: /gerenzhongxin*
Disallow: /gerenzhongxin/*
Disallow: /denglu*
Disallow: /denglu/*
Disallow: /chongzhimima*
Disallow: /chongzhimima/*
Disallow: /zhuce*
Disallow: /zhuce/*
Disallow: /tougao*
Disallow: /tougao/*
Disallow: /zhanzhang
Disallow: /kuaixun*
Disallow: /kuaixun/*
Disallow: /qgfwd
Sitemap: http://www.cznxb.com/sitemap.txt
Sitemap: http://www.cznxb.com/sitemap.xml
追加问题
    0 人参与回答
该问题还没有收到回答 :(