Scripts for everyday SEO use

Remove disallowed in robots.txt urls from XML site map

View the Project on GitHub ink-ru/sm_clean

Scripts for everyday SEO use

Remove disallowed in robots.txt urls from XML site map

View the Project on GitHub ink-ru/sm_clean

Clean XML Site map

This script will clean site map from links disalowed in robots.txt (and some tags)

Works both in browser and in command line

CLI usage

Usage in windos .bat file:

@echo OFF
@chcp 65001
"C:\OpenServer\modules\php\PHP-5.6\php.exe" smap_clean.php %*
pause

Usage in Linux crone:

php sm_clean.php

more info about php cli usage: http://php.net/manual/ru/features.commandline.usage.php