- Published on
A guide on how to block aggressive web crawler bots, particularly MJ12bot, using IIS 7 on Windows Server 2008 R2. The post explains how to set up URL Rewrite rules to prevent unwanted bot activity.
Web-crawlers
All Posts
- troubleshooting (9)
- iis (4)
- nextjs (4)
- csharp (4)
- automation (3)
- sql-server (3)
- database (3)
- networking (3)
- visual-studio (3)
- windows-phone-7 (3)
- music (3)
- web-development (3)
- azure (3)
- retreat (2)
- app-development (2)
- programming (2)
- bassdrive (2)
- seo (2)
- osx (2)
- remote-access (2)
- security (2)
- accounting (2)
- soundcloud (2)
- performance (2)
- review (2)
- software (2)
- cloudflare (2)
- netsuite (2)
- ghost (2)
- windows-server (2)
- windows-7 (2)
- debugging (2)
- os-x (2)
- mobile-development (2)
- granada (1)
- dji-phantom (1)
- japan (1)
- snowboarding (1)
- powershell (1)
- web-administration (1)
- constraints (1)
- router (1)
- telnet (1)
- tailwind (1)
- blog (1)
- tocbot (1)
- adhd (1)
- europe (1)
- ios (1)
- xcode (1)
- clickonce (1)
- backgroundaudioplayer (1)
- shoutcast (1)
- streaming (1)
- drum-and-bass (1)
- internet-radio (1)
- streaming-radio (1)
- gaming (1)
- blend (1)
- windows-development (1)
web-crawlers (1)
- ssh (1)
- proxy (1)
- debian (1)
- squid (1)
- remote-debugging (1)
- software-development (1)
- referral (1)
- business (1)
- technology (1)
- marketing (1)
- deals (1)
- mix (1)
- downtempo (1)
- mac (1)
- ssd (1)
- hardware (1)
- cloud-storage (1)
- bitcasa (1)
- fujifilm (1)
- camera (1)
- tumblr (1)
- web-hosting (1)
- freelancing (1)
- business-tools (1)
- self-storage (1)
- architecture (1)
- alexa (1)
- xml-parsing (1)
- delicious (1)
- bookmarking (1)
- web-services (1)
- diigo (1)
- pinboard (1)
- google-analytics (1)
- web-analytics (1)
- unifi (1)
- dream-machine-pro (1)
- access-logs (1)
- iplayer (1)
- ubiquiti (1)
- mathematics (1)
- curiosities (1)
- edit (1)
- ico (1)
- scam (1)
- cryptocurrency (1)
- 404-error (1)
- digital-ocean (1)
- football (1)
- iphone (1)
- mobile-apps (1)
- caching (1)
- redis (1)
- appfabric (1)
- benchmarking (1)
- vmware (1)
- p2v (1)
- proxmox (1)
- parallels (1)
- migration-guide (1)
- spam (1)
- email-security (1)
- malware (1)
- phishing (1)
- machine-learning (1)
- network (1)
- linq (1)
- contacts (1)
- icloud (1)
- mountain-lion (1)
- upgrade (1)
- filevault (1)
- macos (1)
- recovery-console (1)
- meraki (1)
- sonos (1)
- spotify (1)
- music-streaming (1)
- invites (1)
- maintenance (1)
- net (1)
- g-suite (1)
- email-management (1)
- windows-8 (1)
- metro (1)
- winrt (1)
- storage (1)
- synology (1)
- ad-domain (1)
- smb (1)
- cctv (1)
- cms (1)
- ipfirewall (1)
- vpn (1)
- tvos (1)
- tailscale (1)
- aspnet (1)
- load-balancing (1)
- curl (1)
- http-headers (1)
- vipassana (1)
- meditation (1)
- portugal (1)
- virgin-media (1)
- super-hub (1)
- time-zone (1)
- windows (1)
- task-scheduler (1)
- system-administration (1)
- mdx (1)
- claude-ai (1)
- javascript (1)
- migration (1)
- github-actions (1)
- cicd (1)
- webp (1)
- scripting (1)
- bash (1)