SPAM: (compatible; Bytespider; spider-feedback@bytedance.com)
- funnyinterestingcool
- Posts: 518
- Joined: Tue Jul 09, 2019 11:54 pm
- Contact:
SPAM: (compatible; Bytespider; spider-feedback@bytedance.com)
Cralwer that's not respecting robots.txt rules and using AmazonAWS services to crawl websites and mask (or re-route) their origin IPs. Their crawling rates are extremely high.