一、数据来源:
1、这批今日头条爬虫(zhanzhang.toutiao.com)IP来源于尚贤达猎头网站采集数据;
2、数据采集时间段:2023年10月-2024年7月;
3、判断标准:主要根据用户代理是否包含“zhanzhang.toutiao.com”和IP核实。
二、今日头条爬虫(zhanzhang.toutiao.com)主要有4个用户代理
序号 | UA |
1 | Mozilla/5.0+(Linux;+Android+5.0)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Mobile+Safari/537.36+(compatible;+Bytespider;+https://zhanzhang.toutiao.com/) |
2 | Mozilla/5.0+(compatible;+Bytespider;+https://zhanzhang.toutiao.com/)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/70.0.0.0+Safari/537.36 |
3 | Mozilla/5.0+AppleWebKit/537.36+(KHTML,+like+Gecko)+Mobile+Safari/537.36+(compatible;+Bytespider;+https://zhanzhang.toutiao.com/) |
4 | Mozilla/5.0+(iPhone;+CPU+iPhone+OS+7_1_2+like+Mac+OS+X)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Version/7.0+Mobile+Safari/537.36+(compatible;+Bytespider;+https://zhanzhang.toutiao.com/) |
三、今日头条爬虫(zhanzhang.toutiao.com)IP地址:
1、主要有以下四个网段:
(1)、110.249.201.0/24
(2)、110.249.202.0/24
(3)、111.225.148.0/24
(4)、111.225.149.0/24
110.249.201.10 | 110.249.201.79 | 110.249.202.57 | 111.225.148.245 | 111.225.149.21 |
110.249.201.100 | 110.249.201.8 | 110.249.202.58 | 111.225.148.246 | 111.225.149.210 |
110.249.201.101 | 110.249.201.80 | 110.249.202.59 | 111.225.148.247 | 111.225.149.211 |
110.249.201.102 | 110.249.201.81 | 110.249.202.6 | 111.225.148.248 | 111.225.149.212 |
110.249.201.103 | 110.249.201.82 | 110.249.202.60 | 111.225.148.249 | 111.225.149.213 |
110.249.201.104 | 110.249.201.83 | 110.249.202.61 | 111.225.148.25 | 111.225.149.214 |
110.249.201.105 | 110.249.201.84 | 110.249.202.62 | 111.225.148.26 | 111.225.149.215 |
110.249.201.106 | 110.249.201.85 | 110.249.202.63 | 111.225.148.27 | 111.225.149.216 |
110.249.201.107 | 110.249.201.86 | 110.249.202.64 | 111.225.148.28 | 111.225.149.217 |
110.249.201.108 | 110.249.201.87 | 110.249.202.65 | 111.225.148.29 | 111.225.149.218 |
110.249.201.109 | 110.249.201.88 | 110.249.202.66 | 111.225.148.3 | 111.225.149.219 |
110.249.201.11 | 110.249.201.89 | 110.249.202.67 | 111.225.148.30 | 111.225.149.22 |
110.249.201.110 | 110.249.201.9 | 110.249.202.68 | 111.225.148.31 | 111.225.149.220 |
110.249.201.111 | 110.249.201.90 | 110.249.202.69 | 111.225.148.32 | 111.225.149.221 |
110.249.201.112 | 110.249.201.91 | 110.249.202.7 | 111.225.148.33 | 111.225.149.222 |
110.249.201.113 | 110.249.201.92 | 110.249.202.70 | 111.225.148.34 | 111.225.149.223 |
110.249.201.114 | 110.249.201.93 | 110.249.202.71 | 111.225.148.35 | 111.225.149.224 |
110.249.201.115 | 110.249.201.94 | 110.249.202.72 | 111.225.148.36 | 111.225.149.225 |
110.249.201.116 | 110.249.201.95 | 110.249.202.73 | 111.225.148.37 | 111.225.149.226 |
110.249.201.117 | 110.249.201.96 | 110.249.202.74 | 111.225.148.38 | 111.225.149.227 |
110.249.201.118 | 110.249.201.97 | 110.249.202.75 | 111.225.148.39 | 111.225.149.228 |
110.249.201.119 | 110.249.201.98 | 110.249.202.76 | 111.225.148.4 | 111.225.149.229 |
110.249.201.12 | 110.249.201.99 | 110.249.202.77 | 111.225.148.40 | 111.225.149.23 |
110.249.201.120 | 110.249.202.10 | 110.249.202.78 | 111.225.148.41 | 111.225.149.230 |
110.249.201.121 | 110.249.202.100 | 110.249.202.79 | 111.225.148.42 | 111.225.149.231 |
110.249.201.13 | 110.249.202.101 | 110.249.202.8 | 111.225.148.43 | 111.225.149.232 |
110.249.201.130 | 110.249.202.102 | 110.249.202.80 | 111.225.148.44 | 111.225.149.233 |
110.249.201.131 | 110.249.202.103 | 110.249.202.81 | 111.225.148.45 | 111.225.149.234 |
110.249.201.132 | 110.249.202.104 | 110.249.202.82 | 111.225.148.46 | 111.225.149.235 |
110.249.201.133 | 110.249.202.105 | 110.249.202.83 | 111.225.148.47 | 111.225.149.236 |
110.249.201.134 | 110.249.202.106 | 110.249.202.84 | 111.225.148.48 | 111.225.149.237 |
110.249.201.135 | 110.249.202.107 | 110.249.202.85 | 111.225.148.49 | 111.225.149.238 |
110.249.201.136 | 110.249.202.108 | 110.249.202.86 | 111.225.148.5 | 111.225.149.239 |
110.249.201.137 | 110.249.202.109 | 110.249.202.87 | 111.225.148.50 | 111.225.149.24 |
110.249.201.138 | 110.249.202.11 | 110.249.202.88 | 111.225.148.51 | 111.225.149.240 |
110.249.201.139 | 110.249.202.110 | 110.249.202.89 | 111.225.148.52 | 111.225.149.241 |
110.249.201.14 | 110.249.202.111 | 110.249.202.9 | 111.225.148.53 | 111.225.149.242 |
110.249.201.140 | 110.249.202.112 | 110.249.202.90 | 111.225.148.54 | 111.225.149.243 |
110.249.201.141 | 110.249.202.113 | 110.249.202.91 | 111.225.148.55 | 111.225.149.244 |
110.249.201.142 | 110.249.202.114 | 110.249.202.92 | 111.225.148.56 | 111.225.149.245 |
110.249.201.143 | 110.249.202.115 | 110.249.202.93 | 111.225.148.57 | 111.225.149.246 |
110.249.201.144 | 110.249.202.116 | 110.249.202.94 | 111.225.148.58 | 111.225.149.247 |
110.249.201.145 | 110.249.202.117 | 110.249.202.95 | 111.225.148.59 | 111.225.149.248 |
110.249.201.146 | 110.249.202.118 | 110.249.202.96 | 111.225.148.6 | 111.225.149.249 |
110.249.201.147 | 110.249.202.119 | 110.249.202.97 | 111.225.148.60 | 111.225.149.25 |
110.249.201.148 | 110.249.202.12 | 110.249.202.98 | 111.225.148.61 | 111.225.149.26 |
110.249.201.149 | 110.249.202.120 | 110.249.202.99 | 111.225.148.62 | 111.225.149.27 |
110.249.201.15 | 110.249.202.121 | 111.225.148.10 | 111.225.148.63 | 111.225.149.28 |
110.249.201.150 | 110.249.202.13 | 111.225.148.100 | 111.225.148.64 | 111.225.149.3 |
110.249.201.151 | 110.249.202.130 | 111.225.148.101 | 111.225.148.65 | 111.225.149.30 |
110.249.201.152 | 110.249.202.131 | 111.225.148.102 | 111.225.148.66 | 111.225.149.31 |
110.249.201.153 | 110.249.202.132 | 111.225.148.103 | 111.225.148.67 | 111.225.149.32 |
110.249.201.154 | 110.249.202.133 | 111.225.148.104 | 111.225.148.68 | 111.225.149.33 |
110.249.201.155 | 110.249.202.134 | 111.225.148.105 | 111.225.148.69 | 111.225.149.34 |
110.249.201.156 | 110.249.202.135 | 111.225.148.106 | 111.225.148.7 | 111.225.149.35 |
110.249.201.157 | 110.249.202.136 | 111.225.148.107 | 111.225.148.70 | 111.225.149.36 |
110.249.201.158 | 110.249.202.137 | 111.225.148.108 | 111.225.148.71 | 111.225.149.37 |
110.249.201.159 | 110.249.202.138 | 111.225.148.109 | 111.225.148.72 | 111.225.149.38 |
110.249.201.16 | 110.249.202.139 | 111.225.148.11 | 111.225.148.73 | 111.225.149.39 |
110.249.201.160 | 110.249.202.14 | 111.225.148.110 | 111.225.148.74 | 111.225.149.4 |
110.249.201.161 | 110.249.202.140 | 111.225.148.111 | 111.225.148.75 | 111.225.149.40 |
110.249.201.162 | 110.249.202.141 | 111.225.148.112 | 111.225.148.76 | 111.225.149.41 |
110.249.201.163 | 110.249.202.142 | 111.225.148.113 | 111.225.148.77 | 111.225.149.42 |
110.249.201.164 | 110.249.202.143 | 111.225.148.114 | 111.225.148.78 | 111.225.149.43 |
110.249.201.165 | 110.249.202.144 | 111.225.148.115 | 111.225.148.79 | 111.225.149.44 |
110.249.201.166 | 110.249.202.145 | 111.225.148.116 | 111.225.148.8 | 111.225.149.45 |
110.249.201.167 | 110.249.202.146 | 111.225.148.117 | 111.225.148.80 | 111.225.149.46 |
110.249.201.168 | 110.249.202.147 | 111.225.148.118 | 111.225.148.81 | 111.225.149.47 |
110.249.201.169 | 110.249.202.148 | 111.225.148.119 | 111.225.148.82 | 111.225.149.48 |
110.249.201.17 | 110.249.202.149 | 111.225.148.12 | 111.225.148.83 | 111.225.149.49 |
110.249.201.170 | 110.249.202.15 | 111.225.148.120 | 111.225.148.84 | 111.225.149.5 |
110.249.201.171 | 110.249.202.150 | 111.225.148.121 | 111.225.148.85 | 111.225.149.50 |
110.249.201.172 | 110.249.202.151 | 111.225.148.13 | 111.225.148.86 | 111.225.149.51 |
110.249.201.173 | 110.249.202.152 | 111.225.148.130 | 111.225.148.87 | 111.225.149.52 |
110.249.201.174 | 110.249.202.153 | 111.225.148.131 | 111.225.148.88 | 111.225.149.53 |
110.249.201.175 | 110.249.202.154 | 111.225.148.132 | 111.225.148.89 | 111.225.149.54 |
110.249.201.176 | 110.249.202.155 | 111.225.148.133 | 111.225.148.9 | 111.225.149.55 |
110.249.201.177 | 110.249.202.156 | 111.225.148.134 | 111.225.148.90 | 111.225.149.56 |
110.249.201.178 | 110.249.202.157 | 111.225.148.135 | 111.225.148.91 | 111.225.149.57 |
110.249.201.179 | 110.249.202.158 | 111.225.148.136 | 111.225.148.92 | 111.225.149.58 |
110.249.201.18 | 110.249.202.159 | 111.225.148.137 | 111.225.148.93 | 111.225.149.59 |
110.249.201.180 | 110.249.202.16 | 111.225.148.138 | 111.225.148.94 | 111.225.149.6 |
110.249.201.181 | 110.249.202.160 | 111.225.148.139 | 111.225.148.95 | 111.225.149.60 |
110.249.201.182 | 110.249.202.161 | 111.225.148.14 | 111.225.148.96 | 111.225.149.61 |
110.249.201.183 | 110.249.202.162 | 111.225.148.140 | 111.225.148.97 | 111.225.149.62 |
110.249.201.184 | 110.249.202.163 | 111.225.148.141 | 111.225.148.98 | 111.225.149.63 |
110.249.201.185 | 110.249.202.164 | 111.225.148.142 | 111.225.148.99 | 111.225.149.64 |
110.249.201.186 | 110.249.202.165 | 111.225.148.143 | 111.225.149.10 | 111.225.149.65 |
110.249.201.187 | 110.249.202.166 | 111.225.148.144 | 111.225.149.100 | 111.225.149.66 |
110.249.201.188 | 110.249.202.167 | 111.225.148.145 | 111.225.149.101 | 111.225.149.67 |
110.249.201.189 | 110.249.202.168 | 111.225.148.146 | 111.225.149.102 | 111.225.149.68 |
110.249.201.19 | 110.249.202.169 | 111.225.148.147 | 111.225.149.103 | 111.225.149.69 |
110.249.201.190 | 110.249.202.17 | 111.225.148.148 | 111.225.149.104 | 111.225.149.7 |
110.249.201.191 | 110.249.202.170 | 111.225.148.149 | 111.225.149.105 | 111.225.149.70 |
110.249.201.192 | 110.249.202.171 | 111.225.148.15 | 111.225.149.106 | 111.225.149.71 |
110.249.201.193 | 110.249.202.172 | 111.225.148.150 | 111.225.149.107 | 111.225.149.72 |
110.249.201.194 | 110.249.202.173 | 111.225.148.151 | 111.225.149.108 | 111.225.149.73 |
110.249.201.195 | 110.249.202.174 | 111.225.148.152 | 111.225.149.109 | 111.225.149.74 |
110.249.201.196 | 110.249.202.175 | 111.225.148.153 | 111.225.149.11 | 111.225.149.75 |
110.249.201.197 | 110.249.202.176 | 111.225.148.154 | 111.225.149.110 | 111.225.149.76 |
110.249.201.198 | 110.249.202.177 | 111.225.148.155 | 111.225.149.111 | 111.225.149.77 |
110.249.201.199 | 110.249.202.178 | 111.225.148.156 | 111.225.149.112 | 111.225.149.78 |
110.249.201.2 | 110.249.202.179 | 111.225.148.157 | 111.225.149.113 | 111.225.149.79 |
110.249.201.20 | 110.249.202.18 | 111.225.148.158 | 111.225.149.114 | 111.225.149.8 |
110.249.201.200 | 110.249.202.180 | 111.225.148.159 | 111.225.149.115 | 111.225.149.80 |
110.249.201.201 | 110.249.202.181 | 111.225.148.16 | 111.225.149.116 | 111.225.149.81 |
110.249.201.202 | 110.249.202.182 | 111.225.148.160 | 111.225.149.117 | 111.225.149.82 |
110.249.201.203 | 110.249.202.183 | 111.225.148.161 | 111.225.149.118 | 111.225.149.83 |
110.249.201.204 | 110.249.202.184 | 111.225.148.162 | 111.225.149.119 | 111.225.149.84 |
110.249.201.205 | 110.249.202.185 | 111.225.148.163 | 111.225.149.12 | 111.225.149.85 |
110.249.201.206 | 110.249.202.186 | 111.225.148.164 | 111.225.149.120 | 111.225.149.86 |
110.249.201.207 | 110.249.202.187 | 111.225.148.165 | 111.225.149.121 | 111.225.149.87 |
110.249.201.208 | 110.249.202.188 | 111.225.148.166 | 111.225.149.13 | 111.225.149.88 |
110.249.201.209 | 110.249.202.189 | 111.225.148.167 | 111.225.149.130 | 111.225.149.89 |
110.249.201.21 | 110.249.202.19 | 111.225.148.168 | 111.225.149.131 | 111.225.149.9 |
110.249.201.210 | 110.249.202.190 | 111.225.148.169 | 111.225.149.132 | 111.225.149.90 |
110.249.201.212 | 110.249.202.191 | 111.225.148.17 | 111.225.149.133 | 111.225.149.91 |
110.249.201.214 | 110.249.202.192 | 111.225.148.170 | 111.225.149.134 | 111.225.149.92 |
110.249.201.216 | 110.249.202.193 | 111.225.148.171 | 111.225.149.135 | 111.225.149.93 |
110.249.201.218 | 110.249.202.194 | 111.225.148.172 | 111.225.149.136 | 111.225.149.94 |
110.249.201.219 | 110.249.202.195 | 111.225.148.173 | 111.225.149.137 | 111.225.149.95 |
110.249.201.221 | 110.249.202.196 | 111.225.148.174 | 111.225.149.138 | 111.225.149.96 |
110.249.201.222 | 110.249.202.197 | 111.225.148.175 | 111.225.149.139 | 111.225.149.97 |
110.249.201.225 | 110.249.202.198 | 111.225.148.176 | 111.225.149.14 | 111.225.149.98 |
110.249.201.227 | 110.249.202.199 | 111.225.148.177 | 111.225.149.140 | 111.225.149.99 |
110.249.201.228 | 110.249.202.2 | 111.225.148.178 | 111.225.149.141 | |
110.249.201.230 | 110.249.202.20 | 111.225.148.179 | 111.225.149.142 | |
110.249.201.231 | 110.249.202.200 | 111.225.148.18 | 111.225.149.143 | |
110.249.201.232 | 110.249.202.201 | 111.225.148.180 | 111.225.149.144 | |
110.249.201.233 | 110.249.202.202 | 111.225.148.181 | 111.225.149.145 | |
110.249.201.234 | 110.249.202.203 | 111.225.148.182 | 111.225.149.146 | |
110.249.201.235 | 110.249.202.204 | 111.225.148.183 | 111.225.149.147 | |
110.249.201.236 | 110.249.202.205 | 111.225.148.184 | 111.225.149.148 | |
110.249.201.237 | 110.249.202.206 | 111.225.148.185 | 111.225.149.149 | |
110.249.201.238 | 110.249.202.207 | 111.225.148.186 | 111.225.149.15 | |
110.249.201.239 | 110.249.202.208 | 111.225.148.187 | 111.225.149.150 | |
110.249.201.24 | 110.249.202.209 | 111.225.148.188 | 111.225.149.151 | |
110.249.201.240 | 110.249.202.21 | 111.225.148.189 | 111.225.149.152 | |
110.249.201.241 | 110.249.202.211 | 111.225.148.19 | 111.225.149.153 | |
110.249.201.242 | 110.249.202.212 | 111.225.148.190 | 111.225.149.154 | |
110.249.201.243 | 110.249.202.213 | 111.225.148.191 | 111.225.149.155 | |
110.249.201.244 | 110.249.202.215 | 111.225.148.192 | 111.225.149.156 | |
110.249.201.245 | 110.249.202.216 | 111.225.148.193 | 111.225.149.157 | |
110.249.201.246 | 110.249.202.217 | 111.225.148.194 | 111.225.149.158 | |
110.249.201.247 | 110.249.202.219 | 111.225.148.195 | 111.225.149.159 | |
110.249.201.248 | 110.249.202.221 | 111.225.148.196 | 111.225.149.16 | |
110.249.201.249 | 110.249.202.222 | 111.225.148.197 | 111.225.149.160 | |
110.249.201.28 | 110.249.202.225 | 111.225.148.198 | 111.225.149.161 | |
110.249.201.29 | 110.249.202.227 | 111.225.148.199 | 111.225.149.162 | |
110.249.201.3 | 110.249.202.228 | 111.225.148.2 | 111.225.149.163 | |
110.249.201.30 | 110.249.202.229 | 111.225.148.20 | 111.225.149.164 | |
110.249.201.31 | 110.249.202.230 | 111.225.148.200 | 111.225.149.165 | |
110.249.201.32 | 110.249.202.231 | 111.225.148.201 | 111.225.149.166 | |
110.249.201.33 | 110.249.202.232 | 111.225.148.202 | 111.225.149.167 | |
110.249.201.34 | 110.249.202.233 | 111.225.148.203 | 111.225.149.168 | |
110.249.201.36 | 110.249.202.234 | 111.225.148.204 | 111.225.149.169 | |
110.249.201.37 | 110.249.202.235 | 111.225.148.205 | 111.225.149.170 | |
110.249.201.38 | 110.249.202.236 | 111.225.148.206 | 111.225.149.171 | |
110.249.201.4 | 110.249.202.237 | 111.225.148.207 | 111.225.149.172 | |
110.249.201.40 | 110.249.202.238 | 111.225.148.208 | 111.225.149.173 | |
110.249.201.42 | 110.249.202.239 | 111.225.148.209 | 111.225.149.174 | |
110.249.201.43 | 110.249.202.24 | 111.225.148.21 | 111.225.149.175 | |
110.249.201.44 | 110.249.202.240 | 111.225.148.210 | 111.225.149.176 | |
110.249.201.45 | 110.249.202.241 | 111.225.148.211 | 111.225.149.177 | |
110.249.201.46 | 110.249.202.242 | 111.225.148.212 | 111.225.149.178 | |
110.249.201.47 | 110.249.202.243 | 111.225.148.213 | 111.225.149.179 | |
110.249.201.48 | 110.249.202.244 | 111.225.148.214 | 111.225.149.18 | |
110.249.201.49 | 110.249.202.245 | 111.225.148.215 | 111.225.149.180 | |
110.249.201.5 | 110.249.202.246 | 111.225.148.216 | 111.225.149.181 | |
110.249.201.50 | 110.249.202.247 | 111.225.148.217 | 111.225.149.182 | |
110.249.201.51 | 110.249.202.248 | 111.225.148.218 | 111.225.149.183 | |
110.249.201.52 | 110.249.202.249 | 111.225.148.219 | 111.225.149.184 | |
110.249.201.53 | 110.249.202.26 | 111.225.148.22 | 111.225.149.185 | |
110.249.201.54 | 110.249.202.3 | 111.225.148.220 | 111.225.149.186 | |
110.249.201.55 | 110.249.202.31 | 111.225.148.221 | 111.225.149.187 | |
110.249.201.56 | 110.249.202.32 | 111.225.148.222 | 111.225.149.188 | |
110.249.201.57 | 110.249.202.33 | 111.225.148.223 | 111.225.149.189 | |
110.249.201.58 | 110.249.202.34 | 111.225.148.224 | 111.225.149.19 | |
110.249.201.59 | 110.249.202.35 | 111.225.148.225 | 111.225.149.190 | |
110.249.201.6 | 110.249.202.36 | 111.225.148.226 | 111.225.149.191 | |
110.249.201.60 | 110.249.202.37 | 111.225.148.227 | 111.225.149.192 | |
110.249.201.61 | 110.249.202.38 | 111.225.148.228 | 111.225.149.193 | |
110.249.201.62 | 110.249.202.39 | 111.225.148.229 | 111.225.149.194 | |
110.249.201.63 | 110.249.202.4 | 111.225.148.23 | 111.225.149.195 | |
110.249.201.64 | 110.249.202.42 | 111.225.148.230 | 111.225.149.196 | |
110.249.201.65 | 110.249.202.43 | 111.225.148.231 | 111.225.149.197 | |
110.249.201.66 | 110.249.202.44 | 111.225.148.232 | 111.225.149.198 | |
110.249.201.67 | 110.249.202.45 | 111.225.148.233 | 111.225.149.199 | |
110.249.201.68 | 110.249.202.46 | 111.225.148.234 | 111.225.149.2 | |
110.249.201.69 | 110.249.202.47 | 111.225.148.235 | 111.225.149.20 | |
110.249.201.7 | 110.249.202.48 | 111.225.148.236 | 111.225.149.200 | |
110.249.201.70 | 110.249.202.49 | 111.225.148.237 | 111.225.149.201 | |
110.249.201.71 | 110.249.202.5 | 111.225.148.238 | 111.225.149.202 | |
110.249.201.72 | 110.249.202.50 | 111.225.148.239 | 111.225.149.203 | |
110.249.201.73 | 110.249.202.51 | 111.225.148.24 | 111.225.149.204 | |
110.249.201.74 | 110.249.202.52 | 111.225.148.240 | 111.225.149.205 | |
110.249.201.75 | 110.249.202.53 | 111.225.148.241 | 111.225.149.206 | |
110.249.201.76 | 110.249.202.54 | 111.225.148.242 | 111.225.149.207 | |
110.249.201.77 | 110.249.202.55 | 111.225.148.243 | 111.225.149.208 | |
110.249.201.78 | 110.249.202.56 | 111.225.148.244 | 111.225.149.209 |
四、今日头条爬虫(zhanzhang.toutiao.com)的一些特点:
对网站没什么危害,但抓取网站频繁,对资源消耗较大,可为网站带来些许客户
五、EXECL格式数据下载
下载