Python代理池是什么意思？Python中代理池如何搭建( 二 ) _python

3.最后只需要在爬虫中读取代理池文件并从中随机取出代理ip来使用，在调用爬虫方法时将代理ip作为指定ip使用即可，代码示例如下所示：
import pandas as pdimport numpy as npimport requestsimport timedf = pd.read_csv('ip.csv', header=None, names=["ip", "port", "anonymous", "proxy_type", "speed"])proxy_types = ["{}".format(i) for i in np.array(df['proxy_type'])]ips = ["{}".format(i) for i in np.array(df['ip'])]ports = ["{}".format(i) for i in np.array(df['port'])]proxy_url = ['{0}://{1}:{2}'.format(proxy_types[i], ips[i], ports[i]) for i in range(len(ips))]proxy_type = ['{}'.format(i) for i in proxy_types]for i in range(200): time.sleep(1) proxies = { proxy_type[i]: proxy_url[i] } try: response = requests.get('http://www.quanben9.com/', proxies=proxies) except Exception as e: print('invalid ip and port') else: code = response.status_code if code == 200: print('effective ip') with open('effective_ip.csv', 'a+', encoding='utf-8-sig') as f: f.write(proxy_type[i] + ',' + proxy_url[i] + '') else: print('invalid ip and port')以上就是关于“Python代理池是什么意思？Python中代理池如何搭建”的全部内容了，希望对你有所帮助。

Python代理池是什么意思？Python中代理池如何搭建( 二 )

猜你喜欢