爬取花瓣网美女图片

下面是脚本之家 jb51.cc 通过网络收集整理的代码片段。

脚本之家小编现在分享给大家，也给大家做个参考。

import urllib,urllib2,re,sys,os,requests
path=r"C:wqabeautify"
url = 'http://huaban.com/favorite/beauty'
#http://huaban.com/explore/zhongwenlogo/?ig1un9tq&max=327773629&limit=20&wfl=1
i_headers = {"User-Agent": "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML,like Gecko) Chrome/46.0.2490.71 Safari/537.36"}
count=0

def urlHandle(url):
    req = urllib2.Request(url,headers=i_headers)
    html = urllib2.urlopen(req).read()
    reg = re.compile(r'"pin_id":(d+),.+?"file":{"farm":"farm1","bucket":"hbimg",.+?"key":"(.*?)",.+?"type":"image/(.*?)"',re.S)
    groups = re.findall(reg,html)
    return groups


def imgHandle(groups):
    if groups:
        for att in groups:    
            pin_id = att[0]
            att_url = att[1] + '_fw236'
            img_type = att[2]
            img_url = 'http://img.hb.aicdn.com/' + att_url
        
            r = requests.get(img_url)
            with open(path + att_url + '.' + img_type,'wb') as fd:
                for chunk in r.iter_content():
                    fd.write(chunk)



groups = urlHandle(url)
imgHandle(groups)

while(groups):
    count+=1
    print count
    pin_id  = groups[-1][0]
    print pin_id
    urltemp = url+'/?max=' + str(pin_id) + '&limit=' + str(20) + '&wfl=1'
    print(urltemp)
    groups = urlHandle(urltemp)
    #print groups
    imgHandle(groups)

以上是脚本之家(jb51.cc)为你收集整理的全部代码内容，希望文章能够帮你解决所遇到的程序开发问题。

如果觉得脚本之家网站内容还不错，欢迎将脚本之家网站推荐给程序员好友。

（编辑：安卓应用网）

【声明】本站内容均来自网络，其相关言论仅代表作者个人观点，不代表本站立场。若无意侵犯到您的权利，请及时与联系站长删除相关内容!