EADST

Obtain Links and Download Images from Webpages

Obtain Links and Download Images from Webpages

import requests
from bs4 import BeautifulSoup

def getHTMLText(url):
    try:
        res = requests.get(url, timeout = 6)
        res.raise_for_status()
        res.encoding = res.apparent_encoding
        return res.text
    except:
        return 'Error'

def main(url):
    demo = getHTMLText(url)
    soup = BeautifulSoup(demo, 'html.parser')
    a_labels = soup.find_all('a', attrs={'href': True})

    for idx, a in enumerate(a_labels):
        link = a.get('href')
        if "res" not in link and ".jpg" in link and idx % 50 == 1:
            urls = url + link
            save_path = "./save/" + link
            with open(save_path, 'wb') as f:
                f.write(requests.get(urls).content)


url = "http://eadst.com/"
main(url)
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
WAN VPN Gemma C++ SQLite CTC Web 第一性原理 Pillow Markdown Land HaggingFace VGG-16 Animate RAR Dataset SAM PyCharm 继承 UNIX CUDA TensorRT Template Tiktoken GPTQ BeautifulSoup uWSGI PIP DeepSeek Quantize Tracking mmap TTS Random Jupyter Zip Food Qwen2.5 XGBoost LeetCode Baidu SQL Review Translation TensorFlow 多进程 阿里云 Statistics Plotly LoRA Paper BTC 版权 FP32 CC torchinfo Image2Text Bin 多线程 llama.cpp Color Google 净利润 Use 图形思考法 关于博主 PDB Qwen2 CLAP Cloudreve Vim EXCEL OpenAI Plate Pickle Interview Hungarian Anaconda Distillation Domain Attention Datetime LLM scipy Quantization Rebuttal YOLO Pandas Safetensors FP16 Firewall Hilton 域名 Streamlit git UI CSV Algorithm News Card Proxy Bipartite 强化学习 Heatmap transformers Github Sklearn Input Agent Linux 音频 uwsgi OCR Breakpoint diffusers FlashAttention Logo git-lfs BF16 Nginx 论文速读 icon Video GGML PyTorch SPIE API InvalidArgumentError Bitcoin 报税 Django Numpy Hotel NLP 腾讯云 飞书 图标 RGB Clash Base64 Tensor NameSilo Claude 递归学习法 Git AI Bert Llama Windows Knowledge 签证 Data ModelScope 证件照 PDF Mixtral ResNet-50 ChatGPT GIT Math 算法题 GoogLeNet Vmess Docker WebCrawler LLAMA Permission Ptyhon COCO VSCode Diagram 财报 MD5 Paddle printf 顶会 LaTeX Ubuntu Conda Miniforge Michelin CAM Website tar Transformers NLTK logger Search SVR v2ray Jetson DeepStream Augmentation CV hf 搞笑 CEIR Disk TSV Pytorch Python 云服务器 Shortcut GPT4 RL XML ONNX Qwen FP64 Freesound tqdm FP8 OpenCV Magnet Crawler ms-swift QWEN v0.dev FastAPI Password IndexTTS2 Excel HuggingFace 公式 论文 JSON
站点统计

本站现有博文333篇,共被浏览922211

本站已经建立2628天!

热门文章
文章归档
回到顶部