EADST

Obtain Links and Download Images from Webpages

Obtain Links and Download Images from Webpages

import requests
from bs4 import BeautifulSoup

def getHTMLText(url):
    try:
        res = requests.get(url, timeout = 6)
        res.raise_for_status()
        res.encoding = res.apparent_encoding
        return res.text
    except:
        return 'Error'

def main(url):
    demo = getHTMLText(url)
    soup = BeautifulSoup(demo, 'html.parser')
    a_labels = soup.find_all('a', attrs={'href': True})

    for idx, a in enumerate(a_labels):
        link = a.get('href')
        if "res" not in link and ".jpg" in link and idx % 50 == 1:
            urls = url + link
            save_path = "./save/" + link
            with open(save_path, 'wb') as f:
                f.write(requests.get(urls).content)


url = "http://eadst.com/"
main(url)
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
NLP Rebuttal Paddle 第一性原理 v2ray NameSilo SVR FP16 Nginx Breakpoint PIP RAR AI MD5 PDB UI LoRA 飞书 Docker PyCharm 算法题 CAM CV ChatGPT Tensor QWEN Interview Bitcoin scipy Hilton Random Vim LLAMA 阿里云 Land Ptyhon Review torchinfo Miniforge Food Hotel 证件照 OCR LeetCode v0.dev 签证 Pytorch SQL CTC Plate Mixtral Logo Shortcut SAM LaTeX WebCrawler Pickle Web Pillow RGB Harness transformers hf OpenAI Attention Claude Zip FP32 Jetson News Permission Math Augmentation CUDA 继承 Llama Freesound TensorRT Python Windows YOLO CSV Qwen2 HaggingFace NLTK Bert BeautifulSoup 强化学习 CLAP DeepSeek SQLite API 论文速读 Markdown EXCEL JSON Clash logger 公式 Paper Pandas Jev Plotly 净利润 Linux Crawler tar Tracking git-lfs Vmess Ubuntu FP64 Git 音频 CEIR 域名 Translation uwsgi Qwen2.5 FastAPI Gemma Baidu GoogLeNet TensorFlow Michelin FP8 BTC VPN git Magnet Agent Disk 顶会 Tiktoken 云服务器 Datetime 报税 GGML SPIE Numpy WAN uWSGI COCO Template Proxy BF16 LLM 多线程 Bipartite GPT4 Website Dataset tqdm Google Data PDF 关于博主 Cloudreve printf Statistics FlashAttention 递归学习法 GIT CC llama.cpp Base64 VSCode Safetensors Django Card Search 财报 Input HuggingFace Excel Transformers Diagram Github 版权 Streamlit InvalidArgumentError C++ Heatmap IndexTTS2 ModelScope Conda diffusers Anaconda Domain Algorithm Qwen TTS UNIX Quantize XGBoost RL DeepStream 图标 ResNet-50 ONNX PyTorch Bin Jupyter 论文 API网关 TSV Firewall ms-swift 腾讯云 Distillation Video Image2Text Password Color Quantization 图形思考法 Use Sklearn 搞笑 icon 多进程 GPTQ XML VGG-16 Animate Hungarian Knowledge mmap OpenCV
站点统计

本站现有博文337篇,共被浏览961338次

本站已经建立2673天!

热门文章
文章归档
回到顶部