Breaking News: Grepper is joining You.com. Read the official announcement!

get all urls from a website python

YOU.com answered on September 12, 2023 Popularity 5/10 Helpfulness 4/10

answer get all urls from a website python

get all urls from a website python

Comment

import requests
from bs4 import BeautifulSoup

def get_all_urls_from_website(url):
    try:
        response = requests.get(url)
        soup = BeautifulSoup(response.content, 'html.parser')
        urls = []
        for link in soup.find_all('a'):
            url = link.get('href')
            if url is not None:
                urls.append(url)
        return urls
    except requests.exceptions.RequestException as e:
        print("Error: ", e)
        return []

# Example usage:
website_url = "https://www.example.com"
all_urls = get_all_urls_from_website(website_url)
for url in all_urls:
    print(url)

Popularity 5/10 Helpfulness 4/10 Language python

Source: Grepper

Link to this answer
Share Copy Link

Contributed on Sep 12 2023

YOU.com

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

get all urls from a website python

Contents

More Related Answers

get all urls from a website python

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.