ページをスクラップし、hrefをクリックしてhrefsデータを取り込みます

Question

私はページをスクラップし、タグ内のhrefsデータを取得しようとしていますが、結果を得ることができません。これは私の学校の課題です。 誰かが私にこの問題を解決してもらえますか？

これは私のコードです：

from bs4 import BeautifulSoup 
import re 
import requests 

for i in range (1,5): 
    base_url = 'https://www.leboncoin.fr/locations' 
    url = 'https://www.leboncoin.fr/locations/1152669519.htm?ca=22_s' 
    res = requests.get(url) 
    soup = BeautifulSoup(res.text) 

    locations = [] 

    links = soup.find_all(['li','a'], href=re.compile('.*\/locations\/+(i)+')) 

    for l in links: 
     full_link = base_url + l['href'] 
     titre = l[['li', 'section', 'h2']].strip() 
     res = requests.get(full_link) 
     soup = BeautifulSoup(res.text) 
     loyer = soup.find(['h2','span'], attrs={"class": "value\^((?![A-Z]).)*$"}) 
     loyers = loyer.text 
     ville = soup.find(['h2','span'], attrs={"class": "value", "itemprop": "adresse"}) 
     villes = ville.text 
     surface = soup.find(['h2','span'], attrs={"class": "clearfix", "calss": "value"}) 
     surfaces = surface.text 
     description = soup.find('p', attrs={"class": "value", "itemprop": "description"}) 
     descriptions = description.text 
     shops.append(titre, loyers, villes, surfaces, descriptions) 

    print(locations) 

私はこのような結果だ：あなたの答えを事前に

[] 
[] 
[] 
[] 

感謝を。

Answer 1

あなたはどこにでもお店を定義していません、私はあなたが辞書を必要と仮定しています。したがって、これを行うには：

for l in links: 
    shops = {} 
    full_link = base_url + l['href'] 
    shops['titre'] = l[['li', 'section', 'h2']].strip() 
    res = requests.get(full_link) 
    soup = BeautifulSoup(res.text) 
    loyer = soup.find(['h2','span'], attrs={"class": "value\^((?![A-Z]).)*$"}) 
    shops['loyers'] = loyer.text 
    ville = soup.find(['h2','span'], attrs={"class": "value", "itemprop": "adresse"}) 
    shops['villes'] = ville.text 
    surface = soup.find(['h2','span'], attrs={"class": "clearfix", "calss": "value"}) 
    shops['surfaces'] = surface.text 
    description = soup.find('p', attrs={"class": "value", "itemprop": "description"}) 
    shops['descriptions'] = description.text 
    locations.append(shops) 

print(locations)