ruby​​ nokogiriウェブスクレーパーで分割サブアレイ

Question

こんにちは私はちょうどhttps://github.com/ryandhaase/Web-Scraper/blob/master/airbnb_scraper.rbとhttps://medium.com/@tabor_francesca/web-scraper-airbnb-24d67939b08a#.mg7ny2tkeのチュートリアルを終えました。そして今私は練習中です。サブアレイを分割するのに問題があります。すべてが機能しますが、都市、州、および郵便番号を別々のExcelの列に分割することはできません。

次の行は間違っていますが、どうすれば修正できますか？

city << [subarray[0], "this is not working", subarray[1]] 

私の推測では、修正が必要な別の行があります。ただ、FYIとして

require 'rubygems' 
require 'nokogiri' 
require 'open-uri' 
require 'csv' 


url = "https://www.tesla.com/findus/list/stores/United+States" 

page = Nokogiri::HTML(open(url)) 

page = Nokogiri::HTML(open("https://www.tesla.com/findus/list/stores/United+States")) 
puts page.class 

name = [] 
street_address = [] 
extended_address = [] 
city = [] 
state = [] 
zip = [] 


    page.css('a.fn.org.url').each do |line| 
     name << line.text.strip 
    end 

    page.css('span.street-address').each do |line| 
     street_address << line.text 
    end 

    page.css('span.extended-address').each do |line| 
     extended_address << line.text 
    end 

    page.css('span.locality').each do |line| 
     subarray = line.text.strip.split(/ · /) 

     if subarray.length == 3 
      city << subarray 
     else 
      city << [subarray[0], "this is not working", subarray[1]] 
    end 

    end 



CSV.open("teslaStores.csv", "w") do |file| 
    file << ["Name", "Street Address", "Street Address Continued", "City", "State", "Zip"] 

    name.length.times do |i| 
    file << [name[i], street_address[i], extended_address[i], city[i], city[i][0], city[i][1]] 
    end 
end 

Answer 1

だから、私が行ってきましたpythonのmeetup.comイベントに参加し、このトピックにクラスがない場合でも、指示の1つに援助を求めました:)。先生は、コンマとスペースで分割する必要があると説明しました。私が前にどこかに分けていたところ。

page.css('span.locality').each do |line| 
     subarray = line.text.strip.split(',') 
     subarray2 = subarray[1].split(' ') 

      city << subarray[0] 
      state << subarray2[0] 
      zip << subarray2[1] 
    end 

ここで完全な答えだ：？

require 'rubygems' 
require 'nokogiri' 
require 'open-uri' 
require 'csv' 


url = "https://www.tesla.com/findus/list/stores/United+States" 

page = Nokogiri::HTML(open(url)) 

page = Nokogiri::HTML(open("https://www.tesla.com/findus/list/stores/United+States")) 
puts page.class 

name = [] 
street_address = [] 
extended_address = [] 
city = [] 
state = [] 
zip = [] 


    page.css('a.fn.org.url').each do |line| 
     name << line.text.strip 
    end 

    page.css('span.street-address').each do |line| 
     street_address << line.text 
    end 

    page.css('span.extended-address').each do |line| 
     extended_address << line.text 
    end 

    page.css('span.locality').each do |line| 
     subarray = line.text.strip.split(',') 
     subarray2 = subarray[1].split(' ') 

      city << subarray[0] 
      state << subarray2[0] 
      zip << subarray2[1] 
    end 


CSV.open("teslaStores.csv", "w") do |file| 
    file << ["Name", "Street Address", "Street Address Continued", "City", "State", "Zip"] 

    name.length.times do |i| 
    file << [name[i], street_address[i], extended_address[i], city[i], state[i], zip[i]] 
    end 
end 

Answer 2

、これはテストされていないが、より慣用的なRubyでコード：

require 'csv' 
require 'nokogiri' 
require 'open-uri' 

page = Nokogiri::HTML(open('https://www.tesla.com/findus/list/stores/United+States')) 

name = page.css('a.fn.org.url').map{ |n| n.text.strip } 
street_address = page.css('span.street-address').map { |n| n.text } 
extended_address = page.css('span.extended-address').map{ |n| n.text } 

city = page.css('span.locality').map { |n| 
    subarray = n.text.strip.split(/ · /) 

    if subarray.length == 3 
    subarray 
    else 
    [subarray[0], 'this is not working', subarray[1]] 
    end 

} 

CSV.open('teslaStores.csv', 'w') do |file| 
    file << ['Name', 'Street Address', 'Street Address Continued', 'City', 'State', 'Zip'] 

    name.length.times do |i| 
    file << [name[i], street_address[i], extended_address[i], city[i], city[i][0], city[i][1]] 
    end 
end 

そして、それは少しさらに低減することができるが：

street_address, extended_address = [ 
    'span.street-address', 
    'span.extended-address' 
].map{ |selector| 
    page.css(selector).map { |n| n.text } 
}