Can you correct my script for Webscraping ?

spiceuser-fl76c · 2021-01-20T07:30:21.000Z

I have to search the internet (google chrome or Bing browser) for all the apothekes of Kaiserslautern and Landkreis Kaiserslautern with at least 3 subsidiaries in Germany and obtain in an Excel table the url of these apothekes, the name, the address, the email, phone number and the name of the Geschäftsführer ( manager). I use an ISE Powershell script for this.

Here is my script: I need to run as administrator first.
Then I type Set-execution policy (if restricted)
Get execution Policy unrestricted or open registry Editor via Key + R and type regedit and press enter.
Open the local group policy key + R and type gpedit.msc and press enter. If prompted by UAC, click on yes.
$Apotheken=”Kaiserslautern und Landkreis”
$url=” http://googlechrome.com?q = contact information for $Apotheken”
$result=Invoke-WebRequest $url $elements=$results:All Elements|where class -eq “3 filialen”(in Germany)
$Apotheken = (Get-Service -DisplayName Apotheken | Select-Object -Property DisplayName, url,address,telefon,email address,Geschäftsführer Name)|Format-Table -Proprety Name,url,Address,Telefon,Geschäftsführer Name| export “C:\temp\Apotheken.csv”

DoctorDNS · 2021-01-20T10:57:01.000Z

Kaiserlautern ist einer meiner Lieblingsorte - ich war schon oft geschäftlich unterwegs

Thanks for the question - and just a small point. When you post code here, can you use the </> tool. That makes the code easier to read and that, in turn, increased your chances of a brilliant answer.

Also, when you write pipelines, I always recommend better indentation. Like this:

$Apotheken=”Kaiserslautern und Landkreis”
$url=”http://googlechrome.com?q = contact information for $Apotheker” 
$result=Invoke-WebRequest $url $elements=$results:All Elements|
  Where-Object  class -eq “3 filialen”(in Germany) 
$Apotheken = (Get-Service -DisplayName *Apotheken* | 
  Select-Object -Property DisplayName, url,address,telefon,email address,
                          Geschäftsführer Name)| 
    Format-Table -Proprety Name,url,Address,Telefon,Geschäftsführer Name| 
      export “C:\temp\Apotheken.csv”

Looking at that, a fundamental mistake:

NEVER put anything after Format-Table (or any Format-*) command. The rule is Format right, everrthing else left. Format-Table converts the data into formattring details which are not what you want.

Also, you have some errors in the code - I THINK you want somethign closer to;l

$Apotheken=”Kaiserslautern und Landkreis”
$url=”http://googlechrome.com?q = contact information for $Apotheker” 
$Result=Invoke-WebRequest $url $elements=$results:All Elements|
  Where-Object  class -eq “3 filialen”(in Germany) 
$Apotheken = (Get-Service -DisplayName *Apotheken* | 
  Select-Object -Property DisplayName, url,address,telefon,email address,
                          GeschäftsführerName) |                             # not sure about this property name
    Export-CSV “C:\temp\Apotheken.csv”

Even then, I suspect that this will not work since you are piping the service details which so not contain the properties you want.

I wish I could help more but screen scraping is something I just don;t grok!

Neally · 2021-01-20T15:41:44.000Z

Ha my Dad is from Kaiserlautern, well actually Mainz, but he moved to Lautern as a child.

If you post code, please use the ‘Insert Code’ button. Please and thank you!

PLEASE READ BEFORE POSTING! Read if you're new to the PowerShell forum! Programming & Development

Hi, and welcome to the PowerShell forum! Don’t apologize for being a “noob” or “newbie” or “n00b.” There’s just no need – nobody will think you’re stupid, and the forums are all about asking questions. Just ask! Use a descriptive subject. Don’t say “Need help” or “PowerShell Help”, actually summarize what the problem is. It helps the rest of us keep track of which problem is which. Don’t post massive scripts. We’re all volunteers and we don’t have time to read all that, nor will we copy…