scrape google urls

[24]

Hello everyone I'm currently working on a dorks parser and want to make it working with google but I tried multiple way with htmlagilitypack and didn't find out how to get all the urls of the page.
I'm asking myself if it's really possible to scrape google ? I would really apreciate any help thanks.

[3]

I think you would be more concern of the captcha when using a scraper.
For instance, the first roadblock you would encounter is the captcha on Google's SE. In the past there exist several methods to bypass the captcha but I think now they have patched it to prevent people from scraping the result automatically without involving the captcha.

You can consider using Python's Beautiful Soup to scrap the content, it might just work. But if you are constantly google dorking, the captcha would almost guarantee come out.