Friday, July 29, 2011

Get links from a page with bash

Get anchor elements from a webpage can be done with

curl URL 2>&1 | grep -o -E 'href="([^"#]+)"' | cut -d'"' -f2


where you replace URL with your choice, just like here:
curl http://cookpad.com 2>&1 | grep -o -E 'href="([^"#]+)"' | cut -d'"' -f2
Posted by at
Labels: ,

8 comments:

  1. NelsonAugust 2, 2014 at 12:59 PM

    Thanks for the little script, still useful two years later :-)

    ReplyDelete
  2. UnknownOctober 3, 2014 at 7:24 AM

    Thanks much appreciated!

    ReplyDelete
  3. Blogger UserJuly 2, 2015 at 1:09 PM

    Still useful in 2015

    ReplyDelete
  4. SreeJune 23, 2016 at 8:09 AM

    Still useful in 2016.. thanks

    ReplyDelete
  5. RIJOOctober 1, 2016 at 12:46 AM

    Thanks

    ReplyDelete
  6. SlavkaDecember 8, 2020 at 3:34 PM

    still useful 2020

    ReplyDelete
  7. AJJanuary 5, 2021 at 2:31 PM

    And still useful in 2021. Thanks !

    ReplyDelete
  8. UnknownFebruary 14, 2022 at 4:01 AM

    I know this is one of the most meaningful information for me. And I'm animated reading your article. But should remark on some general things, the website style is perfect; the articles are great. Thanks for the ton of tangible and attainable help. Unique domain backlinks

    ReplyDelete

Subscribe to: Post Comments (Atom)