Beside JavaScript, which language do you use to parse and scrape web pages user ?
Beside JavaScript, which language do you use to parse and scrape web pages user ?
Nicholas Thomas
Other urls found in this thread:
Isaac Anderson
javascript
Isaac Barnes
>jshit
all you need is libxml and libcurl
Gabriel Rivera
AND ?
Christian Adams
>libxml
Does it work for html ?
Landon Turner
I was thinking more like Haskell, Prolog, Python
Non standard langs for this kind of stuff that you actuall use
Kayden Stewart
Is this the right set up ?
#include
pkg-config --cflags --libs libxml-2.0
Angel Reyes
I've done it in Go but generally I use Python with beautifulsoup. Awful name but a decent package
Carson Green
English
Hudson Adams
Python
Scrapy is better.
Owen Sanders
>Scrapy is better.
Will check that out, thanks.
Brayden Russell
Do you prefer Go or beautilfulsoup ?
Which library do you use in Go ?
Isaiah Thompson
Lua and lsqlite3 for complex stuff.
Curl and pup for simple stuff.
Gavin Powell
>Which library do you use in Go ?
I have used goquery in the past which seemed alright. But I was new to web scraping at the time and haven't used it for a while so I'm not sure how good it really is.
I generally prefer Python because most of my web scraping needs are better met with little scripts than compiled programs.
github.com
Blake Rodriguez
she fat as shit now
Jayden James
>big tits
>gets fat
who could have foreseen that
Dominic Sullivan
her twin sister has no problems like that
Wyatt Barnes
what did op say
Isaiah Howard
who cares?
Charles Gonzalez
html is xml
yes
Jayden Phillips
she sleeps with black guys
Henry Cook
that's not your mom, dummy
Ian Murphy
C, and i made my own html parser and xpath like library in ansi c with no dependencies
Luke Richardson
still built for bbc
Jackson Allen
this what bbc is built for retard
bbc porn is literally like animal porn
Robert Barnes
PHP + php-html-parser
Zachary Gutierrez
>white woman
>doesn't sleep with blacks
oxymoron
Luis Collins
COFFEEscript if you catch my drift