Please no bully this time Edition
/pg/ Python General
Ryan Gomez
Other urls found in this thread:
stackoverflow.com
twitter.com
Easton Nelson
Scrapy is bloat.
Tyler King
This is the first time I've heard of it. Is it better just to write your own scraper with other libraries?
Benjamin Cooper
I prefer to have better control of my spiders. Scrapy dumbs down web scraping way too much.
The last time I used it, I spent an entire afternoon reading docs just to see the request fail against Cloudflare. I had to redo everything from scratch.
Angel Jones
I like python but the syntax is for brainlets
num = num + 1 makes my brain explode. How retarded is that
Zachary Gray
Yeah there are a lot of things that don't really make sense but I'm hoping once I get used to them it will be better.
Parker Hughes
You can do that in C.
Luis Clark
First comment of the question
stackoverflow.com
>your brain on Python
Cameron Rivera
good morning xirs!!
Josiah Kelly
Okay user. I will have respect for you this time and i won't turn it into a C# thread.
Kevin Bailey
Bros, wgmi when 3.11 comes out right? We'll finally catch up with PHP performance right?
Jackson Robinson
No, PHP, Node and Lua are on a whole other level of performance. Python would need a lot of changes to even get close. Even Cython isn't as fast as PHP 8.
Parker Roberts
who the fuck uses scrapy... use requests and bs4. and some re. also selenium. that's all you need...
Camden Collins
Thank you sir
Juan Price
>num = num + 1 makes my brain explode
What did you want instead? num++?
"num += 1" is valid Python, and it does what you might expect.
Matthew Green
What are they changing in it and when is it being released?
It's still weird syntax. But most syntax is weird to me because I'm new to programming.
Xavier Smith
I prefer cli, but I have to have a gui. So, which toolkit/library should I use? I have no experience with any of them.
Qt5? tk?
Andrew Turner
Now let me ask you. As a C# guy i don't know much about Python. And i want to be able to create a bot that goes through the subscription/login phase for a few website and then scrapes data. It should be detection proof. I already have ideas about how to do it
>Randomizing the delay between each request within an interval to make it look human
> Randomizing the x; y; position of the mouse inside the button tag before clicking to avoid detection based on mouse placement detection
etc....
What i don't know is which Python libraries i should use for that.
Isaiah Stewart
Selenium
Jace Hall
I have no idea. I've just started using Python and it's my first language.
Jason Morris
I hate this language.
Jayden Nelson
making references implicit and hidden is fucking retard
Asher Young
Oh, okay. Good luck then.
Jose Allen
selenium is exactly what you're looking for, you can control everything you mentioned with it.
Asher James
Tkinter is pretty easy to use for practice/learning projects. I like the way Kivy looks. Seems easier to get a modern looking GUI with Kivy than tkinter, but you'd probably need to spend more time learning the framework to do anything complex
Easton Martin
How is Selenium compared to Cypress and Puppeteer ?
Nathaniel Nelson
Thanks bros!