The most popular open source web scraping framework in Python.

Joined January 2010
“scrapy” became my alter ego. it all started with my first ever python project, a simple web scraper that pulled headlines from top news sites. i used the scrapy library by @ScrapyProject. it wasn’t much, just a script. but it was the first thing i built that actually worked. and that made it special. later, i realized something funny: most of my ideas felt like fragments, messy, raw, not yet stitched together. so the word “scrapy” stuck. i even launched a few nft projects under the name “ScrapyNFTs”, none of them took off (my art was pretty scrapy too lol). nfts introduced me to web3, which led me to explore blockchain… and eventually evolve into @scrapychain.
1
2
5
386
There are prizes for the first 3 people with all data correctly scraped. The solutions must run on Scrapy Cloud. #scrapy #scraping #Python
Are you ready to show off your web scraping skills?💪🏼 Our devs created a coding contest EXCLUSIVELY for Extract Summit attendees. Sign up for Extract Summit and join us for the challenge. 👇🏼 hubs.li/H0Y3V8L0
5
8
Scrapy retweeted
Couldn't attend @ExtractSummit 2020? Don't worry, we've got you covered! All the recorded talks from both the tracks are now available to view on our website - hubs.li/H0B3Qxh0 #extractsummit #scrapinghub #dataextraction #webscraping #datascience
1
3
3
Day 18+19 #100DaysOfCode Created a web scraper with @ScrapyProject to extend my buyblack.guru project - tg it's so easy to pick up. With this, the hardest thing about getting the info I need is actually finding the sites
1
3
Oh, wow! I'm an Artic Code Vault Contributor @github thanks to some antique work in @ScrapyProject and github.com/klbostee/dumbo. It's been some time without coding, so it's a good invitation to start having some fun again :)
Just found out that Scrapy has started shipping its itemloaders as a separate package github.com/scrapy/itemloader… on my experience, a very elegant approach to keeping parsing logic separated from all the other hacks. @scrapinghub thanks!
2
7
Want to see what's new in Scrapy ? @ScrapyProject @ScrapingHub Check out my article on the latest update in Towards Data Science. #python #webdevelopment #100DaysOfCode towardsdatascience.com/my-fa…
7
13
Scrapy retweeted
Our Python Developer, Roy Healy, wrote this great article on Scrapy Shell GUI. His open-source project makes it really easy to build spiders. Check it out! bit.ly/32L5jJL #scrapy #spiders #webscraping #dataextraction
5
10
Delighted to be featured alongside all these fantastic Irish entrepreneurs, thanks @thinkbusinessie, here's to a great 2020! 🎊🚀
4
10
Scrapy retweeted
We have recently open-sourced Scrapy middleware that allows easy integration of AutoExtract with Scrapy. Read our latest blog post to find out how! - bit.ly/32lCKkU #AutoExtract #Scrapy #AI #ML #DataExtraction #WebScraping
10
14
Scrapy retweeted
#EOY2019 nominee, @shaneaevans will be talking about the future of location-flexible work at the Remote AfterWorks meetup in Cork. Register here to attend - bit.ly/2omlxJE #remoteworking #futureofwork #flexiblework #workfromanywhere
5
6
You can now watch all the talks from the Web Data Extraction Summit 2019 online on our website! - bit.ly/2Itd1z8 #extractsummit #scrapinghub #dataextraction #bigdata #webscraping #ML #AI
5
7
Scrapy retweeted
Couldn't attend the @extractsummit? Don't worry, we've got you covered! All the talks from the Web Data Extraction Summit 2019 are now available to view - bit.ly/2oYtPHn #extractsummit #scrapinghub #dataextraction #webscraping #datascience
4
7
Scrapy retweeted
ANNOUNCING THE LAUNCH OF SCRAPINGHUB'S AUTOEXTRACT!🎉 Powered by AI, AutoExtract makes scraping at scale easy! Read our blog post - bit.ly/306Dsp2 #AI #MachineLearning #DataExtraction #WebScraping #BigData #DataScience
1
11
1
18
Scrapy retweeted
Web extracted product data can help companies gain a competitive advantage through #brandmonitoring and #pricemonitoring. Get inspired by our latest blog! - bit.ly/2NbPjvf #dynamicpricing #MAPcompliance #bigdata #datascience #dataextraction #webscraping
1
2