@crowltech

The open-source SEO crawler, made by SEOs for SEOs. Buy me a coffeee! https://xitter.cf/t.co/bNY5fo6eBK

crowl.tech/
Joined July 2018
  • Tweets22
  • Following5
  • Followers169
Thanks @juandastic for this user guide in 🇪🇸 juandastic.co/seo-tecnico/co…
1
1
Am I the only one who needs more time to write the documentation than to dev the feature? 😅
Quick update today to resolve a bug with blank pages that send HTTP 200 rescodes, and to update some outdated dependencies. To upgrade: crowl.tech/documentation/set…
2
Super update, je pense surtout pour la détection de langue avec Fasttext. Je pique l'idée, j'avais pas vu que dans la doc il avait mis en place un model tout prêt. Je m'emmerdais pour rien 😂 En tout cas super ajout sur le crawler allez voir ça 👍
Crowl@crowltech30 Apr 2021
v0.3 is finally here! Exclusion patterns, custom XPath extractors, proxies, language detection... See the full list of new features here: crowl.tech/releases/
2
2
ICYMI: new release of the #opensource #seo #crawler
Crowl@crowltech30 Apr 2021
v0.3 is finally here! Exclusion patterns, custom XPath extractors, proxies, language detection... See the full list of new features here: crowl.tech/releases/
1
v0.3 is finally here! Exclusion patterns, custom XPath extractors, proxies, language detection... See the full list of new features here: crowl.tech/releases/
1
3
3
3
New features (and old ones too) are described in the docs. See config options here: crowl.tech/documentation/con…
1
1
You can also support this project with a few cups of coffee buymeacoffee.com/crowltech ❤️

Crowl, the opensource SEO crawler is A crawler for SEOs, by SEOs, free and opensource.

Support the development of Crowl and help me get dedicated time for this project: buy me a coffee!You can support this project punctually (in the support tab on the right), or become a regular support

buymeacoffee.com
Support Crowl on @buymeacoffee ! buymeacoffee.com/crowltech/s…

Support Crowl! — Crowl, the opensource SEO crawler

Post by Crowl, the opensource SEO crawler

buymeacoffee.com
1
Currently writing release note and updating documentation 😎
1
Currently testing the next release of #crowl with some great new features. Still a bit of debug to do, but quite sure you'll like it!
1
2
1
A quick update this evening to add a parameter to exclude a pattern of URLs. Checkout gitlab.com/crowltech/crowl/-… and crowl.tech/documentation/con…
1
3
1
3
No release tag because some other features are coming quick!
A client of ours brought up this SEO-focused crawl library that I wasn't aware of (@crowltech) bit.ly/2ZixEY1 It abstracts some of the stuff you'll likely need to build if you're scraping. Sharing because it was new to me.
2
3
8
Crowl v0.2 is out! Config files & CSV export are the main features. Check out the release notes: gitlab.com/crowltech/crowl/-… And the new docs: crowl.tech/docs/ Feedback is welcome!

v0.2 · Tags · Crowl / crowl · GitLab

The opensource SEO crawler, made by SEOs for SEOs.

gitlab.com
1
1
1
A few example of using #cURL for #SEO databulle.com/blog/seo/curl-…

cURL for SEO

Tips and ideas to use cURL for common SEO checks.

databulle.com
1
Crowl: un crawler SEO opensource linuxfr.org/news/crowl-un-cr… via @linuxfrorg
1
4
A few technical updates are coming soon, too ;-)
1
We added a bit of documentation to make it easier to use Crowl. Check it out ! crowl.tech/docs/
1
3
Crowl: initiative for an opensource SEO crawler databulle.com/blog/random/cr… via @databulle

Crowl, the opensource SEO crawler

A few words about Crowl, the free, opensource and community-based SEO crawler.

databulle.com
2
4
Load more