cloudflare-scrape
A Python module to bypass Cloudflare's anti-bot page.
Python3237mit
7 months ago
anti-bot-pagecloudflareprotected-page
spider_man
SpiderMan,a base-on Broadway fast high-level web crawling & scraping framework f
Elixir19apache-2.0
2 months ago
crawlerdata-miningelixir
select.rs
A Rust library to extract useful data from HTML documents, suitable for web scra
Rust926mit
4 months ago
kimuraframework
Kimurai is a modern web scraping framework written in Ruby which works out of bo
Ruby999mit
8 months ago
crawlerheadless-chromekimurai
lambdasoup
Functional HTML scraping and rewriting with CSS in OCaml
OCaml373mit
8 months ago
csshtmlocaml
twitter-scraper
Scrape the Twitter frontend API without authentication with Golang.
Go839mit
6 months ago
pattern
Web mining module for Python, with tools for scraping, natural language processi
Python8591bsd-3-clause
10 months ago
machine-learningnatural-language-processingnetwork-analysis
ruia
Async Python 3.6+ web scraping micro-framework based on asyncio
Python1706apache-2.0
10 months ago
aiohttpasyncioasyncio-spider
DotnetSpider
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient
C#3805mit
6 months ago
crawlercross-platformcsharp
rod
A Devtools driver for web automation and scraping
Go4593mit
2 months ago
automationcdpchrome-devtools
scala-scraper
A Scala library for scraping content from HTML pages
Scala710mit
2 months ago
dslhacktoberfesthtml-parsing
metainspector
Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its
Ruby1023mit
2 months ago
jsoup
jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS
Java10397mit
5 months ago
csscss-selectorsdom
crawly
Crawly, a high-level web crawling & scraping framework for Elixir.
Elixir825apache-2.0
2 months ago
crawlercrawlingelixir
scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Python49034bsd-3-clause
6 months ago
crawlercrawlingframework
sinew
Generate roxygen2 skeletons populated with information scraped from the function
R164other
9 months ago
elixir-scrape
Scrape any website, article or RSS/Atom Feed with ease!
Elixir326lgpl-3.0
4 years ago
data-scienceelixirfeed
r-web-scraping-cheat-sheet
Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.
R378mit
last year
cheatsheethttrr
node-readability
Scrape/Crawl article from any site automatically. Make any web page readable, no
JavaScript341
6 years ago
walker
Seamlessly fetch paginated data from any source. Simple and high performance API
Go7mit
last year
api-scraperindexerpagination
upton
A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.
HTML1614mit
5 years ago
goq
A declarative struct-tag-based HTML unmarshaling or scraping package for Go buil
Go251mit
3 years ago
decodergolanggoquery
dataflowkit
Extract structured data from web sites. Web sites scraping.
Go623bsd-3-clause
last year
cdpchrome-fetchercrawling
enpeem-search
Search npm packages by web scraping and without indexing all npm packages
JavaScript4mit
8 years ago
antch
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
Go255mit
4 years ago
crawlercrawlingframework
metainspector
Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its
Ruby983mit
last year
NoFbEventScraper
This app scrapes Facebook event links and adds the event to your calendar.
Java26gpl-3.0
3 years ago
androidcalendarevents
steam_reviews
Video game review datasets scraped from the Steam website (http://store.steampow
39mit
8 years ago
haproxy_exporter
Simple server that scrapes HAProxy stats and exports them via HTTP for Prometheu
Go609apache-2.0
last year
gohaproxyhaproxy-exporter
FakeNewsCorpus
A dataset of millions of news articles scraped from a curated list of data sourc
366apache-2.0
4 years ago
artificial-intelligencecorpusdatabase
job_search
An app to search startup jobs scraped from websites written in Elixir, Phoenix,
Elixir96mit
7 years ago
elasticsearchelixirotp
golem-stat-bot
This is an example project on how stats.golem.network API can be utilized. It sc
Python2mit
3 years ago
golem
SDE-Interview-Questions
Most comprehensive list :clipboard: of tech interview questions :blue_book: of c
Java7009mit
2 years ago
algorithmcareercupcoding-interview