GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — GitHub - OnePlus7/cola: A distributed crawling framework.

BranchesTags
Open more actions menu
 
 

Latest commit

 

History

72 Commits
72 Commits

Folders and files

NameName
Last commit message
Last commit date
bin
bin
 
 
cola
cola
 
 
contrib
contrib
 
 
tests
tests
 
 
.gitignore
.gitignore
 
 
AUTHORS
AUTHORS
 
 
LICENSE
LICENSE
 
 
README.md
README.md
 
 

Repository files navigation

cola

Cola is a distributed crawling framework.

Why named cola? hmm, I like cola, and cola sounds a bit like crawler.

##Quick Start

  • download or clone source code, add cola to python path.
  • start cola master: /path/to/cola/bin/start_master.py
  • start cola worker: /path/to/cola/bin/start_worker.py --master [ip address]
  • run job: /path/to/cola/bin/coca.py -runLocalJob /path/to/cola/contrib/wiki

##Tips

  • Chinese docs(wiki).
  • I am trying my best to make cola stable.
  • Cola can also run in a single machine, you don't need to start master, workers and so on. Everything is simple!

About

A distributed crawling framework.

Resources

Readme
License
Activity

Stars

0 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

Packages

Contributors

You are visitor 01402520 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.