news_crawler

HOW TO USE

python mongodb.py

HOW TO ADD A NEW MODULE

1. write your module *.py refer to tech_163.py or auto_163.py
2. put your module *.py in the folder mod
3. add from mod import * to mongodb.py
4. add your name of module to mod = [tech_163, auto_163, *]

• define a news item as:

item = {'title': title,
        'date': date,
        'content': content,
        'cate': 'tech/auto/*',
        'src': '163/*',
        'link': link,
        }

• mysql.py is unfinished coz my project is based on mongodb