cherrypy & gevent patch
给cherrypy 打gevent WSGIServer的patch
1. patch Serving 类
2. 关闭python的原生WSGIServer
具体使用例子参考 我的开源项目 https://github.com/thomashuang/Lilac
#!/usr/bin/env python import cherrypy
from cherrypy import _cprequest
from cherrypy.lib import httputil
import sys
import logging
from cherrypy.process import servers LOGGER = logging.getLogger('web.patch') try:
from greenlet import getcurrent as get_ident
except ImportError:
LOGGER.ERROR('You shall install Gevent, if wanna use gevent wsgi server')
exit(1) def patch_cherrypy():
cherrypy.serving = GreenletServing() class GreenletServing(object):
__slots__ = ('__local__', ) def __init__(self):
object.__setattr__(self, '__local__', {})
ident = get_ident()
self.__local__[ident] = {
'request': _cprequest.Request(httputil.Host("127.0.0.1", 80), httputil.Host("127.0.0.1", 1111)),
'response': _cprequest.Response()
} def load(self, request, response):
self.__local__[get_ident()] = {
'request': request,
'response': response
} def __getattr__(self, name):
try:
return self.__local__[get_ident()][name]
except KeyError:
raise AttributeError(name) def __setattr__(self, name, value):
ident = get_ident()
local = self.__local__
try:
local[ident][name] = value
except KeyError:
local[ident] = {name: value} def clear(self):
"""Clear all attributes of the current greenlet."""
del self.__local__[get_ident()]
#!/usr/bin/env python import cherrypy
import sys
import logging
from cherrypy.process import servers LOGGER = logging.getLogger('web.server') class GeventWSGIServer(object): """Adapter for a gevent.wsgi.WSGIServer.""" def __init__(self, *args, **kwargs):
from lilac.web.patch import patch_cherrypy patch_cherrypy()
self.args = args
self.kwargs = kwargs
self.ready = False def start(self):
"""Start the GeventWSGIServer."""
# We have to instantiate the server class here because its __init__
from gevent.wsgi import WSGIServer self.ready = True
LOGGER.debug('Starting Gevent WSGI Server...')
self.httpd = WSGIServer(*self.args, **self.kwargs)
self.httpd.serve_forever() def stop(self):
"""Stop the HTTP server."""
LOGGER.debug('Stoping Gevent WSGI Server...')
self.ready = False
self.httpd.stop() class WebServer(object): def __init__(self, server_name='Sola', host='127.0.0.1', port=8080, use_gevent=True, debug=False, encoding='UTF-8'):
self.server_name = server_name
self.host = host
self.port = port
self.debug = debug
self.encoding = encoding
self.use_gevent = use_gevent
self.config = self.gen_config()
self.bootstrap() def bootstrap(self):
"""You can intialize more configs or settings in here"""
pass def gen_config(self):
conf = {
'global':
{
'server.socket_host': self.host,
'server.socket_port': self.port,
'engine.autoreload.on': self.debug,
#'log.screen': self.debug,
'log.error_file': '',
'log.access_file': '',
'request.error_response': self.handle_internal_exception,
'tools.decode.on': True,
"tools.encode.on": True,
'tools.encode.encoding': self.encoding,
'tools.gzip.on': True,
'tools.log_headers.on': False,
'request.show_tracebacks': False,
}
}
if self.use_gevent:
conf['global']['environment'] = 'embedded' return conf def set_404_pape(self, not_found_handler):
"""Custom not found page"""
self.config['global']['error_page.404'] = not_found_handler def asset(self, path, asset_path):
"""Set servering Static directory"""
self.config[path] = {
'tools.staticdir.on': True,
'tools.staticdir.dir': asset_path
} def handle_internal_exception(self):
"""Handle the unknow exception and also throw 5xx status and push message to frontend"""
cls, e, tb = sys.exc_info() LOGGER.exception('Unhandled Error %s', e)
resp = cherrypy.response
resp.status = 500
resp.content_type = 'text/html; charset=UTF-8' if cherrypy.request.method != 'HEAD':
resp.body = ["""<html>
<head><title>Internal Server Error </title></head>
<body><p>An error occurred: <b>%s</b></p></body>
</html> """ % (str(e))] def new_route(self):
return cherrypy.dispatch.RoutesDispatcher() def create_app(self):
raise NotImplemented('Must implement create_app in Subclass') def _bootstrap_app(self):
ctl, routes = self.create_app()
cherrypy.config.clear()
config = {'/': {'request.dispatch': routes}, 'global': self.config}
config.update(self.config)
cherrypy.config.update(config)
return cherrypy.tree.mount(ctl, '/', config) def serve_forever(self):
engine = cherrypy.engine
if hasattr(engine, "signal_handler"):
engine.signal_handler.subscribe()
if hasattr(engine, "console_control_handler"):
engine.console_control_handler.subscribe()
app = self._bootstrap_app()
try:
if self.use_gevent:
# Turn off autoreload when using *cgi.
#cherrypy.config.update({'engine.autoreload_on': False})
addr = cherrypy.server.bind_addr
cherrypy.server.unsubscribe()
f = GeventWSGIServer(addr, app, log=None)
s = servers.ServerAdapter(engine, httpserver=f, bind_addr=addr)
s.subscribe()
engine.start()
else:
cherrypy.quickstart(app)
except KeyboardInterrupt:
self.stop()
else:
engine.block() def stop(self):
cherrypy.engine.stop()
cherrypy & gevent patch的更多相关文章
- 高并发异步uwsgi+web.py+gevent
为什么用web.py? python的web框架有很多,比如webpy.flask.bottle等,但是为什么我们选了webpy呢?想了好久,未果,硬要给解释,我想可能原因有两个:第一个是兄弟项目组用 ...
- 协程--gevent模块(单线程高并发)
先恶补一下知识点,上节回顾 上下文切换:当CPU从执行一个线程切换到执行另外一个线程的时候,它需要先存储当前线程的本地的数据,程序指针等,然后载入另一个线程的本地数据,程序指针等,最后才开始执行.这种 ...
- [转载]python gevent
原地址: http://www.liaoxuefeng.com/wiki/001374738125095c955c1e6d8bb493182103fac9270762a000/001407503089 ...
- 流动python - 写port扫描仪和各种并发尝试(多线程/多进程/gevent/futures)
port扫描仪的原理非常easy.没有什么比操作更socket,能够connect它认为,port打开. import socket def scan(port): s = socket.socket ...
- gevent拾遗
在前文已经介绍过了gevent的调度流程,本文介绍gevent一些重要的模块,包括Timeout,Event\AsynResult, Semphore, socket patch,这些模块都涉及当 ...
- Python并发编程协程(Coroutine)之Gevent
Gevent官网文档地址:http://www.gevent.org/contents.html 基本概念 我们通常所说的协程Coroutine其实是corporate routine的缩写,直接翻译 ...
- gevent程序员指南
gevent程序员指南 由Gevent社区编写 gevent是一个基于libev的并发库.它为各种并发和网络相关的任务提供了整洁的API. 介绍 本指南假定读者有中级Python水平,但不要求有其 ...
- python中的猴子补丁Monkey Patch
python中的猴子补丁Monkey Patch 什么是猴子补丁 the term monkey patch only refers to dynamic modifications of a cla ...
- 协程----greenlet模块,gevent模块
1.协程初识,greenlet模块 2.gevent模块(需要pip安装) 一.协程初识,greenlet模块: 协程:是单线程下的并发,又称微线程,纤程.英文名Coroutine.一句话说明什么是线 ...
随机推荐
- scikit-learning教程(三)使用文本数据
使用文本数据 本指南的目标是探讨scikit-learn 一个实际任务中的一些主要工具:分析二十个不同主题的文本文档(新闻组帖子)集合. 在本节中,我们将看到如何: 加载文件内容和类别 提取适用于机器 ...
- Qt容器类之一:Qt的容器类介绍
一.介绍 Qt库提供了一套通用的基于模板的容器类,可以用这些类存储指定类型的项.比如,你需要一个大小可变的QString的数组,则使用QVector<QString>. 这些容器类比STL ...
- bzoj 5015 [Snoi2017]礼物
题面 https://www.lydsy.com/JudgeOnline/problem.php?id=5015 题解 首先把k=1,k=2,k=3的手推一遍 然后发现一些规律 就是数列可以表示成$a ...
- Hdu 3652 B-number (同余数位DP)
题目链接: Hdu 3652 B-number 题目描述: 给出一个数n,问 [1, n]区间内有几个数能被13整除并且还有13这个子串? 解题思路: 能整除的数位DP,确定好状态随便搞搞就能过了.d ...
- POM报错Failure to transfer org.apache.maven.plugins:maven-resources-plugin:pom:2.6 from
解决方式一: 1.查看.m2\repository\org\apache\maven\plugins\maven-resources-plugin\下maven-resources-plugin- ...
- 132 Palindrome Partitioning II 分割回文串 II
给定一个字符串 s,将 s 分割成一些子串,使每个子串都是回文串.返回 s 符合要求的的最少分割次数.例如,给出 s = "aab",返回 1 因为进行一次分割可以将字符串 s 分 ...
- v-bind和v-on
v-bind指令用于设置HTML属性:v-bind:href 缩写为 :href <a :href="{{url}}">aa</a> v-on 指令用于绑 ...
- android开发学习 ------- MongoDB数据库简单理解
首先说一下MongoDB是什么? MongoDB 是一个介于关系数据库和非关系数据库之间的产品,是非关系数据库当中功能最丰富,最像关系数据库的. MongoDB 是一个基于分布式文件存储的数据库. N ...
- 转 Java 208道面试题及部分答案 补充部分答案
转自https://www.cnblogs.com/chen1005/p/10481102.html ---恢复内容开始--- 一.Java 基础 1.JDK 和 JRE 有什么区别? 答:JRE ...
- canvas基础绘制-一个小球的坠落、反弹
效果如图: html: <!DOCTYPE html> <html lang="en"> <head> <meta charset=&qu ...