Skip to main content

26 posts tagged with "Python"

View All Tags

  • windows cmd 下 找到 python 与 pip 文件存放地址
λ  where.exe python    
D:\Python36\python.exe    
    
λ  where.exe pip    
D:\Python36\Scripts\pip.exe
  • windows 自带 ubuntu 下 （Windows 系统盘符存在/mnt/中）
:~$ sudo ln -s /mnt/d/Python36/Scripts/pip.exe /usr/bin/wpip    
:~$ sudo ln -s /mnt/d/Python36/python.exe /usr/bin/wpython
PythonOne min read

执行​

在IPython console里先cd到test.py所在的文件夹，再run test.py。注意使用的是命令run 而不是命令python。

debug​

栗子：

debugfile('/home/1/tensor2tensor/tensor2tensor/bin/t2t-datagen', args='--problem=image_mnist --data_dir=~/t2t_data --tmp_dir=~/t2t_data/tmp',wdir='/home/1/tensor2tensor/tensor2tensor/bin')
  • ipython下
cd /home    
pwd    
ls    
help(runfile)    
Help on function runfile in module _pydev_bundle.pydev_umd:    
runfile(filename, args=None, wdir=None, is_module=False, global_vars=None)    
    Run filename    
    args: command line arguments (string)    
    wdir: working directory    
run test.py

更多资料

PythonOne min read

下载地址

error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\BIN\\cl.exe' failed with exit status 2
  • 注意安装目录不能有中文
  • 版本对应 python 版本
  • 命令为：pip install *.whl
PythonOne min read

pycharm The repository located at pypi.douban.com is not a trusted or secure​

首先在 window 的文件夹窗口输入 ： %APPDATA%

image.png

然后在底下新建 pip 文件夹，然后到 pip 文件夹里面去新建个 pip.ini, 然后再里面输入内容 [global] timeout = 6000 index-url = http://pypi.douban.com/simple trusted-host = pypi.douban.com

image.png

作者：摘星辰 Li 链接：https://www.zhihu.com/question/38341743/answer/128985546 来源：知乎

PythonOne min read

配置信息​

  • python3 3.6
  • Flask-SQLAlchemy 2.3.2
  • win10

报错​

-----> [2018-07-16 17:22:42,041] [ERROR] [base.py<131>-base.run_job]: Job "auto_rollback.<locals>.wrapper (trigger: interval[0:30:00], next run at: 2018-07-16 17:52:42 CST)" raised an exception    
Traceback (most recent call last):    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1193, in _execute_context    
    context)    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/default.py", line 507, in do_execute    
    cursor.execute(statement, parameters)    
  File "/usr/local/lib/python3.6/site-packages/MySQLdb/cursors.py", line 250, in execute    
    self.errorhandler(self, exc, value)    
  File "/usr/local/lib/python3.6/site-packages/MySQLdb/connections.py", line 50, in defaulterrorhandler    
    raise errorvalue    
  File "/usr/local/lib/python3.6/site-packages/MySQLdb/cursors.py", line 247, in execute    
    res = self._query(query)    
  File "/usr/local/lib/python3.6/site-packages/MySQLdb/cursors.py", line 411, in _query    
    rowcount = self._do_query(q)    
  File "/usr/local/lib/python3.6/site-packages/MySQLdb/cursors.py", line 374, in _do_query    
    db.query(q)    
  File "/usr/local/lib/python3.6/site-packages/MySQLdb/connections.py", line 277, in query    
    _mysql.connection.query(self, query)    
_mysql_exceptions.OperationalError: (2006, 'MySQL server has gone away')    
    
The above exception was the direct cause of the following exception:    
    
Traceback (most recent call last):    
  File "/usr/local/lib/python3.6/site-packages/apscheduler/executors/base.py", line 125, in run_job    
    retval = job.func(*job.args, **job.kwargs)    
  File "/home/zza/eth_crawler/crawler_script/utils.py", line 28, in wrapper    
    raise err    
  File "/home/zza/eth_crawler/crawler_script/utils.py", line 24, in wrapper    
    return func(*args, **kwargs)    
  File "/home/zza/eth_crawler/crawler_script/token_tracker.py", line 240, in update    
    db_address = db.session.query(Token.contract_address).filter(None == Token.total_supply).all()    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 2773, in all    
    return list(self)    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 2925, in __iter__    
    return self._execute_and_instances(context)    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 2948, in _execute_and_instances    
    result = conn.execute(querycontext.statement, self._params)    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 948, in execute    
    return meth(self, multiparams, params)    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection    
    return connection._execute_clauseelement(self, multiparams, params)    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement    
    compiled_sql, distilled_params    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1200, in _execute_context    
    context)    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1413, in _handle_dbapi_exception    
    exc_info    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause    
    reraise(type(exception), exception, tb=exc_tb, cause=cause)    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/util/compat.py", line 186, in reraise    
    raise value.with_traceback(tb)    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1193, in _execute_context    
    context)    
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/default.py", line 507, in do_execute    
    cursor.execute(statement, parameters)    
  File "/usr/local/lib/python3.6/site-packages/MySQLdb/cursors.py", line 250, in execute    
    self.errorhandler(self, exc, value)    
  File "/usr/local/lib/python3.6/site-packages/MySQLdb/connections.py", line 50, in defaulterrorhandler    
    raise errorvalue    
  File "/usr/local/lib/python3.6/site-packages/MySQLdb/cursors.py", line 247, in execute    
    res = self._query(query)    
  File "/usr/local/lib/python3.6/site-packages/MySQLdb/cursors.py", line 411, in _query    
    rowcount = self._do_query(q)    
  File "/usr/local/lib/python3.6/site-packages/MySQLdb/cursors.py", line 374, in _do_query    
    db.query(q)    
  File "/usr/local/lib/python3.6/site-packages/MySQLdb/connections.py", line 277, in query    
    _mysql.connection.query(self, query)    
sqlalchemy.exc.OperationalError: (_mysql_exceptions.OperationalError) (2006, 'MySQL server has gone away') [SQL: 'SELECT token.contract_address AS token_contract_address \nFROM token \nWHERE token.total_supply IS NULL'] (Background on this error at: http://sqlalche.me/e/e3q8)

已使用解决方案​

出错后需要 rollback，为了后续程序能运行，给每个涉及 sql 语句的函数用了装饰器​

def auto_rollback(func):    
    def wrapper(*args, **kwargs):    
        try:    
            return func(*args, **kwargs)    
        except Exception as err:    
            db.session.rollback()    
            log.error(err)    
            raise err    
    
    return wrapper
  • 治标不治本系列

把 SQLALCHEMY_POOL_RECYCLE 设成一个较小的数​

app.config['SQLALCHEMY_POOL_SIZE'] = 128  # 线程池大小    
app.config['SQLALCHEMY_POOL_TIMEOUT'] = 90  # 超时时间    
app.config['SQLALCHEMY_POOL_RECYCLE'] = 3  # 空闲连接自动回收时间    
app.config['SQLALCHEMY_MAX_OVERFLOW'] = 128  # 控制在连接池达到最大值后可以创建的连接数。

根据错误日志 在需要用数据库的地方先断开连接​

db.session.remove()
  • 失败

将单独的 sql 语句改成 nopool 连接方式​

class nullpool_SQLAlchemy(SQLAlchemy):    
    def apply_driver_hacks(self, app, info, options):    
        super(nullpool_SQLAlchemy, self).apply_driver_hacks(app, info, options)    
        from sqlalchemy.pool import NullPool    
        options['poolclass'] = NullPool    
        del options['pool_size']

解决后又会出现

sqlalchemy.exc.InvalidRequestError: Can't reconnect until invalid transaction is rolled back
  • 失败

每次访问数据库重新生成 sqlalchemy 连接 ✔​

    from xxx import SQLAlchemy    
    from xxx import app    
    db = SQLAlchemy(app)

最粗暴但是最有效的解决方式，这个问题困扰了将近 3 周，emmm image.png

解决参考​

Python3 min read