2 Jun
2017
2 Jun
'17
3:39 p.m.
Hi Oscar
The problem is that “MySQL server has gone away”, so it can’t update
the database after finishing the MWCS job. We fixed this in the newest
version, so you should indeed update.
I think that updating is done by “pip install msnoise”, and then for
each project “msnoise upgrade_db” (see the release notes
http://msnoise.org/doc/releasenotes/msnoise-1.5.html ). Tom can
clarify if this method I just described is actually the way to go…
Best, Lukas
2017-06-02 15:20 GMT+02:00 Christos Evangelidis <cevan(a)noa.gr>gr>:
Dear Oscar,
Can you really run 20 instances of the code (-t 20) ? I find the -t 20
rather high, but your machine might support it..
Regards,
Christos
Στις 1 Ιουν 2017 6:01 μμ, ο χρήστης "Oscar Alberto Castro Artola" <
oscar.cas.art(a)gmail.com> έγραψε:
Hello,
I have 10 years of data for 13 stations, I have computed the CCF and now it
is turn to compute the MWCS. When I do *msnoise -t 20 compute_mwcs *this
error appears:
*Process Process-4:*
*Traceback (most recent call last):*
* File "/usr/local/anaconda/lib/python2.7/multiprocessing/process.py",
line 258, in _bootstrap*
* self.run()*
* File "/usr/local/anaconda/lib/python2.7/multiprocessing/process.py",
line 114, in run*
* self._target(*self._args, **self._kwargs)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/msnoise/
s05compute_mwcs.py",
line 150, in main*
* update_job(db, day, pair, jobtype='DTT', flag='D')*
* File "/usr/local/anaconda/lib/python2.7/site-packages/msnoise/api.py",
line 615, in update_job*
* job = session.query(Job).filter(Job.day == day).filter(Job.pair ==
pair).filter(Job.jobtype == jobtype).first()*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/orm/query.py",
line 2755, in first*
* ret = list(self[0:1])*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/orm/query.py",
line 2547, in __getitem__*
* return list(res)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/orm/query.py",
line 2855, in __iter__*
* return self._execute_and_instances(context)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/orm/query.py",
line 2878, in _execute_and_instances*
* result = conn.execute(querycontext.statement, self._params)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 945, in execute*
* return meth(self, multiparams, params)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/
sql/elements.py",
line 263, in _execute_on_connection*
* return connection._execute_clauseelement(self, multiparams, params)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1053, in _execute_clauseelement*
* compiled_sql, distilled_params*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1189, in _execute_context*
* context)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1402, in _handle_dbapi_exception*
* exc_info*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/util/compat.py",
line 203, in raise_from_cause*
* reraise(type(exception), exception, tb=exc_tb, cause=cause)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1182, in _execute_context*
* context)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/
engine/default.py",
line 470, in do_execute*
* cursor.execute(statement, parameters)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/pymysql/cursors.py", line
158, in execute*
* result = self._query(query)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/pymysql/cursors.py", line
308, in _query*
* conn.query(q)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/pymysql/connections.py",
line 819, in query*
* self._execute_command(COMMAND.COM_QUERY, sql)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/pymysql/connections.py",
line 1037, in _execute_command*
* self._write_bytes(packet)*
* File
"/usr/local/anaconda/lib/python2.7/site-packages/pymysql/connections.py",
line 989, in _write_bytes*
* raise err.OperationalError(2006, "MySQL server has gone away (%r)" %
(e,))*
*OperationalError: (pymysql.err.OperationalError) (2006, "MySQL server has
gone away (error(32, 'Broken pipe'))") [SQL: u'SELECT jobs.ref AS
jobs_ref,
jobs.day AS jobs_day, jobs.pair AS jobs_pair, jobs.jobtype AS jobs_jobtype,
jobs.flag AS jobs_flag, jobs.lastmod AS jobs_lastmod \nFROM jobs \nWHERE
jobs.day = %(day_1)s AND jobs.pair = %(pair_1)s AND jobs.jobtype =
%(jobtype_1)s \n LIMIT %(param_1)s'] [parameters: {u'param_1': 1,
u'day_1':
'2009-02-16', u'jobtype_1': 'DTT', u'pair_1':
'IG.ARIG:IG.MOIG'}]*
At the beginning everything works fine, but because it takes a long time to
make the computation (around 5 days), every time that I come back to see
the results this happens. I am working with MSNoise 1.4 and I don't know
how to upgrade to MSNoise 1.5.
Does anyone know how to fix this?
Thanks in advance!
Oscar
_______________________________________________
MSNoise mailing list
MSNoise(a)mailman-as.oma.be
http://mailman-as.oma.be/mailman/listinfo/msnoise
_______________________________________________
MSNoise mailing list
MSNoise(a)mailman-as.oma.be
http://mailman-as.oma.be/mailman/listinfo/msnoise