Dear All,
I have just installed msnoise versions 1.6, in the configuration I set
hpc to Y. After computing of cross-correlation, I use the command
"msnoise new_jobs CC:STACK", which make stack job in the dashboard, but
when I use the command "msnoise stack -r" it doesn't compute reference
stack!
I will be grateful, if you help me.
regards,
Navid
Dear users & friends,
More than 2 years after the last major release (MSNoise 1.5) I’m proud
to announce the new MSNoise 1.6. It is a major release, with a massive
amount of work since the last one: in GitHub numbers , it’s over 190
commits and over 4000 lines of code and documentation changed or added!
MSNoise 1.6 introduces a series of new features :
The workflow has been rewritten to create “job types” per step,
making it easier for users to reset a jobs before a specific step.
This and other smaller adaptations to the code allows to run
MSNoise more efficiently, e.g. on a HPC.
The components to compute can be defined for “single-station” and
“cross-station” independently.
The compute_cc step has been completely rewritten to be much, much
faster.
A new db top level command, which among others include dump and
import commands for handling the tables from the database.
A new Interaction Examples & Gallery section of the documentation
in order to demonstrate how users can interact with the MSNoise API,
e.g. for creating custom plots.
As always, this version has benefited from outputs/ideas/pull
requests/questions from several users/friends.
Thanks to all for using MSNoise, and please, let us know why/how you use
it (and please cite it!)!
To date, we found/are aware of 70 publications using MSNoise! That’s the
best validation of our project ever and it has doubled since last release!!
Thomas
Full release notes for 1.6:
http://msnoise.org/doc/releasenotes/msnoise-1.6.html (please read them!!)
--
Dr. Thomas Lecocq
Geologist - Seismologist
Seismology - Gravimetry
Royal Observatory of Belgium
*
* * * * *
* * * *
---------
http://www.seismology.behttp://msnoise.orghttp://twitter.com/#!/Seismologie_behttps://www.facebook.com/seismologie.be
Hi,
Please try to adapt your MySQL server config following this:
http://msnoise.org/doc/master/installation.html#mysql-mariadb-configuration
note you'll have to restart the mysql server after the changes.
Cheers,
Thomas
Le 15/07/2019 à 20:32, gaelle vanessa Nana a écrit :
> Hello group,
>
> i have Problem with the STACK.
> I did the CC, but when i start the STACK processus, some PB appear, i don't
> know what to do exactly.
> You can see below the error who appear on the terminal, after running the
> STACK.
>
> thank you for your help
>
>
> base) vanessa@NANA:~/noise1$ msnoise stack -r -m -i 10
> Lets STACK !
> 2019-07-15 19:23:45 [DEBUG] Starting the ref stack
> []
> 2019-07-15 19:23:45 [DEBUG] Processing XB_CM01:XB_CM02-ZZ-1
> Traceback (most recent call last):
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/base.py",
>
> line 1244, in _execute_context
> cursor, statement, parameters, context
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/default.py
> ", line 550, in do_execute
> cursor.execute(statement, parameters)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/cursors.py",
> line 17
> 0, in execute
> result = self._query(query)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/cursors.py",
> line 32
> 8, in _query
> conn.query(q)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py",
> lin
> e 517, in query
> self._affected_rows = self._read_query_result(unbuffered=unbuffered)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py",
> lin
> e 732, in _read_query_result
> result.read()
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py",
> lin
> e 1075, in read
> first_packet = self.connection._read_packet()
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py",
> lin
> e 684, in _read_packet
> packet.check_error()
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/protocol.py",
> line 2
> 20, in check_error
> err.raise_mysql_exception(self._data)
> File "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/err.py",
> line 109, i
> n raise_mysql_exception
> raise errorclass(errno, errval)
> pymysql.err.InternalError: (1055, "Expression #1 of SELECT list is not in
> GROUP BY claus
> e and contains nonaggregated column 'msnoise.jobs.ref' which is not
> functionally depende
> nt on columns in GROUP BY clause; this is incompatible with
> sql_mode=only_full_group_by"
> )
>
> The above exception was the direct cause of the following exception:
>
> Traceback (most recent call last):
> File "/home/vanessa/anaconda3/bin/msnoise", line 10, in <module>
> sys.exit(run())
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/msnoise/scripts/msnoise.py",
> line 717, in run
> cli(obj={})
> File "/home/vanessa/anaconda3/lib/python3.7/site-packages/click/core.py",
> line 764, in
> __call__
> return self.main(*args, **kwargs)
> File "/home/vanessa/anaconda3/lib/python3.7/site-packages/click/core.py",
> line 717, in
> main
> rv = self.invoke(ctx)
> File "/home/vanessa/anaconda3/lib/python3.7/site-packages/click/core.py",
> line 1137, i
> n invoke
> return _process_result(sub_ctx.command.invoke(sub_ctx))
> File "/home/vanessa/anaconda3/lib/python3.7/site-packages/click/core.py",
> line 956, in
> invoke
> return ctx.invoke(self.callback, **ctx.params)
> File "/home/vanessa/anaconda3/lib/python3.7/site-packages/click/core.py",
> line 555, in
> invoke
> return callback(*args, **kwargs)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/msnoise/scripts/msnoise.py",
> line 375, in stack
> main('ref', interval)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/msnoise/s04stack.py",
> line 1
> 97, in main
> updated_days = updated_days_for_dates(db, start, end, pair.replace('_',
> '.'), jobtyp
> e='CC', interval=datetime.timedelta(days=interval),returndays=True)
> File "/home/vanessa/anaconda3/lib/python3.7/site-packages/msnoise/api.py",
> line 1255,
> in updated_days_for_dates
> group_by(Job.day).order_by(Job.day).all()
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/orm/query.py",
> li
> ne 3168, in all
> return list(self)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/orm/query.py",
> li
> ne 3324, in __iter__
> return self._execute_and_instances(context)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/orm/query.py",
> li
> ne 3349, in _execute_and_instances
> result = conn.execute(querycontext.statement, self._params)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/base.py",
>
> line 988, in execute
> return meth(self, multiparams, params)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/sql/elements.py",
> line 287, in _execute_on_connection
> return connection._execute_clauseelement(self, multiparams, params)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/base.py",
>
> line 1107, in _execute_clauseelement
> distilled_params,
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/base.py",
>
> line 1248, in _execute_context
> e, statement, parameters, cursor, context
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/base.py",
>
> line 1466, in _handle_dbapi_exception
> util.raise_from_cause(sqlalchemy_exception, exc_info)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/util/compat.py",
>
> line 399, in raise_from_cause
> reraise(type(exception), exception, tb=exc_tb, cause=cause)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/util/compat.py",
>
> line 153, in reraise
> raise value.with_traceback(tb)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/base.py",
>
> line 1244, in _execute_context
> cursor, statement, parameters, context
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/default.py
> ", line 550, in do_execute
> cursor.execute(statement, parameters)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/cursors.py",
> line 17
> 0, in execute
> result = self._query(query)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/cursors.py",
> line 32
> 8, in _query
> conn.query(q)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py",
> lin
> e 517, in query
> self._affected_rows = self._read_query_result(unbuffered=unbuffered)
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py",
> lin
> e 732, in _read_query_result
> result.read()
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py",
> lin
> e 1075, in read
> first_packet = self.connection._read_packet()
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py",
> lin
> e 684, in _read_packet
> packet.check_error()
> File
> "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/protocol.py",
> line 2
> 20, in check_error
> err.raise_mysql_exception(self._data)
> File "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/err.py",
> line 109, i
> n raise_mysql_exception
> raise errorclass(errno, errval)
> sqlalchemy.exc.InternalError: (pymysql.err.InternalError) (1055,
> "Expression #1 of SELEC
> T list is not in GROUP BY clause and contains nonaggregated column
> 'msnoise.jobs.ref' wh
> ich is not functionally dependent on columns in GROUP BY clause; this is
> incompatible wi
> th sql_mode=only_full_group_by")
> [SQL: SELECT jobs.ref AS jobs_ref, jobs.day AS jobs_day, jobs.pair AS
> jobs_pair, jobs.jo
> btype AS jobs_jobtype, jobs.flag AS jobs_flag, jobs.lastmod AS jobs_lastmod
>
> FROM jobs
> WHERE jobs.pair = %(pair_1)s AND jobs.day >= %(day_1)s AND jobs.day <=
> %(day_2)s AND job
> s.jobtype = %(jobtype_1)s AND jobs.lastmod >= %(lastmod_1)s GROUP BY
> jobs.day ORDER BY j
> obs.day]
> [parameters: {'pair_1': 'XB.CM01:XB.CM02', 'day_1': datetime.date(2006, 1,
> 1), 'day_2':
> datetime.date(2007, 1, 1), 'jobtype_1': 'CC', 'lastmod_1':
> datetime.datetime(2019, 7, 5,
> 19, 23, 45, 798518)}]
> (Background on this error at: http://sqlalche.me/e/2j85)
>
>
> Le mer. 3 juil. 2019 à 08:07, Thomas Lecocq <Thomas.Lecocq(a)seismology.be> a
> écrit :
>
>> Hi,
>>
>> Could you try using an empty folder, as stated in the doc and here: "
>>
>> Directory is not empty, can't run tests here!"
>>
>> ?
>>
>> Thomas
>>
>> On 28/06/2019 15:01, gaelle vanessa Nana wrote:
>>> hello MSnoise group
>>> i have a problem,after installing Msnoise, i tried to run MSNOISE TEST
>> but
>>> there is some problem.
>>> I tried to install pyqt, pyside but no success.
>>> Please, if someone have an idea to solve this problem.
>>>
>>> cheers
>>>
>>> (base) vanessa@NANA:~$ msnoise test
>>> 2019-06-28 13:51:35 [DEBUG] CACHEDIR=/home/vanessa/.cache/matplotlib
>>> 2019-06-28 13:51:35 [DEBUG] Using fontManager instance from
>>> /home/vanessa/.cache/matplotlib/fontlist-v310.json
>>> 2019-06-28 13:51:36 [DEBUG] Loaded backend qt5agg version unknown.
>>> 2019-06-28 13:51:36 [DEBUG] Loaded backend qt5agg version unknown.
>>> 2019-06-28 13:51:36 [DEBUG] Loaded backend Qt5Agg version unknown.
>>> 2019-06-28 13:51:36 [DEBUG] Loaded backend agg version unknown.
>>> 2019-06-28 13:51:36 [DEBUG] Loaded backend agg version unknown.
>>> Directory is not empty, can't run tests here!
>>>
>>> _______________________________________________
>>> MSNoise mailing list
>>> MSNoise(a)mailman-as.oma.be
>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>> --
>> Dr. Thomas Lecocq
>> Geologist - Seismologist
>>
>> Seismology - Gravimetry
>> Royal Observatory of Belgium
>>
>> *
>> * * * * *
>> * * * *
>> ---------
>> http://www.seismology.be
>> http://msnoise.org
>> http://twitter.com/#!/Seismologie_be
>> https://www.facebook.com/seismologie.be
>>
>> _______________________________________________
>> MSNoise mailing list
>> MSNoise(a)mailman-as.oma.be
>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>
> _______________________________________________
> MSNoise mailing list
> MSNoise(a)mailman-as.oma.be
> http://mailman-as.oma.be/mailman/listinfo/msnoise
>
Hi everyone,
I want to work with sara plugin, after station table has been populated
and the archive scanned, I use the command "msnoise config --set
plugins=msnoise_sara" then Successfully updated parameter plugins =
msnoise_sara.
Afterwards I use the command "msnoise p sara install" and I face with
the Error "No such command "sara""
could you please help me
Thanks a lot
Navid
>From vanessa.gaelle3(a)gmail.com Mon Jul 15 18:32:37 2019
Return-Path: <vanessa.gaelle3(a)gmail.com>
X-Original-To: msnoise(a)mailman-as.oma.be
Delivered-To: msnoise(a)mailman-as.oma.be
Received: from mail-oi1-f174.google.com (mail-oi1-f174.google.com
[209.85.167.174])
by mailman-as.oma.be (Postfix) with ESMTP id 2398E2075B
for <msnoise(a)mailman-as.oma.be>; Mon, 15 Jul 2019 18:32:37 +0000 (UTC)
Received: by mail-oi1-f174.google.com with SMTP id s184so13433018oie.9
for <msnoise(a)mailman-as.oma.be>; Mon, 15 Jul 2019 11:32:37 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
h=mime-version:references:in-reply-to:from:date:message-id:subject:to;
bh=8FQlI/B22THz1BlxuVRG+2J33NYLtL+fFfOln5d+gTg=;
b=rdQJjPdyG2V0iwseZEDwm/R+/uhm3c6piUoUbWwl9wtnXWCkVsSXjt4X0d79wc7QZ5
H3wYCOo/bhJBagqoz0MitiaPwsVg9x4Py212TvLiXulFX2wqJ5+rxl9JlXj89o+qQ2/D
2u7UusYKOIp5jTvN4aT51yqYw9c1xN4qkvwlX5Ph9zCRn2r9PhTpOVJBOm4hmZggBmhX
5dsBallB4vJwQ21uEYGaCqCjeSMWNmgxs0NKLKqeUwNqp2qDqp//zNcz0Yv0Gp1F6+cC
XM7ZgpiNYvkRqJTseykUvDMvGfaPCn55PYfdviuc1dpb/r0SkKMuPo2VwMEcUXOkELLA
K1/A==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20161025;
h=x-gm-message-state:mime-version:references:in-reply-to:from:date
:message-id:subject:to;
bh=8FQlI/B22THz1BlxuVRG+2J33NYLtL+fFfOln5d+gTg=;
b=oghE5kmS7XAaMs7Arz4LaN0uuJ1f+bnLaRu2ok9IuAaYk2mEgFME0eYQORC/h7ePOo
CWLayVKFgFaHzDfgupFEiPNOeN5QomZfnRemC9oJkqlHfgWieDw2lpT36g86+XbUVAbr
iXdrYi6HmP9rLNGtPk5WM+b7zFgz+2c0A3lFLPkZ07frCf/wGQG7RdCzjd2wdjWybG6u
S3fS8ch85NayEVv0IINBHrs9FADIBCZijtaScdQqfVWCnIdLCfMqu4lDwzTuN8qdNtN8
6/tdyzMwucKfQtn2wNu7CSx8hQyaqV8kOJ2DGCtg01kVu3QcSP4HZrpKgFYGyI0Ry4r2
501Q==
X-Gm-Message-State: APjAAAW0Eb+SEVW//I4DKSyMF448W3ULSstrwwZT8kB2CbeR8osT74gJ
/JGfRQab1Fz/eKMUa4BL4qyyuVDoEopKPj2+pTRPCbz6
X-Google-Smtp-Source: APXvYqyp24AjB8Nx92UQPmRtNnc1SX+RvtDptMYfdGLrWpaMxS9/8caetjMCFDIdHC/etcCqTMtmSu+wjFF5SD5O0/I=
X-Received: by 2002:aca:544b:: with SMTP id i72mr14663197oib.174.1563215555809;
Mon, 15 Jul 2019 11:32:35 -0700 (PDT)
MIME-Version: 1.0
References: <CAMKH5-=4HkuTgBU6SqH6A=BZuCCgJSLku4AnCa4i=og0DqO_qA(a)mail.gmail.com>
<778217f9-4cec-ce15-530f-5e318838c820(a)seismology.be>
In-Reply-To: <778217f9-4cec-ce15-530f-5e318838c820(a)seismology.be>
From: gaelle vanessa Nana <vanessa.gaelle3(a)gmail.com>
Date: Mon, 15 Jul 2019 19:32:15 +0100
Message-ID: <CAMKH5-=sG8+7SkKu2DCPd5gnwmFMUvXJf8YGZ+B3L+x_w6N8SA(a)mail.gmail.com>
To: Python Package for Monitoring Seismic Velocity Changes using Ambient
Seismic Noise <msnoise(a)mailman-as.oma.be>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Content-Filtered-By: Mailman/MimeDel 2.1.12
Subject: Re: [MSNoise] help
X-BeenThere: msnoise(a)mailman-as.oma.be
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Python Package for Monitoring Seismic Velocity Changes using Ambient
Seismic Noise <msnoise.mailman-as.oma.be>
List-Unsubscribe: <http://mailman-as.oma.be/mailman/options/msnoise>,
<mailto:msnoise-request@mailman-as.oma.be?subject=unsubscribe>
List-Archive: <http://mailman-as.oma.be/pipermail/msnoise/>
List-Post: <mailto:msnoise@mailman-as.oma.be>
List-Help: <mailto:msnoise-request@mailman-as.oma.be?subject=help>
List-Subscribe: <http://mailman-as.oma.be/mailman/listinfo/msnoise>,
<mailto:msnoise-request@mailman-as.oma.be?subject=subscribe>
X-List-Received-Date: Mon, 15 Jul 2019 18:32:37 -0000
Hello group,
i have Problem with the STACK.
I did the CC, but when i start the STACK processus, some PB appear, i don't
know what to do exactly.
You can see below the error who appear on the terminal, after running the
STACK.
thank you for your help
base) vanessa@NANA:~/noise1$ msnoise stack -r -m -i 10
Lets STACK !
2019-07-15 19:23:45 [DEBUG] Starting the ref stack
[]
2019-07-15 19:23:45 [DEBUG] Processing XB_CM01:XB_CM02-ZZ-1
Traceback (most recent call last):
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/base=
.py",
line 1244, in _execute_context
cursor, statement, parameters, context
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/defa=
ult.py
", line 550, in do_execute
cursor.execute(statement, parameters)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/cursors.py",
line 17
0, in execute
result =3D self._query(query)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/cursors.py",
line 32
8, in _query
conn.query(q)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py=
",
lin
e 517, in query
self._affected_rows =3D self._read_query_result(unbuffered=3Dunbuffered)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py=
",
lin
e 732, in _read_query_result
result.read()
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py=
",
lin
e 1075, in read
first_packet =3D self.connection._read_packet()
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py=
",
lin
e 684, in _read_packet
packet.check_error()
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/protocol.py",
line 2
20, in check_error
err.raise_mysql_exception(self._data)
File "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/err.py",
line 109, i
n raise_mysql_exception
raise errorclass(errno, errval)
pymysql.err.InternalError: (1055, "Expression #1 of SELECT list is not in
GROUP BY claus
e and contains nonaggregated column 'msnoise.jobs.ref' which is not
functionally depende
nt on columns in GROUP BY clause; this is incompatible with
sql_mode=3Donly_full_group_by"
)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/vanessa/anaconda3/bin/msnoise", line 10, in <module>
sys.exit(run())
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/msnoise/scripts/msnois=
e.py",
line 717, in run
cli(obj=3D{})
File "/home/vanessa/anaconda3/lib/python3.7/site-packages/click/core.py",
line 764, in
__call__
return self.main(*args, **kwargs)
File "/home/vanessa/anaconda3/lib/python3.7/site-packages/click/core.py",
line 717, in
main
rv =3D self.invoke(ctx)
File "/home/vanessa/anaconda3/lib/python3.7/site-packages/click/core.py",
line 1137, i
n invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/home/vanessa/anaconda3/lib/python3.7/site-packages/click/core.py",
line 956, in
invoke
return ctx.invoke(self.callback, **ctx.params)
File "/home/vanessa/anaconda3/lib/python3.7/site-packages/click/core.py",
line 555, in
invoke
return callback(*args, **kwargs)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/msnoise/scripts/msnois=
e.py",
line 375, in stack
main('ref', interval)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/msnoise/s04stack.py",
line 1
97, in main
updated_days =3D updated_days_for_dates(db, start, end, pair.replace('_'=
,
'.'), jobtyp
e=3D'CC', interval=3Ddatetime.timedelta(days=3Dinterval),returndays=3DTrue)
File "/home/vanessa/anaconda3/lib/python3.7/site-packages/msnoise/api.py",
line 1255,
in updated_days_for_dates
group_by(Job.day).order_by(Job.day).all()
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/orm/query.p=
y",
li
ne 3168, in all
return list(self)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/orm/query.p=
y",
li
ne 3324, in __iter__
return self._execute_and_instances(context)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/orm/query.p=
y",
li
ne 3349, in _execute_and_instances
result =3D conn.execute(querycontext.statement, self._params)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/base=
.py",
line 988, in execute
return meth(self, multiparams, params)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/sql/element=
s.py",
line 287, in _execute_on_connection
return connection._execute_clauseelement(self, multiparams, params)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/base=
.py",
line 1107, in _execute_clauseelement
distilled_params,
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/base=
.py",
line 1248, in _execute_context
e, statement, parameters, cursor, context
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/base=
.py",
line 1466, in _handle_dbapi_exception
util.raise_from_cause(sqlalchemy_exception, exc_info)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/util/compat=
.py",
line 399, in raise_from_cause
reraise(type(exception), exception, tb=3Dexc_tb, cause=3Dcause)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/util/compat=
.py",
line 153, in reraise
raise value.with_traceback(tb)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/base=
.py",
line 1244, in _execute_context
cursor, statement, parameters, context
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/defa=
ult.py
", line 550, in do_execute
cursor.execute(statement, parameters)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/cursors.py",
line 17
0, in execute
result =3D self._query(query)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/cursors.py",
line 32
8, in _query
conn.query(q)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py=
",
lin
e 517, in query
self._affected_rows =3D self._read_query_result(unbuffered=3Dunbuffered)
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py=
",
lin
e 732, in _read_query_result
result.read()
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py=
",
lin
e 1075, in read
first_packet =3D self.connection._read_packet()
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/connections.py=
",
lin
e 684, in _read_packet
packet.check_error()
File
"/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/protocol.py",
line 2
20, in check_error
err.raise_mysql_exception(self._data)
File "/home/vanessa/anaconda3/lib/python3.7/site-packages/pymysql/err.py",
line 109, i
n raise_mysql_exception
raise errorclass(errno, errval)
sqlalchemy.exc.InternalError: (pymysql.err.InternalError) (1055,
"Expression #1 of SELEC
T list is not in GROUP BY clause and contains nonaggregated column
'msnoise.jobs.ref' wh
ich is not functionally dependent on columns in GROUP BY clause; this is
incompatible wi
th sql_mode=3Donly_full_group_by")
[SQL: SELECT jobs.ref AS jobs_ref, jobs.day AS jobs_day, jobs.pair AS
jobs_pair, jobs.jo
btype AS jobs_jobtype, jobs.flag AS jobs_flag, jobs.lastmod AS jobs_lastmod
FROM jobs
WHERE jobs.pair =3D %(pair_1)s AND jobs.day >=3D %(day_1)s AND jobs.day <=
=3D
%(day_2)s AND job
s.jobtype =3D %(jobtype_1)s AND jobs.lastmod >=3D %(lastmod_1)s GROUP BY
jobs.day ORDER BY j
obs.day]
[parameters: {'pair_1': 'XB.CM01:XB.CM02', 'day_1': datetime.date(2006, 1,
1), 'day_2':
datetime.date(2007, 1, 1), 'jobtype_1': 'CC', 'lastmod_1':
datetime.datetime(2019, 7, 5,
19, 23, 45, 798518)}]
(Background on this error at: http://sqlalche.me/e/2j85)
Le mer. 3 juil. 2019 =C3=A0 08:07, Thomas Lecocq <Thomas.Lecocq(a)seismology.=
be> a
=C3=A9crit :
> Hi,
>
> Could you try using an empty folder, as stated in the doc and here: "
>
> Directory is not empty, can't run tests here!"
>
> ?
>
> Thomas
>
> On 28/06/2019 15:01, gaelle vanessa Nana wrote:
> > hello MSnoise group
> > i have a problem,after installing Msnoise, i tried to run MSNOISE TEST
> but
> > there is some problem.
> > I tried to install pyqt, pyside but no success.
> > Please, if someone have an idea to solve this problem.
> >
> > cheers
> >
> > (base) vanessa@NANA:~$ msnoise test
> > 2019-06-28 13:51:35 [DEBUG] CACHEDIR=3D/home/vanessa/.cache/matplotlib
> > 2019-06-28 13:51:35 [DEBUG] Using fontManager instance from
> > /home/vanessa/.cache/matplotlib/fontlist-v310.json
> > 2019-06-28 13:51:36 [DEBUG] Loaded backend qt5agg version unknown.
> > 2019-06-28 13:51:36 [DEBUG] Loaded backend qt5agg version unknown.
> > 2019-06-28 13:51:36 [DEBUG] Loaded backend Qt5Agg version unknown.
> > 2019-06-28 13:51:36 [DEBUG] Loaded backend agg version unknown.
> > 2019-06-28 13:51:36 [DEBUG] Loaded backend agg version unknown.
> > Directory is not empty, can't run tests here!
> >
> > _______________________________________________
> > MSNoise mailing list
> > MSNoise(a)mailman-as.oma.be
> > http://mailman-as.oma.be/mailman/listinfo/msnoise
>
> --
> Dr. Thomas Lecocq
> Geologist - Seismologist
>
> Seismology - Gravimetry
> Royal Observatory of Belgium
>
> *
> * * * * *
> * * * *
> ---------
> http://www.seismology.be
> http://msnoise.org
> http://twitter.com/#!/Seismologie_be
> https://www.facebook.com/seismologie.be
>
> _______________________________________________
> MSNoise mailing list
> MSNoise(a)mailman-as.oma.be
> http://mailman-as.oma.be/mailman/listinfo/msnoise
>
hello MSnoise group
i have a problem,after installing Msnoise, i tried to run MSNOISE TEST but
there is some problem.
I tried to install pyqt, pyside but no success.
Please, if someone have an idea to solve this problem.
cheers
(base) vanessa@NANA:~$ msnoise test
2019-06-28 13:51:35 [DEBUG] CACHEDIR=/home/vanessa/.cache/matplotlib
2019-06-28 13:51:35 [DEBUG] Using fontManager instance from
/home/vanessa/.cache/matplotlib/fontlist-v310.json
2019-06-28 13:51:36 [DEBUG] Loaded backend qt5agg version unknown.
2019-06-28 13:51:36 [DEBUG] Loaded backend qt5agg version unknown.
2019-06-28 13:51:36 [DEBUG] Loaded backend Qt5Agg version unknown.
2019-06-28 13:51:36 [DEBUG] Loaded backend agg version unknown.
2019-06-28 13:51:36 [DEBUG] Loaded backend agg version unknown.
Directory is not empty, can't run tests here!
Hello MSnoise Group,
I am trying to use windows version of msnoise with mysql but, I am having
problem during data import. Being a beginer at both python and mysql.
All steps are clear till creating empty database in mysql but, after that I
am facing problem even after reading documentation for several times. Even,
I tried reading codes of Data_structure, Scan_archive and even one extra
code given for custom data structure and station population but could not
get anything.
I can open the admin interface but there is no data to show. The sac file i
am trying to import is attached herewith.
May i get some demo for the steps involved during data loading and
populating the stations.
Thanking you
yours sincerely,
Shiv Mangal Gupta
IIT (ISM), Dhanbad , India
ᐧ
Hi, Thomas,
Recently, I used msnoise development version to process my data. I found the `stack` command will insert the MWCS jobs whose ‘day’ attribute were REF,
and when I completed the `compute_mwcs`, the flag of MWCS jobs with REF day were still T(Todo). Progress bar of MWCS jobs in dashboard was not 100%.
I checked the Job list and found all MWCS jobs have been done except the jobs with 'REF day'.
Then I looked the file s04stack.py, and found the REF MWCS jobs were inserted by:
```
322 update_job(db, "REF", ref_name.replace('_', '.'), 'MWCS', 'T’)
```
It seems these jobs were not used in MWCS step.
If you don't mind I asked, I'd like to understand the reason behind setting up such job.
When I want to compute MWCS repeatedly, after reset all mwcs jobs, should I mark the jobs with ‘REF day' as D(done) manually?
Looking forward your reply.
Thank you very very much!
weiyu
Dear Joseph,
Thanks for using MSNoise.
If there is only one core running it means probably that you have only 1
day of data to correlate. The multi-thread/processing of MSNoise works
based on "day" jobs, which are independent from the other days. With 1
day of data for N stations, you'll have N (N-1)/2 jobs "T"odo in the
database, but they will all be processed by the same thread.
Best regards,
Thomas
Le 24/06/2019 à 02:32, Thangraj, Joseph a écrit :
> Dear Thomas,
> I am using MSNoise to process a 250 Hz sample rate data set with
> 131 stations. I was trying to run my cross-correlations (compute-cc)
> in parallel to make the computations faster. However, inspite of using
> msnoise -t 14 compute-cc on a 70 cpu computer (256 Gb ram), the
> cross-correlations still run on one cpu. The parallel instances of
> 'compute-cc' start and finish without doing any jobs. Is it because
> the first instance sets all the jobs as 'I' meaning in progress, or
> should I change something in my config to make it run in parallel. I
> would appreciate your input about this problem. Please let me know if
> you require any additional information.
> Have a good week ahead!
>
> Joseph Thangraj
>
> Graduate student
>
> Department of Geosciences
>
> Baylor University
>
Hi MSNoise group,
I run a shell script which downloads data for each day, processes it to
produce an updated DVV plot, then removes the original data to save space
on my computer. However, MSNoise does not perform 'compute-cc', until I
manually remove all files in the 'Database-Data Availability' tab in the
MSNoise admin GUI (FileNotFoundError: [Errno 2] No such file or directory) .
Is there a command I can run in my script to not have to make a manual
adjustment to the data availability tab?
Regards,
Caitlin Smith,
University of Auckland
csmi310(a)aucklanduni.ac.nz
Hello MSNoise group,
I faced with a problem with 'msnoise -t 2 scan-archive'.
Below are the responses when I run 'msnoise -t 2 scan-archive' and with
'--init'.
PS>msnoise -t 2 scan-archive --init
c:\users\jeon\anaconda3\lib\site-packages\pymysql\cursors.py:170: Warning:
(1366, "Incorrect string value: '\\xB4\\xEB\\xC7\\xD1\\xB9\\xCE...' for
column 'VARIABLE_VALUE' at row 1")
result = self._query(query)
2019-06-13 20:38:41 [INFO] *** Starting: Scan Archive ***
2019-06-13 20:38:41 [INFO] Initializing (should be run only once)
2019-06-13 20:38:41 [INFO] Will work on 2 thread(s)
2019-06-13 20:38:41 [INFO] Will search for files between 2017-01-01 and
2019-12-30
2019-06-13 20:38:41 [DEBUG] Will search for channels: ['*']
2019-06-13 20:38:41 [DEBUG] Data Folder: E:\00.msnoise\02.SeimicData
2019-06-13 20:38:41 [DEBUG] Folders to glob:
E:\00.msnoise\02.SeimicData\2017/KG/TJN/*.D,E:\00.msnoise\02.SeimicData\2017/KS/JEJB/*.D,E:\00.msnoise\02.SeimicData\2017/KS/YOCB/*.D,E:\00.msnoise\02.SeimicData\2018/KG/TJN/*.D,E:\00.msnoise\02.SeimicData\2018/KS/JEJB/*.D,E:\00.msnoise\02.SeimicData\2018/KS/YOCB/*.D,E:\00.msnoise\02.SeimicData\2019/KG/TJN/*.D,E:\00.msnoise\02.SeimicData\2019/KS/JEJB/*.D,E:\00.msnoise\02.SeimicData\2019/KS/YOCB/*.D
2019-06-13 20:38:41 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KG/TJN\HHE.D folder: 1
2019-06-13 20:38:41 [INFO] E:\00.msnoise\02.SeimicData\2019/KG/TJN\HHE.D:
Started
2019-06-13 20:38:42 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KS/JEJB\HHE.D folder: 4
2019-06-13 20:38:42 [INFO] E:\00.msnoise\02.SeimicData\2019/KS/JEJB\HHE.D:
Started
c:\users\jeon\anaconda3\lib\site-packages\pymysql\cursors.py:170: Warning:
(1366, "Incorrect string value: '\\xB4\\xEB\\xC7\\xD1\\xB9\\xCE...' for
column 'VARIABLE_VALUE' at row 1")
result = self._query(query)
c:\users\jeon\anaconda3\lib\site-packages\pymysql\cursors.py:170: Warning:
(1366, "Incorrect string value: '\\xB4\\xEB\\xC7\\xD1\\xB9\\xCE...' for
column 'VARIABLE_VALUE' at row 1")
result = self._query(query)
2019-06-13 20:38:54 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KS/JEJB\HHN.D folder: 3
2019-06-13 20:38:54 [INFO] E:\00.msnoise\02.SeimicData\2019/KS/JEJB\HHN.D:
Started
2019-06-13 20:38:55 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KS/JEJB\HHZ.D folder: 3
2019-06-13 20:38:55 [INFO] E:\00.msnoise\02.SeimicData\2019/KS/JEJB\HHZ.D:
Started
c:\users\jeon\anaconda3\lib\site-packages\pymysql\cursors.py:170: Warning:
(1366, "Incorrect string value: '\\xB4\\xEB\\xC7\\xD1\\xB9\\xCE...' for
column 'VARIABLE_VALUE' at row 1")
result = self._query(query)
c:\users\jeon\anaconda3\lib\site-packages\pymysql\cursors.py:170: Warning:
(1366, "Incorrect string value: '\\xB4\\xEB\\xC7\\xD1\\xB9\\xCE...' for
column 'VARIABLE_VALUE' at row 1")
result = self._query(query)
2019-06-13 20:39:12 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KS/YOCB\HHE.D folder: 1
2019-06-13 20:39:12 [INFO] E:\00.msnoise\02.SeimicData\2019/KS/YOCB\HHE.D:
Started
2019-06-13 20:39:12 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KS/YOCB\HHN.D folder: 1
2019-06-13 20:39:12 [INFO] E:\00.msnoise\02.SeimicData\2019/KS/YOCB\HHN.D:
Started
c:\users\jeon\anaconda3\lib\site-packages\pymysql\cursors.py:170: Warning:
(1366, "Incorrect string value: '\\xB4\\xEB\\xC7\\xD1\\xB9\\xCE...' for
column 'VARIABLE_VALUE' at row 1")
result = self._query(query)
c:\users\jeon\anaconda3\lib\site-packages\pymysql\cursors.py:170: Warning:
(1366, "Incorrect string value: '\\xB4\\xEB\\xC7\\xD1\\xB9\\xCE...' for
column 'VARIABLE_VALUE' at row 1")
result = self._query(query)
2019-06-13 20:39:25 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KS/YOCB\HHZ.D folder: 1
2019-06-13 20:39:25 [INFO] E:\00.msnoise\02.SeimicData\2019/KS/YOCB\HHZ.D:
Started
c:\users\jeon\anaconda3\lib\site-packages\pymysql\cursors.py:170: Warning:
(1366, "Incorrect string value: '\\xB4\\xEB\\xC7\\xD1\\xB9\\xCE...' for
column 'VARIABLE_VALUE' at row 1")
result = self._query(query)
2019-06-13 20:39:34 [INFO] *** Finished: Scan Archive ***
2019-06-13 20:39:34 [INFO] It took 52.61 seconds
PS>msnoise -t 2 scan-archive
c:\users\jeon\anaconda3\lib\site-packages\pymysql\cursors.py:170: Warning:
(1366, "Incorrect string value: '\\xB4\\xEB\\xC7\\xD1\\xB9\\xCE...' for
column 'VARIABLE_VALUE' at row 1")
result = self._query(query)
2019-06-17 21:09:28 [INFO] *** Starting: Scan Archive ***
2019-06-17 21:09:28 [INFO] Will work on 2 thread(s)
2019-06-17 21:09:28 [INFO] Will search for files between 2017-01-01 and
2019-12-30
2019-06-17 21:09:28 [DEBUG] Will search for channels: ['*']
2019-06-17 21:09:28 [DEBUG] Data Folder: E:\00.msnoise\02.SeimicData
2019-06-17 21:09:28 [DEBUG] Folders to glob:
E:\00.msnoise\02.SeimicData\2017/KG/TJN/*.D,E:\00.msnoise\02.SeimicData\2017/KS/JEJB/*.D,E:\00.msnoise\02.SeimicData\2017/KS/YOCB/*.D,E:\00.msnoise\02.SeimicData\2018/KG/TJN/*.D,E:\00.msnoise\02.SeimicData\2018/KS/JEJB/*.D,E:\00.msnoise\02.SeimicData\2018/KS/YOCB/*.D,E:\00.msnoise\02.SeimicData\2019/KG/TJN/*.D,E:\00.msnoise\02.SeimicData\2019/KS/JEJB/*.D,E:\00.msnoise\02.SeimicData\2019/KS/YOCB/*.D
2019-06-17 21:09:28 [DEBUG] Will search for files more recent than
2019-06-16T12:09:28.717502Z
2019-06-17 21:09:28 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KG/TJN\HHE.D folder: 0
2019-06-17 21:09:28 [DEBUG] Will search for files more recent than
2019-06-16T12:09:28.717502Z
2019-06-17 21:09:28 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KS/JEJB\HHE.D folder: 0
2019-06-17 21:09:28 [DEBUG] Will search for files more recent than
2019-06-16T12:09:28.717502Z
2019-06-17 21:09:28 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KS/JEJB\HHN.D folder: 0
2019-06-17 21:09:28 [DEBUG] Will search for files more recent than
2019-06-16T12:09:28.717502Z
2019-06-17 21:09:28 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KS/JEJB\HHZ.D folder: 0
2019-06-17 21:09:28 [DEBUG] Will search for files more recent than
2019-06-16T12:09:28.717502Z
2019-06-17 21:09:28 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KS/YOCB\HHE.D folder: 0
2019-06-17 21:09:28 [DEBUG] Will search for files more recent than
2019-06-16T12:09:28.717502Z
2019-06-17 21:09:28 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KS/YOCB\HHN.D folder: 0
2019-06-17 21:09:28 [DEBUG] Will search for files more recent than
2019-06-16T12:09:28.717502Z
2019-06-17 21:09:28 [DEBUG] Files detected in
E:\00.msnoise\02.SeimicData\2019/KS/YOCB\HHZ.D folder: 0
2019-06-17 21:09:28 [INFO] *** Finished: Scan Archive ***
2019-06-17 21:09:28 [INFO] It took 0.16 seconds
I have don't idea why it do not work.
Please give me a help.
Thank you!
Sincerely,
YoungJun Jeon
