Globaleaks not running after upgrade from 3.4.1 to 3.6.8

donaldjfraser · January 29, 2019, 8:11am

We upgraded Debian from 16.04 to Debian 18.10, and Globaleaks from 3.4.1 and 3.6.8.

The updated Globaleaks installation completed successfully but fails to start.

Extended logs show failure while migrating tables. Our old database and backup is still on version 44.

If the migration fails all the time, how do we roll back to version 3.4.1?

See logs below:

● globaleaks.service - LSB: Start the GlobaLeaks server.
Loaded: loaded (/etc/init.d/globaleaks; generated)
Active: active (exited) since Tue 2019-01-29 07:38:49 UTC; 3min 7s ago
Docs: man:systemd-sysv-generator(8)
Process: 1088 ExecStart=/etc/init.d/globaleaks start (code=exited, status=0/SUCCESS)

Jan 29 07:38:44 ac-globaleaks-01 systemd[1]: Starting LSB: Start the GlobaLeaks server…
Jan 29 07:38:48 ac-globaleaks-01 globaleaks[1088]: * Starting GlobaLeaks daemon globaleaks
Jan 29 07:38:49 ac-globaleaks-01 globaleaks[1088]: …done.
Jan 29 07:38:49 ac-globaleaks-01 systemd[1]: Started LSB: Start the GlobaLeaks server…

root@ac-globaleaks-01:~# curl -vvv localhost:8082

Rebuilt URL to: localhost:8082/
Trying 127.0.0.1…
TCP_NODELAY set
connect to 127.0.0.1 port 8082 failed: Connection refused
Failed to connect to localhost port 8082: Connection refused
Closing connection 0
curl: (7) Failed to connect to localhost port 8082: Connection refused

root@ac-globaleaks-01:~# globaleaks -v
GlobaLeaks version: 3.6.8
Database version: 46

2019-01-29 07:03:33+0000 [-] Loading /usr/lib/python2.7/dist-packages/globaleaks/backend.py…
2019-01-29 07:03:34+0000 [-] Loaded.
2019-01-29 07:03:34+0000 [-] twistd 17.9.0 (/usr/bin/python 2.7.15) starting up.
2019-01-29 07:03:34+0000 [-] reactor class: twisted.internet.epollreactor.EPollReactor.
2019-01-29 07:03:34+0000 [-] /usr/lib/python2.7/dist-packages/sqlalchemy/ext/declarative/clsregistry.py:120: sqlalchemy.exc.SAWarning: This declarative base already contains a class with the same class name and module name as globaleaks.db.migration.y, and will be replaced in the string-lookup table.
2019-01-29 07:03:36+0000 [-] [E] Found an already initialized database version: 44
2019-01-29 07:03:36+0000 [-] [E] Performing schema migration from version 44 to version 46
2019-01-29 07:03:36+0000 [-] [I] Updating DB from version 44 to version 45
2019-01-29 07:03:36+0000 [-] [I] Migrating table:
2019-01-29 07:03:36+0000 [-] * Anomalies [#2706]
2019-01-29 07:03:37+0000 [-] * ArchivedSchema [#3]
2019-01-29 07:03:37+0000 [-] * Comment [#20]
2019-01-29 07:03:37+0000 [-] * Config [#90]
2019-01-29 07:03:37+0000 [-] * ConfigL10N [#73]
2019-01-29 07:03:37+0000 [-] * Context [#8]
2019-01-29 07:03:37+0000 [-] * ContextImg [#7]
2019-01-29 07:03:37+0000 [-] * CustomTexts [#0]
2019-01-29 07:03:37+0000 [-] * EnabledLanguage [#1]
2019-01-29 07:03:37+0000 [-] * Field [#161]
2019-01-29 07:03:37+0000 [-] * FieldAnswer [#185]
2019-01-29 07:03:37+0000 [-] * FieldAnswerGroup [#108]
2019-01-29 07:03:37+0000 [-] ł FieldAttr [#516]
2019-01-29 07:03:37+0000 [-] * FieldOption [#205]
2019-01-29 07:03:37+0000 [-] * File [#2]
2019-01-29 07:03:37+0000 [-] * IdentityAccessRequest [#0]
2019-01-29 07:03:37+0000 [-] * InternalFile [#51]
2019-01-29 07:03:37+0000 [-] * InternalTip [#9]
2019-01-29 07:03:37+0000 [-] * Mail [#0]
2019-01-29 07:03:37+0000 [-] * Message [#0]
2019-01-29 07:03:37+0000 [-] * Questionnaire [#9]
2019-01-29 07:03:37+0000 [-] * Receiver [#14]
2019-01-29 07:03:37+0000 [-] * ReceiverContext [#14]
2019-01-29 07:03:37+0000 [-] * ReceiverFile [#167]
2019-01-29 07:03:37+0000 [-] * ReceiverTip [#21]
2019-01-29 07:03:37+0000 [-] * SecureFileDelete [#1]
2019-01-29 07:03:37+0000 [-] * SubmissionStatus [#3]
2019-01-29 07:03:37+0000 [-] * SubmissionSubStatus [#0]
2019-01-29 07:03:37+0000 [-] * SubmissionStatusChange [#8]
2019-01-29 07:03:37+0000 [-] * ShortURL [#0]
2019-01-29 07:03:37+0000 [-] * Signup [#0]
2019-01-29 07:03:37+0000 [-] * Stats [#10]
2019-01-29 07:03:37+0000 [-] * Step [#10]
2019-01-29 07:03:37+0000 [-] * Tenant [#1]
2019-01-29 07:03:37+0000 [-] ł User [#18]
2019-01-29 07:03:38+0000 [-] * UserImg [#2]
2019-01-29 07:03:38+0000 [-] * UserTenant [#18]
2019-01-29 07:03:38+0000 [-] * WhistleblowerFile [#188]
2019-01-29 07:03:38+0000 [-] [E] Failure while migrating table WhistleblowerFile: (sqlite3.IntegrityError) UNIQUE constraint failed: whistleblowerfile.filename [SQL: u’INSERT INTO whistleblowerfile (id, receivertip_id, name, filename, size, content_type, downloads, creation_date, last_access, description, new) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)’] [parameters: ((u’8f6f980f-9589-4ddc-91da-624be0cfcea0’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 1.pdf’, u’g6CLZ3XRtaRZIY1l.plain’, 158864, u’application/pdf’, 0, ‘2019-01-23 09:27:49.867779’, ‘1970-01-01 00:00:00.000000’, u’Email 1’, 1), (u’52ffb8c6-6f07-4ef7-9467-7ce602f65da9’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 1 - Annexure A .jpg’, u’EenyAJBjQdGseRhL.plain’, 143923, u’image/jpeg’, 0, ‘2019-01-23 09:29:38.514923’, ‘1970-01-01 00:00:00.000000’, u’Email 1 - Annexure A’, 1), (u’c45c71f8-15cc-48fb-8093-d04e65886743’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 2.pdf’, u’Y4eQ6OCdkPRLkgxp.plain’, 173071, u’application/pdf’, 0, ‘2019-01-23 09:30:02.831072’, ‘1970-01-01 00:00:00.000000’, u’Email 2’, 1), (u’9dc156f5-3a18-4581-80bf-46e5ece1e218’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3.pdf’, u’pNSyRxgTTfACQRv3.plain’, 163389, u’application/pdf’, 0, ‘2019-01-23 09:30:23.614091’, ‘1970-01-01 00:00:00.000000’, u’Email 3’, 1), (u’860f24be-4bd4-4268-8b2a-14b9ed5d8d74’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure A.pdf’, u’xZdMXEYFBxhRlb52.plain’, 114555, u’application/pdf’, 0, ‘2019-01-23 09:30:36.484355’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure A’, 1), (u’1d635638-8bd5-4275-85ee-2f90f2346ec3’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure B.pdf’, u’JL3ypF237Dnq8RUH.plain’, 143824, u’application/pdf’, 0, ‘2019-01-23 09:30:50.932228’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure B’, 1), (u’af928c72-48a8-42fe-a4a9-ea1355a25c9d’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure C.pdf’, u’BCrdtIl0zhaC2B0q.plain’, 1412058, u’application/pdf’, 0, ‘2019-01-23 09:31:23.355521’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure C’, 1), (u’21a068ad-dc90-49e3-aa2c-e56f762cf270’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure C.pdf’, u’BCrdtIl0zhaC2B0q.plain’, 1412058, u’application/pdf’, 0, ‘2019-01-23 09:31:24.410222’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure C’, 1) … displaying 10 of 188 total bound parameter sets … (u’a6c2a7a3-151b-4c2b-8b4b-bedb3e3bc052’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 60 - Annexure D.doc’, u’kN34HR8leRpRSngx.plain’, 69632, u’application/msword’, 0, ‘2019-01-28 06:59:16.014034’, ‘1970-01-01 00:00:00.000000’, u’Email 60 - Annexure D’, 1), (u’27e7531f-def7-40d8-bfca-f8b94a3d4050’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 61.pdf’, u’iCyf2btMB46fpLxJ.plain’, 165873, u’application/pdf’, 0, ‘2019-01-28 08:29:56.930502’, ‘1970-01-01 00:00:00.000000’, u’Email 61’, 1))]
2019-01-29 07:03:38+0000 [-] [E] Migration failure: (sqlite3.IntegrityError) UNIQUE constraint failed: whistleblowerfile.filename [SQL: u’INSERT INTO whistleblowerfile (id, receivertip_id, name, filename, size, content_type, downloads, creation_date, last_access, description, new) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)’] [parameters: ((u’8f6f980f-9589-4ddc-91da-624be0cfcea0’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 1.pdf’, u’g6CLZ3XRtaRZIY1l.plain’, 158864, u’application/pdf’, 0, ‘2019-01-23 09:27:49.867779’, ‘1970-01-01 00:00:00.000000’, u’Email 1’, 1), (u’52ffb8c6-6f07-4ef7-9467-7ce602f65da9’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 1 - Annexure A .jpg’, u’EenyAJBjQdGseRhL.plain’, 143923, u’image/jpeg’, 0, ‘2019-01-23 09:29:38.514923’, ‘1970-01-01 00:00:00.000000’, u’Email 1 - Annexure A’, 1), (u’c45c71f8-15cc-48fb-8093-d04e65886743’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 2.pdf’, u’Y4eQ6OCdkPRLkgxp.plain’, 173071, u’application/pdf’, 0, ‘2019-01-23 09:30:02.831072’, ‘1970-01-01 00:00:00.000000’, u’Email 2’, 1), (u’9dc156f5-3a18-4581-80bf-46e5ece1e218’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3.pdf’, u’pNSyRxgTTfACQRv3.plain’, 163389, u’application/pdf’, 0, ‘2019-01-23 09:30:23.614091’, ‘1970-01-01 00:00:00.000000’, u’Email 3’, 1), (u’860f24be-4bd4-4268-8b2a-14b9ed5d8d74’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure A.pdf’, u’xZdMXEYFBxhRlb52.plain’, 114555, u’application/pdf’, 0, ‘2019-01-23 09:30:36.484355’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure A’, 1), (u’1d635638-8bd5-4275-85ee-2f90f2346ec3’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure B.pdf’, u’JL3ypF237Dnq8RUH.plain’, 143824, u’application/pdf’, 0, ‘2019-01-23 09:30:50.932228’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure B’, 1), (u’af928c72-48a8-42fe-a4a9-ea1355a25c9d’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure C.pdf’, u’BCrdtIl0zhaC2B0q.plain’, 1412058, u’application/pdf’, 0, ‘2019-01-23 09:31:23.355521’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure C’, 1), (u’21a068ad-dc90-49e3-aa2c-e56f762cf270’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure C.pdf’, u’BCrdtIl0zhaC2B0q.plain’, 1412058, u’application/pdf’, 0, ‘2019-01-23 09:31:24.410222’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure C’, 1) … displaying 10 of 188 total bound parameter sets … (u’a6c2a7a3-151b-4c2b-8b4b-bedb3e3bc052’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 60 - Annexure D.doc’, u’kN34HR8leRpRSngx.plain’, 69632, u’application/msword’, 0, ‘2019-01-28 06:59:16.014034’, ‘1970-01-01 00:00:00.000000’, u’Email 60 - Annexure D’, 1), (u’27e7531f-def7-40d8-bfca-f8b94a3d4050’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 61.pdf’, u’iCyf2btMB46fpLxJ.plain’, 165873, u’application/pdf’, 0, ‘2019-01-28 08:29:56.930502’, ‘1970-01-01 00:00:00.000000’, u’Email 61’, 1))]
2019-01-29 07:03:38+0000 [-] [E] Verbose exception traceback:
2019-01-29 07:03:38+0000 [-] [I] Traceback (most recent call last):\n\n File “/usr/lib/python2.7/dist-packages/globaleaks/db/init.py”, line 81, in update_db\n migration.perform_migration(db_version)\n\n File “/usr/lib/python2.7/dist-packages/globaleaks/db/migration.py”, line 233, in perform_migration\n raise exception\n\nIntegrityError: (sqlite3.IntegrityError) UNIQUE constraint failed: whistleblowerfile.filename [SQL: u’INSERT INTO whistleblowerfile (id, receivertip_id, name, filename, size, content_type, downloads, creation_date, last_access, description, new) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)’] [parameters: ((u’8f6f980f-9589-4ddc-91da-624be0cfcea0’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 1.pdf’, u’g6CLZ3XRtaRZIY1l.plain’, 158864, u’application/pdf’, 0, ‘2019-01-23 09:27:49.867779’, ‘1970-01-01 00:00:00.000000’, u’Email 1’, 1), (u’52ffb8c6-6f07-4ef7-9467-7ce602f65da9’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 1 - Annexure A .jpg’, u’EenyAJBjQdGseRhL.plain’, 143923, u’image/jpeg’, 0, ‘2019-01-23 09:29:38.514923’, ‘1970-01-01 00:00:00.000000’, u’Email 1 - Annexure A’, 1), (u’c45c71f8-15cc-48fb-8093-d04e65886743’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 2.pdf’, u’Y4eQ6OCdkPRLkgxp.plain’, 173071, u’application/pdf’, 0, ‘2019-01-23 09:30:02.831072’, ‘1970-01-01 00:00:00.000000’, u’Email 2’, 1), (u’9dc156f5-3a18-4581-80bf-46e5ece1e218’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3.pdf’, u’pNSyRxgTTfACQRv3.plain’, 163389, u’application/pdf’, 0, ‘2019-01-23 09:30:23.614091’, ‘1970-01-01 00:00:00.000000’, u’Email 3’, 1), (u’860f24be-4bd4-4268-8b2a-14b9ed5d8d74’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure A.pdf’, u’xZdMXEYFBxhRlb52.plain’, 114555, u’application/pdf’, 0, ‘2019-01-23 09:30:36.484355’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure A’, 1), (u’1d635638-8bd5-4275-85ee-2f90f2346ec3’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure B.pdf’, u’JL3ypF237Dnq8RUH.plain’, 143824, u’application/pdf’, 0, ‘2019-01-23 09:30:50.932228’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure B’, 1), (u’af928c72-48a8-42fe-a4a9-ea1355a25c9d’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure C.pdf’, u’BCrdtIl0zhaC2B0q.plain’, 1412058, u’application/pdf’, 0, ‘2019-01-23 09:31:23.355521’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure C’, 1), (u’21a068ad-dc90-49e3-aa2c-e56f762cf270’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure C.pdf’, u’BCrdtIl0zhaC2B0q.plain’, 1412058, u’application/pdf’, 0, ‘2019-01-23 09:31:24.410222’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure C’, 1) … displaying 10 of 188 total bound parameter sets … (u’a6c2a7a3-151b-4c2b-8b4b-bedb3e3bc052’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 60 - Annexure D.doc’, u’kN34HR8leRpRSngx.plain’, 69632, u’application/msword’, 0, ‘2019-01-28 06:59:16.014034’, ‘1970-01-01 00:00:00.000000’, u’Email 60 - Annexure D’, 1), (u’27e7531f-def7-40d8-bfca-f8b94a3d4050’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 61.pdf’, u’iCyf2btMB46fpLxJ.plain’, 165873, u’application/pdf’, 0, ‘2019-01-28 08:29:56.930502’, ‘1970-01-01 00:00:00.000000’, u’Email 61’, 1))]\n
2019-01-29 07:03:38+0000 [-] Main loop terminated.
2019-01-29 07:03:38+0000 [-] Server Shut Down.
2019-01-29 07:03:38+0000 [-] Exiting GlobaLeaks

evilaliv3 · January 29, 2019, 8:24am

Thank you for reporting this @donaldjfraser

Let me check on the inconvenience and get back to you.

In the meantime just stop globaleaks, and as soon that we will identify the issue even by today you will first update to a 3.6.9 and then globaleaks will be restarted automatically with the update.

evilaliv3 · January 29, 2019, 10:05am

Dear @donaldjfraser,

your issue has been solved with commit https://github.com/globaleaks/GlobaLeaks/commit/962eec35d9528703a4d47bf533cfdf3ba7e53bb4 that is now part of release 3.6.9.

I invite you to update and get back here in case of errors.

best,

Giovanni Pellerano

donaldjfraser · January 29, 2019, 10:37am

Good day,

Thank you for the response. I have updated to 3.6.9, and we are still getting the error:

root@ac-globaleaks-01:~# globaleaks -v
GlobaLeaks version: 3.6.9
Database version: 46

Log file:

2019-01-29 10:28:26+0000 [-] Loading /usr/lib/python2.7/dist-packages/globaleaks/backend.py…
2019-01-29 10:28:26+0000 [-] Loaded.
2019-01-29 10:28:26+0000 [-] twistd 17.9.0 (/usr/bin/python 2.7.15) starting up.
2019-01-29 10:28:26+0000 [-] reactor class: twisted.internet.epollreactor.EPollReactor.
2019-01-29 10:28:26+0000 [-] /usr/lib/python2.7/dist-packages/sqlalchemy/ext/declarative/clsregistry.py:120: sqlalchemy.exc.SAWarning: This declarative base already contains a class with the same class name and module name as globaleaks.db.migration.y, and will be replaced in the string-lookup table.
2019-01-29 10:28:28+0000 [-] [E] Found an already initialized database version: 44
2019-01-29 10:28:28+0000 [-] [E] Performing schema migration from version 44 to version 46
2019-01-29 10:28:28+0000 [-] [I] Updating DB from version 44 to version 45
2019-01-29 10:28:29+0000 [-] [I] Migrating table:
2019-01-29 10:28:29+0000 [-] * Anomalies [#2706]
2019-01-29 10:28:29+0000 [-] * ArchivedSchema [#3]
2019-01-29 10:28:29+0000 [-] * Comment [#20]
2019-01-29 10:28:29+0000 [-] * Config [#90]
2019-01-29 10:28:29+0000 [-] * ConfigL10N [#73]
2019-01-29 10:28:29+0000 [-] * Context [#8]
2019-01-29 10:28:29+0000 [-] * ContextImg [#7]
2019-01-29 10:28:29+0000 [-] * CustomTexts [#0]
2019-01-29 10:28:29+0000 [-] * EnabledLanguage [#1]
2019-01-29 10:28:30+0000 [-] * Field [#161]
2019-01-29 10:28:30+0000 [-] * FieldAnswer [#185]
2019-01-29 10:28:30+0000 [-] * FieldAnswerGroup [#108]
2019-01-29 10:28:30+0000 [-] ł FieldAttr [#516]
2019-01-29 10:28:30+0000 [-] * FieldOption [#205]
2019-01-29 10:28:30+0000 [-] * File [#2]
2019-01-29 10:28:30+0000 [-] * IdentityAccessRequest [#0]
2019-01-29 10:28:30+0000 [-] * InternalFile [#51]
2019-01-29 10:28:30+0000 [-] * InternalTip [#9]
2019-01-29 10:28:30+0000 [-] * Mail [#0]
2019-01-29 10:28:30+0000 [-] * Message [#0]
2019-01-29 10:28:30+0000 [-] * Questionnaire [#9]
2019-01-29 10:28:30+0000 [-] * Receiver [#14]
2019-01-29 10:28:30+0000 [-] * ReceiverContext [#14]
2019-01-29 10:28:30+0000 [-] * ReceiverFile [#167]
2019-01-29 10:28:30+0000 [-] * ReceiverTip [#21]
2019-01-29 10:28:30+0000 [-] * SecureFileDelete [#1]
2019-01-29 10:28:30+0000 [-] * SubmissionStatus [#3]
2019-01-29 10:28:30+0000 [-] * SubmissionSubStatus [#0]
2019-01-29 10:28:30+0000 [-] * SubmissionStatusChange [#8]
2019-01-29 10:28:30+0000 [-] * ShortURL [#0]
2019-01-29 10:28:30+0000 [-] * Signup [#0]
2019-01-29 10:28:30+0000 [-] * Stats [#10]
2019-01-29 10:28:30+0000 [-] * Step [#10]
2019-01-29 10:28:30+0000 [-] * Tenant [#1]
2019-01-29 10:28:30+0000 [-] ł User [#18]
2019-01-29 10:28:30+0000 [-] * UserImg [#2]
2019-01-29 10:28:30+0000 [-] * UserTenant [#18]
2019-01-29 10:28:30+0000 [-] * WhistleblowerFile [#188]
2019-01-29 10:28:30+0000 [-] [E] Failure while migrating table WhistleblowerFile: (sqlite3.IntegrityError) UNIQUE constraint failed: whistleblowerfile.filename [SQL: u’INSERT INTO whistleblowerfile (id, receivertip_id, name, filename, size, content_type, downloads, creation_date, last_access, description, new) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)’] [parameters: ((u’8f6f980f-9589-4ddc-91da-624be0cfcea0’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 1.pdf’, u’g6CLZ3XRtaRZIY1l.plain’, 158864, u’application/pdf’, 0, ‘2019-01-23 09:27:49.867779’, ‘1970-01-01 00:00:00.000000’, u’Email 1’, 1), (u’52ffb8c6-6f07-4ef7-9467-7ce602f65da9’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 1 - Annexure A .jpg’, u’EenyAJBjQdGseRhL.plain’, 143923, u’image/jpeg’, 0, ‘2019-01-23 09:29:38.514923’, ‘1970-01-01 00:00:00.000000’, u’Email 1 - Annexure A’, 1), (u’c45c71f8-15cc-48fb-8093-d04e65886743’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 2.pdf’, u’Y4eQ6OCdkPRLkgxp.plain’, 173071, u’application/pdf’, 0, ‘2019-01-23 09:30:02.831072’, ‘1970-01-01 00:00:00.000000’, u’Email 2’, 1), (u’9dc156f5-3a18-4581-80bf-46e5ece1e218’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3.pdf’, u’pNSyRxgTTfACQRv3.plain’, 163389, u’application/pdf’, 0, ‘2019-01-23 09:30:23.614091’, ‘1970-01-01 00:00:00.000000’, u’Email 3’, 1), (u’860f24be-4bd4-4268-8b2a-14b9ed5d8d74’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure A.pdf’, u’xZdMXEYFBxhRlb52.plain’, 114555, u’application/pdf’, 0, ‘2019-01-23 09:30:36.484355’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure A’, 1), (u’1d635638-8bd5-4275-85ee-2f90f2346ec3’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure B.pdf’, u’JL3ypF237Dnq8RUH.plain’, 143824, u’application/pdf’, 0, ‘2019-01-23 09:30:50.932228’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure B’, 1), (u’af928c72-48a8-42fe-a4a9-ea1355a25c9d’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure C.pdf’, u’BCrdtIl0zhaC2B0q.plain’, 1412058, u’application/pdf’, 0, ‘2019-01-23 09:31:23.355521’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure C’, 1), (u’21a068ad-dc90-49e3-aa2c-e56f762cf270’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure C.pdf’, u’BCrdtIl0zhaC2B0q.plain’, 1412058, u’application/pdf’, 0, ‘2019-01-23 09:31:24.410222’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure C’, 1) … displaying 10 of 188 total bound parameter sets … (u’a6c2a7a3-151b-4c2b-8b4b-bedb3e3bc052’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 60 - Annexure D.doc’, u’kN34HR8leRpRSngx.plain’, 69632, u’application/msword’, 0, ‘2019-01-28 06:59:16.014034’, ‘1970-01-01 00:00:00.000000’, u’Email 60 - Annexure D’, 1), (u’27e7531f-def7-40d8-bfca-f8b94a3d4050’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 61.pdf’, u’iCyf2btMB46fpLxJ.plain’, 165873, u’application/pdf’, 0, ‘2019-01-28 08:29:56.930502’, ‘1970-01-01 00:00:00.000000’, u’Email 61’, 1))]
2019-01-29 10:28:30+0000 [-] [E] Migration failure: (sqlite3.IntegrityError) UNIQUE constraint failed: whistleblowerfile.filename [SQL: u’INSERT INTO whistleblowerfile (id, receivertip_id, name, filename, size, content_type, downloads, creation_date, last_access, description, new) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)’] [parameters: ((u’8f6f980f-9589-4ddc-91da-624be0cfcea0’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 1.pdf’, u’g6CLZ3XRtaRZIY1l.plain’, 158864, u’application/pdf’, 0, ‘2019-01-23 09:27:49.867779’, ‘1970-01-01 00:00:00.000000’, u’Email 1’, 1), (u’52ffb8c6-6f07-4ef7-9467-7ce602f65da9’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 1 - Annexure A .jpg’, u’EenyAJBjQdGseRhL.plain’, 143923, u’image/jpeg’, 0, ‘2019-01-23 09:29:38.514923’, ‘1970-01-01 00:00:00.000000’, u’Email 1 - Annexure A’, 1), (u’c45c71f8-15cc-48fb-8093-d04e65886743’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 2.pdf’, u’Y4eQ6OCdkPRLkgxp.plain’, 173071, u’application/pdf’, 0, ‘2019-01-23 09:30:02.831072’, ‘1970-01-01 00:00:00.000000’, u’Email 2’, 1), (u’9dc156f5-3a18-4581-80bf-46e5ece1e218’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3.pdf’, u’pNSyRxgTTfACQRv3.plain’, 163389, u’application/pdf’, 0, ‘2019-01-23 09:30:23.614091’, ‘1970-01-01 00:00:00.000000’, u’Email 3’, 1), (u’860f24be-4bd4-4268-8b2a-14b9ed5d8d74’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure A.pdf’, u’xZdMXEYFBxhRlb52.plain’, 114555, u’application/pdf’, 0, ‘2019-01-23 09:30:36.484355’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure A’, 1), (u’1d635638-8bd5-4275-85ee-2f90f2346ec3’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure B.pdf’, u’JL3ypF237Dnq8RUH.plain’, 143824, u’application/pdf’, 0, ‘2019-01-23 09:30:50.932228’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure B’, 1), (u’af928c72-48a8-42fe-a4a9-ea1355a25c9d’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure C.pdf’, u’BCrdtIl0zhaC2B0q.plain’, 1412058, u’application/pdf’, 0, ‘2019-01-23 09:31:23.355521’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure C’, 1), (u’21a068ad-dc90-49e3-aa2c-e56f762cf270’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure C.pdf’, u’BCrdtIl0zhaC2B0q.plain’, 1412058, u’application/pdf’, 0, ‘2019-01-23 09:31:24.410222’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure C’, 1) … displaying 10 of 188 total bound parameter sets … (u’a6c2a7a3-151b-4c2b-8b4b-bedb3e3bc052’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 60 - Annexure D.doc’, u’kN34HR8leRpRSngx.plain’, 69632, u’application/msword’, 0, ‘2019-01-28 06:59:16.014034’, ‘1970-01-01 00:00:00.000000’, u’Email 60 - Annexure D’, 1), (u’27e7531f-def7-40d8-bfca-f8b94a3d4050’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 61.pdf’, u’iCyf2btMB46fpLxJ.plain’, 165873, u’application/pdf’, 0, ‘2019-01-28 08:29:56.930502’, ‘1970-01-01 00:00:00.000000’, u’Email 61’, 1))]
2019-01-29 10:28:30+0000 [-] [E] Verbose exception traceback:
2019-01-29 10:28:30+0000 [-] [I] Traceback (most recent call last):\n\n File “/usr/lib/python2.7/dist-packages/globaleaks/db/init.py”, line 81, in update_db\n migration.perform_migration(db_version)\n\n File “/usr/lib/python2.7/dist-packages/globaleaks/db/migration.py”, line 233, in perform_migration\n raise exception\n\nIntegrityError: (sqlite3.IntegrityError) UNIQUE constraint failed: whistleblowerfile.filename [SQL: u’INSERT INTO whistleblowerfile (id, receivertip_id, name, filename, size, content_type, downloads, creation_date, last_access, description, new) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)’] [parameters: ((u’8f6f980f-9589-4ddc-91da-624be0cfcea0’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 1.pdf’, u’g6CLZ3XRtaRZIY1l.plain’, 158864, u’application/pdf’, 0, ‘2019-01-23 09:27:49.867779’, ‘1970-01-01 00:00:00.000000’, u’Email 1’, 1), (u’52ffb8c6-6f07-4ef7-9467-7ce602f65da9’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 1 - Annexure A .jpg’, u’EenyAJBjQdGseRhL.plain’, 143923, u’image/jpeg’, 0, ‘2019-01-23 09:29:38.514923’, ‘1970-01-01 00:00:00.000000’, u’Email 1 - Annexure A’, 1), (u’c45c71f8-15cc-48fb-8093-d04e65886743’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 2.pdf’, u’Y4eQ6OCdkPRLkgxp.plain’, 173071, u’application/pdf’, 0, ‘2019-01-23 09:30:02.831072’, ‘1970-01-01 00:00:00.000000’, u’Email 2’, 1), (u’9dc156f5-3a18-4581-80bf-46e5ece1e218’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3.pdf’, u’pNSyRxgTTfACQRv3.plain’, 163389, u’application/pdf’, 0, ‘2019-01-23 09:30:23.614091’, ‘1970-01-01 00:00:00.000000’, u’Email 3’, 1), (u’860f24be-4bd4-4268-8b2a-14b9ed5d8d74’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure A.pdf’, u’xZdMXEYFBxhRlb52.plain’, 114555, u’application/pdf’, 0, ‘2019-01-23 09:30:36.484355’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure A’, 1), (u’1d635638-8bd5-4275-85ee-2f90f2346ec3’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure B.pdf’, u’JL3ypF237Dnq8RUH.plain’, 143824, u’application/pdf’, 0, ‘2019-01-23 09:30:50.932228’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure B’, 1), (u’af928c72-48a8-42fe-a4a9-ea1355a25c9d’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure C.pdf’, u’BCrdtIl0zhaC2B0q.plain’, 1412058, u’application/pdf’, 0, ‘2019-01-23 09:31:23.355521’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure C’, 1), (u’21a068ad-dc90-49e3-aa2c-e56f762cf270’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 3 - Annexure C.pdf’, u’BCrdtIl0zhaC2B0q.plain’, 1412058, u’application/pdf’, 0, ‘2019-01-23 09:31:24.410222’, ‘1970-01-01 00:00:00.000000’, u’Email 3 - Annexure C’, 1) … displaying 10 of 188 total bound parameter sets … (u’a6c2a7a3-151b-4c2b-8b4b-bedb3e3bc052’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 60 - Annexure D.doc’, u’kN34HR8leRpRSngx.plain’, 69632, u’application/msword’, 0, ‘2019-01-28 06:59:16.014034’, ‘1970-01-01 00:00:00.000000’, u’Email 60 - Annexure D’, 1), (u’27e7531f-def7-40d8-bfca-f8b94a3d4050’, u’31e868b0-43f9-464d-a7c0-bc521ee17939’, u’Email 61.pdf’, u’iCyf2btMB46fpLxJ.plain’, 165873, u’application/pdf’, 0, ‘2019-01-28 08:29:56.930502’, ‘1970-01-01 00:00:00.000000’, u’Email 61’, 1))]\n
2019-01-29 10:28:30+0000 [-] Main loop terminated.
2019-01-29 10:28:30+0000 [-] Server Shut Down.
2019-01-29 10:28:30+0000 [-] Exiting GlobaLeaks

evilaliv3 · January 29, 2019, 10:38am

Thank you @donaldjfraser, let me check again and get back to you.

evilaliv3 · January 29, 2019, 11:52am

@donaldjfraser: i’ve applied the same fix for the migration 45.

Would you please try to update to the version 3.6.10?

donaldjfraser · January 29, 2019, 12:55pm

Thank you very much for the response and the solution. Upgrade to 3.6.10 was successful and Globaleaks is now running again on our server. We can view and capture records again.

I do see some errors on the log files related to the DB records migration, so I am including that so that you can see it for completeness should it be something that needs attention for a future commit:

The errors are:

2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/vq3CyNVCUi1LBiSQ.plain: ‘NoneType’ object has no attribute ‘open’

See log below:

2019-01-29 11:59:50+0000 [-] Loading /usr/lib/python2.7/dist-packages/globaleaks/backend.py…
2019-01-29 11:59:50+0000 [-] Loaded.
2019-01-29 11:59:50+0000 [-] twistd 17.9.0 (/usr/bin/python 2.7.15) starting up.
2019-01-29 11:59:50+0000 [-] reactor class: twisted.internet.epollreactor.EPollReactor.
2019-01-29 11:59:50+0000 [-] /usr/lib/python2.7/dist-packages/sqlalchemy/ext/declarative/clsregistry.py:120: sqlalchemy.exc.SAWarning: This declarative base already contains a class with the same class name and module name as globaleaks.db.migration.y, and will be replaced in the string-lookup table.
2019-01-29 11:59:53+0000 [-] [E] Found an already initialized database version: 44
2019-01-29 11:59:53+0000 [-] [E] Performing schema migration from version 44 to version 46
2019-01-29 11:59:53+0000 [-] [I] Updating DB from version 44 to version 45
2019-01-29 11:59:54+0000 [-] [I] Migrating table:
2019-01-29 11:59:54+0000 [-] * Anomalies [#2706]
2019-01-29 11:59:55+0000 [-] * ArchivedSchema [#3]
2019-01-29 11:59:55+0000 [-] * Comment [#20]
2019-01-29 11:59:55+0000 [-] * Config [#90]
2019-01-29 11:59:55+0000 [-] * ConfigL10N [#73]
2019-01-29 11:59:55+0000 [-] * Context [#8]
2019-01-29 11:59:55+0000 [-] * ContextImg [#7]
2019-01-29 11:59:55+0000 [-] * CustomTexts [#0]
2019-01-29 11:59:55+0000 [-] * EnabledLanguage [#1]
2019-01-29 11:59:55+0000 [-] * Field [#161]
2019-01-29 11:59:55+0000 [-] * FieldAnswer [#185]
2019-01-29 11:59:55+0000 [-] * FieldAnswerGroup [#108]
2019-01-29 11:59:55+0000 [-] ł FieldAttr [#516]
2019-01-29 11:59:55+0000 [-] * FieldOption [#205]
2019-01-29 11:59:55+0000 [-] * File [#2]
2019-01-29 11:59:55+0000 [-] * IdentityAccessRequest [#0]
2019-01-29 11:59:55+0000 [-] * InternalFile [#51]
2019-01-29 11:59:55+0000 [-] * InternalTip [#9]
2019-01-29 11:59:55+0000 [-] * Mail [#0]
2019-01-29 11:59:55+0000 [-] * Message [#0]
2019-01-29 11:59:55+0000 [-] * Questionnaire [#9]
2019-01-29 11:59:55+0000 [-] * Receiver [#14]
2019-01-29 11:59:55+0000 [-] * ReceiverContext [#14]
2019-01-29 11:59:55+0000 [-] * ReceiverFile [#167]
2019-01-29 11:59:55+0000 [-] * ReceiverTip [#21]
2019-01-29 11:59:55+0000 [-] * SecureFileDelete [#1]
2019-01-29 11:59:55+0000 [-] * SubmissionStatus [#3]
2019-01-29 11:59:55+0000 [-] * SubmissionSubStatus [#0]
2019-01-29 11:59:55+0000 [-] * SubmissionStatusChange [#8]
2019-01-29 11:59:55+0000 [-] * ShortURL [#0]
2019-01-29 11:59:55+0000 [-] * Signup [#0]
2019-01-29 11:59:55+0000 [-] * Stats [#10]
2019-01-29 11:59:55+0000 [-] * Step [#10]
2019-01-29 11:59:55+0000 [-] * Tenant [#1]
2019-01-29 11:59:55+0000 [-] ł User [#18]
2019-01-29 11:59:55+0000 [-] * UserImg [#2]
2019-01-29 11:59:55+0000 [-] * UserTenant [#18]
2019-01-29 11:59:55+0000 [-] * WhistleblowerFile [#188]
2019-01-29 11:59:55+0000 [-] ł WhistleblowerTip [#9]
2019-01-29 11:59:55+0000 [-] [I] Migration stats:
2019-01-29 11:59:55+0000 [-] [I] * Anomalies table migrated (2706 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * ArchivedSchema table migrated (3 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * Comment table migrated (20 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * Config table migrated (90 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * ConfigL10N table migrated (73 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * Context table migrated (8 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * ContextImg table migrated (7 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * CustomTexts table migrated (0 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * EnabledLanguage table migrated (1 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * Field table migrated (161 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * FieldAnswer table migrated (185 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * FieldAnswerGroup table migrated (108 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * FieldAttr table migrated (516 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * FieldOption table migrated (205 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * File table migrated (2 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * IdentityAccessRequest table migrated (0 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * InternalFile table migrated (51 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * InternalTip table migrated (9 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * Mail table migrated (0 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * Message table migrated (0 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * Questionnaire table migrated (9 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * Receiver table migrated (14 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * ReceiverContext table migrated (14 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * ReceiverFile table migrated (167 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * ReceiverTip table migrated (21 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * SecureFileDelete table migrated (1 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * SubmissionStatus table migrated (3 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * SubmissionSubStatus table migrated (0 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * SubmissionStatusChange table migrated (8 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * ShortURL table migrated (0 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * Signup table migrated (0 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * Stats table migrated (10 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * Step table migrated (10 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * Tenant table migrated (1 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * User table migrated (18 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * UserImg table migrated (2 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * UserTenant table migrated (18 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * WhistleblowerFile table migrated (188 entry(s))
2019-01-29 11:59:55+0000 [-] [I] * WhistleblowerTip table migrated (9 entry(s))
2019-01-29 11:59:55+0000 [-] [I] Updating DB from version 45 to version 46
2019-01-29 11:59:56+0000 [-] [I] Migrating table:
2019-01-29 11:59:56+0000 [-] * Anomalies [#2706]
2019-01-29 11:59:56+0000 [-] * ArchivedSchema [#3]
2019-01-29 11:59:56+0000 [-] * Comment [#20]
2019-01-29 11:59:56+0000 [-] ł Config [#90]
2019-01-29 11:59:56+0000 [-] ł ConfigL10N [#73]
2019-01-29 11:59:56+0000 [-] ł Context [#8]
2019-01-29 11:59:56+0000 [-] * ContextImg [#7]
2019-01-29 11:59:56+0000 [-] * CustomTexts [#0]
2019-01-29 11:59:56+0000 [-] * EnabledLanguage [#1]
2019-01-29 11:59:56+0000 [-] ł Field [#161]
2019-01-29 11:59:56+0000 [-] * FieldAnswer [#185]
2019-01-29 11:59:56+0000 [-] * FieldAnswerGroup [#108]
2019-01-29 11:59:56+0000 [-] * FieldAttr [#516]
2019-01-29 11:59:56+0000 [-] ł FieldOption [#205]
2019-01-29 11:59:57+0000 [-] * File [#2]
2019-01-29 11:59:57+0000 [-] * IdentityAccessRequest [#0]
2019-01-29 11:59:57+0000 [-] ł InternalFile [#51]
2019-01-29 11:59:57+0000 [-] ł InternalTip [#9]
2019-01-29 11:59:57+0000 [-] * InternalTipAnswers [#9]
2019-01-29 11:59:57+0000 [-] * InternalTipData [#0]
2019-01-29 11:59:57+0000 [-] * Mail [#0]
2019-01-29 11:59:57+0000 [-] * Message [#0]
2019-01-29 11:59:57+0000 [-] * Questionnaire [#9]
2019-01-29 11:59:57+0000 [-] * ReceiverContext [#14]
2019-01-29 11:59:57+0000 [-] * ReceiverFile [#167]
2019-01-29 11:59:57+0000 [-] * ReceiverTip [#21]
2019-01-29 11:59:57+0000 [-] * SecureFileDelete [#1]
2019-01-29 11:59:57+0000 [-] * SubmissionStatus [#3]
2019-01-29 11:59:57+0000 [-] * SubmissionSubStatus [#0]
2019-01-29 11:59:57+0000 [-] * SubmissionStatusChange [#8]
2019-01-29 11:59:57+0000 [-] * ShortURL [#0]
2019-01-29 11:59:57+0000 [-] * Signup [#0]
2019-01-29 11:59:57+0000 [-] * Stats [#10]
2019-01-29 11:59:57+0000 [-] * Step [#10]
2019-01-29 11:59:57+0000 [-] * Tenant [#1]
2019-01-29 11:59:57+0000 [-] ł User [#18]
2019-01-29 11:59:57+0000 [-] * UserImg [#2]
2019-01-29 11:59:57+0000 [-] * UserTenant [#18]
2019-01-29 11:59:57+0000 [-] ł WhistleblowerFile [#188]
2019-01-29 11:59:57+0000 [-] * WhistleblowerTip [#9]
2019-01-29 11:59:57+0000 [-] [I] Migration stats:
2019-01-29 11:59:57+0000 [-] [I] * Anomalies table migrated (2706 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * ArchivedSchema table migrated (3 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * Comment table migrated (20 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * Config table migrated (96 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * ConfigL10N table migrated (73 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * Context table migrated (8 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * ContextImg table migrated (7 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * CustomTexts table migrated (0 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * EnabledLanguage table migrated (1 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * Field table migrated (161 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * FieldAnswer table migrated (185 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * FieldAnswerGroup table migrated (108 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * FieldAttr table migrated (516 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * FieldOption table migrated (205 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * File table migrated (2 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * IdentityAccessRequest table migrated (0 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * InternalFile table migrated (50 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * InternalTip table migrated (9 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * InternalTipAnswers table migrated (9 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * InternalTipData table migrated (0 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * Mail table migrated (0 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * Message table migrated (0 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * Questionnaire table migrated (9 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * ReceiverContext table migrated (14 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * ReceiverFile table migrated (167 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * ReceiverTip table migrated (21 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * SecureFileDelete table migrated (1 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * SubmissionStatus table migrated (3 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * SubmissionSubStatus table migrated (0 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * SubmissionStatusChange table migrated (8 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * ShortURL table migrated (0 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * Signup table migrated (0 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * Stats table migrated (10 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * Step table migrated (10 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * Tenant table migrated (1 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * User table migrated (18 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * UserImg table migrated (2 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * UserTenant table migrated (18 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * WhistleblowerFile table migrated (126 entry(s))
2019-01-29 11:59:57+0000 [-] [I] * WhistleblowerTip table migrated (9 entry(s))
2019-01-29 11:59:58+0000 [-] [E] Migration completed with success!
2019-01-29 11:59:58+0000 [-] Site starting on 8082
2019-01-29 11:59:58+0000 [-] Starting factory <builtin.Site instance at 0x7f66e0caec68>
2019-01-29 11:59:58+0000 [-] Site starting on 8083
2019-01-29 11:59:58+0000 [-] Site starting on 80
2019-01-29 11:59:58+0000 [-] GlobaLeaks is now running and accessible at the following urls:
<edited and removed URL’s for privacy>
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/vq3CyNVCUi1LBiSQ.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/OdAHkLQ5s27qkUlo.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/zOddgPJHeww6hwxq.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/x4D8APvZYvS4a72E.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/y7G1RfsHJ312KCwI.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/ZCrPr7CEQF3ZjwUR.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/BPfKdJ0LMtZwy7n4.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/vJ4oiazu38WTVKIv.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/ka2TbYxXtWF2O34M.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/07BgeOjmOqG2bsTo.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/8qsJmaA8heCTZubD.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/zqWQQYnhFaXDosbM.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/jbqush9yJauZjsB7.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/BCrdtIl0zhaC2B0q.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/zyH5Uojg8biBo890.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/Y4eQ6OCdkPRLkgxp.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/unOqIZ2xLKXkVE8s.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/z8qe1kiruhZOibLb.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/nXF9glY1u28XNfW8.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/q06Ao53fUPn5Mzjx.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/nEjrr47STxLIFTRH.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/U8XP1ETVyKsQjbCg.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/vL6hqjOct7FulFU4.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/IsGoZykghxAt1VIq.plain: ‘NoneType’ object has no attribute ‘open’
2019-01-29 11:59:58+0000 [-] [E] Unable to create plaintext file /var/globaleaks/attachments/dTQSR04VfE27LDV3.plain: ‘NoneType’ object has no attribute ‘open’

Rest of the log file contains more fo the same error, and has been ommited due to space.

evilaliv3 · January 29, 2019, 2:11pm

Thank you @donaldjfraser, this errors are meaningless and you can ignore them.

Thank you for reporting them, we will manage to fix them in next releaseses.

best,

Giovanni Pellerano

jestboniface · February 6, 2019, 2:27pm

I’m equally getting this error @evilaliv3
2019-02-06T14:20:15+0000 [-] Loading /usr/lib/python3/dist-packages/globaleaks/backend.py…
2019-02-06T14:20:15+0000 [-] Loaded.
2019-02-06T14:20:15+0000 [twisted.scripts._twistd_unix.UnixAppLogger#info] twistd 17.9.0 (/usr/bin/python3 3.6.7) starting up.
2019-02-06T14:20:15+0000 [twisted.scripts._twistd_unix.UnixAppLogger#info] reactor class: twisted.internet.epollreactor.EPollReactor.
2019-02-06T14:20:15+0000 [twisted.logger._global#warn] /usr/lib/python3/dist-packages/sqlalchemy/ext/declarative/clsregistry.py:120: sqlalchemy.exc.SAWarning: This declarative base already contains a class with the same class name and module name as globaleaks.db.migration.y, and will be replaced in the string-lookup table.
2019-02-06T14:20:17+0000 [stdout#info] [E] Found an already initialized database version: 34
2019-02-06T14:20:17+0000 [stdout#info] [E] Performing schema migration from version 34 to version 46
2019-02-06T14:20:21+0000 [stdout#info] [I] Updating DB from version 34 to version 35
2019-02-06T14:20:22+0000 [stdout#info] [I] Migrating table:
2019-02-06T14:20:22+0000 [stdout#info] * Anomalies [#0]
2019-02-06T14:20:22+0000 [stdout#info] * ArchivedSchema [#4]
2019-02-06T14:20:22+0000 [stdout#info] * Comment [#1481]
2019-02-06T14:20:22+0000 [stdout#info] * Config [#69]
2019-02-06T14:20:22+0000 [stdout#info] * ConfigL10N [#53]
2019-02-06T14:20:22+0000 [stdout#info] ł Context [#4]
2019-02-06T14:20:22+0000 [stdout#info] [WARNING] Found an expiration date longer than 5 years! Configuring tips to never expire.
2019-02-06T14:20:22+0000 [stdout#info] [WARNING] Found an expiration date longer than 5 years! Configuring tips to never expire.
2019-02-06T14:20:22+0000 [stdout#info] [WARNING] Found an expiration date longer than 5 years! Configuring tips to never expire.
2019-02-06T14:20:22+0000 [stdout#info] * CustomTexts [#0]
2019-02-06T14:20:22+0000 [stdout#info] * EnabledLanguage [#1]
2019-02-06T14:20:22+0000 [stdout#info] * Field [#34]
2019-02-06T14:20:22+0000 [stdout#info] * FieldAnswer [#23602]
2019-02-06T14:20:26+0000 [stdout#info] * FieldAnswerGroup [#13180]
2019-02-06T14:20:28+0000 [stdout#info] * FieldAttr [#102]
2019-02-06T14:20:28+0000 [stdout#info] * FieldOption [#2]
2019-02-06T14:20:28+0000 [stdout#info] * File [#2]
2019-02-06T14:20:28+0000 [stdout#info] * IdentityAccessRequest [#0]
2019-02-06T14:20:28+0000 [stdout#info] * InternalFile [#155]
2019-02-06T14:20:28+0000 [stdout#info] * InternalTip [#1318]
2019-02-06T14:20:28+0000 [stdout#info] * Mail [#0]
2019-02-06T14:20:28+0000 [stdout#info] * Message [#217]
2019-02-06T14:20:28+0000 [stdout#info] * Questionnaire [#2]
2019-02-06T14:20:28+0000 [stdout#info] * Receiver [#5]
2019-02-06T14:20:28+0000 [stdout#info] * ReceiverContext [#16]
2019-02-06T14:20:28+0000 [stdout#info] * ReceiverFile [#544]
2019-02-06T14:20:29+0000 [stdout#info] * ReceiverTip [#4393]
2019-02-06T14:20:29+0000 [stdout#info] * SecureFileDelete [#0]
2019-02-06T14:20:29+0000 [stdout#info] * ShortURL [#0]
2019-02-06T14:20:30+0000 [stdout#info] * Stats [#2397282]
Killed

after migrating Stats, it auomaticallly kills the process

evilaliv3 · February 6, 2019, 3:23pm

Thank you @jestboniface,

actually the old version you are running was accumulating a large number of statistics that the system is not able to handle in remts of rams.

In more recent times we bugfixed your issue optimizing the database so that in the current release is fixed.

I’m going to emit today a fix for you so to be able and you will have to wait for release 3.6.12 in order to be able to migrate succesfully.

We wiull do our best to be able to release it by today.

best,

Giovanni Pellerano

evilaliv3 · February 6, 2019, 3:38pm

@jestboniface: a patch has been produced and will be released by today with version 3.6.12 (https://github.com/globaleaks/GlobaLeaks/commit/430f1f7581cbbb814a0fb1b19e5160f51f9ab45d)

jestboniface · February 7, 2019, 4:31am

Thank you so much @evilaliv3
I will surely wait for that…

evilaliv3 · February 7, 2019, 1:50pm

@jestboniface: you could now proceed with the update to the version 3.6.12

jestboniface · February 7, 2019, 2:21pm

thanks @evilaliv3 for the prompt:
WHEN I USE apt-get update && apt-get install globaleaks

root@_______:~# apt-get update && apt-get install globaleaks
Hit:1 http://us-west-2.ec2.archive.ubuntu.com/ubuntu bionic InRelease
Hit:2 http://us-west-2.ec2.archive.ubuntu.com/ubuntu bionic-updates InRelease
Get:3 http://us-west-2.ec2.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Get:4 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Hit:5 http://archive.ubuntu.com/ubuntu bionic InRelease
Ign:6 http://deb.globaleaks.org bionic/ InRelease
Get:7 http://deb.globaleaks.org bionic/ Release [1,506 B]
Get:8 http://deb.globaleaks.org bionic/ Release.gpg [566 B]
Err:8 http://deb.globaleaks.org bionic/ Release.gpg
The following signatures were invalid: BADSIG 32E6792624045008 GlobaLeaks software signing key info@globaleaks.org
Fetched 164 kB in 1s (233 kB/s)
Reading package lists… Done
W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: http://deb.globaleaks.org bionic/ Release: The following signatures were invalid: BADSIG 32E6792624045008 GlobaLeaks software signing key info@globaleaks.org
W: Failed to fetch http://deb.globaleaks.org/bionic/Release.gpg The following signatures were invalid: BADSIG 32E6792624045008 GlobaLeaks software signing key info@globaleaks.org
W: Some index files failed to download. They have been ignored, or old ones used instead.
Reading package lists… Done
Building dependency tree
Reading state information… Done
globaleaks is already the newest version (3.6.11).
0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded.

jestboniface · February 7, 2019, 2:31pm

I noticed this same error happens even on a test platform running linux bionic with globaleaks 3.6.11, when I try to update.

evilaliv3 · February 7, 2019, 4:05pm

Thank you @jestboniface for notifying this. It seems i forgot to sign the repository.

Would you please retry now?

jestboniface · February 7, 2019, 4:24pm

very well @evilaliv3
now this is how far I’m

root@ _____ :/tmp# globaleaks -v
GlobaLeaks version: 3.6.12
Database version: 46
root@________ :/tmp# service globaleaks stop
root@________ :/tmp# globaleaks -n -u globaleaks -g globaleaks
Going in background; log available at /var/globaleaks/log/globaleaks.log
Serving the client from directory: /usr/share/globaleaks/client/
2019-02-07T16:10:22+0000 [-] Loading /usr/lib/python3/dist-packages/globaleaks/backend.py…
2019-02-07T16:10:22+0000 [-] Loaded.
2019-02-07T16:10:22+0000 [twisted.scripts.twistd_unix.UnixAppLogger#info] twistd 17.9.0 (/usr/bin/python3 3.6.7) starting up.
2019-02-07T16:10:22+0000 [twisted.scripts.twistd_unix.UnixAppLogger#info] reactor class: twisted.internet.epollreactor.EPollReactor.
2019-02-07T16:10:22+0000 [twisted.logger.global#warn] /usr/lib/python3/dist-packages/sqlalchemy/ext/declarative/clsregistry.py:120: sqlalchemy.exc.SAWarning: This declarative base already contains a class with the same class name and module name as globaleaks.db.migration.y, and will be replaced in the string-lookup table.
2019-02-07T16:10:24+0000 [stdout#info] [E] Found an already initialized database version: 46
2019-02-07T16:10:25+0000 [-] Site starting on 8082
2019-02-07T16:10:25+0000 [builtins.Site#info] Starting factory <Site object at 0x7f823ee0a1d0>
2019-02-07T16:10:25+0000 [-] Site starting on 8083
2019-02-07T16:10:25+0000 [-] Site starting on 80
2019-02-07T16:10:25+0000 [stdout#info] GlobaLeaks is now running and accessible at the following urls:
2019-02-07T16:10:25+0000 [stdout#info] - [Tor]: --> http://.onion
2019-02-07T16:10:25+0000 [stdout#info] [E] Successfully connected to Tor control port
2019-02-07T16:10:25+0000 [TorControlProtocol,client] Created hidden-service at ________.onion
2019-02-07T16:10:25+0000 [TorControlProtocol,client] Created '.onion’, waiting for descriptor uploads.
2019-02-07T16:10:59+0000 [TorControlProtocol,client] Uploaded '_________.onion’ to ‘$82F3altetered-here1EDB14CB60C094300153A4E6A~privacy202’

(blinking…) for the past 12 mins
The CPU load is reading 2% and 0%

evilaliv3 · February 7, 2019, 4:41pm

it should be ok now,

try to connect in localhost to http://127.0.0.1:8082 and you should see it working.

Then you can log in as admin and configure HTTPS with letsencrypt that is included in globaleaks since version 3.0

jestboniface · February 7, 2019, 4:57pm

I have access in now, @evilaliv3 thank you again!!!

I confirm here that it has worked!! Thank you so much @evilaliv3

Pyramid · March 17, 2020, 2:18pm

I have the same error

Hit:1 http://it.archive.ubuntu.com/ubuntu bionic InRelease
Hit:3 http://it.archive.ubuntu.com/ubuntu bionic-updates InRelease
Hit:4 http://it.archive.ubuntu.com/ubuntu bionic-backports InRelease
Hit:5 http://security.ubuntu.com/ubuntu bionic-security InRelease
Ign:2 https://deb.globaleaks.org bionic/ InRelease
Get:6 https://deb.globaleaks.org bionic/ Release [744 B]
Get:7 https://deb.globaleaks.org bionic/ Release.gpg [833 B]
Err:7 https://deb.globaleaks.org bionic/ Release.gpg
The following signatures were invalid: BADSIG 32E6792624045008 GlobaLeaks software signing key info@globaleaks.org
Fetched 833 B in 1s (1,237 B/s)
Reading package lists… Done
W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://deb.globaleaks.org bionic/ Release: The following signatures were invalid: BADSIG 32E6792624045008 GlobaLeaks software signing key info@globaleaks.org
W: Failed to fetch http://deb.globaleaks.org/bionic/Release.gpg The following signatures were invalid: BADSIG 32E6792624045008 GlobaLeaks software signing key info@globaleaks.org
W: Some index files failed to download. They have been ignored, or old ones used instead.
Reading package lists… Done
Building dependency tree
Reading state information… Done
The following packages were automatically installed and are no longer required:
python3-psutil python3-scrypt
Use ‘apt autoremove’ to remove them.
The following packages will be upgraded:
globaleaks
1 upgraded, 0 newly installed, 0 to remove and 48 not upgraded.
Need to get 3,368 kB of archives.
After this operation, 52.2 kB of additional disk space will be used.
Err:1 https://deb.globaleaks.org bionic/ globaleaks 4.0.3
404 Not Found [IP: 51.15.240.96 443]
E: Failed to fetch https://deb.globaleaks.org/bionic/globaleaks_4.0.3_all.deb 404 Not Found [IP: 51.15.240.96 443]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?