Exception when freshly installed from snap #9580

Upgreydd · 2018-02-02T09:36:58Z

Description:

Server Setup Information:

Version of Rocket.Chat Server: 0.61.0
Operating System: Ubuntu 14.04 LTS
Deployment Method(snap/docker/tar/etc): snap
Number of Running Instances: 1
DB Replicaset Oplog:
Node Version:

Steps to Reproduce:

Just install rocket via snap
2.
3.

Expected behavior:

It's working

Actual behavior:

Getting exception and rocket chat doesn't run at all 👎

Relevant logs:

lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: Exception in added observe/observeChanges callback: TypeError: Cannot read property 'split' of null
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at packages/rocketchat:lib/server/lib/validateEmailDomain.js:13:37
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at RocketChat.settings.callbacks.(anonymous function).forEach.callback (packages/rocketchat:lib/lib/settings.js:69:61)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at Array.forEach (<anonymous>)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at forEach.item (packages/rocketchat:lib/lib/settings.js:69:41)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at Array.forEach (<anonymous>)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at Object.load (packages/rocketchat:lib/lib/settings.js:67:14)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at Object.added (packages/rocketchat:lib/server/functions/settings.js:261:31)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at _CachingChangeObserver.added (packages/minimongo/local_collection.js:1305:28)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at added (packages/minimongo/local_collection.js:707:29)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at runWithEnvironment (packages/meteor.js:1240:24)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at packages/meteor.js:1253:14
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at packages/mongo/observe_multiplex.js:182:30
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at Array.forEach (<anonymous>)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at Function._.each._.forEach (packages/underscore.js:139:11)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at Object.task (packages/mongo/observe_multiplex.js:176:9)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at Meteor._SynchronousQueue.SQp._run (packages/meteor.js:869:16)
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: at packages/meteor.js:846:12
lut 02 10:31:21 server rocketchat-server.rocketchat-server[27891]: Updating process.env.MAIL_URL

The text was updated successfully, but these errors were encountered:

cinderblock · 2018-03-27T07:16:19Z

I believe I have the same issue on 0.62.2

My rocket.chat instance recently crashed and I went to restart it. Upon restart, it failed like above. Here are my logs:

Mar 27 10:03:19 my.server.com systemd[1]: Started The Rocket.Chat server.
Mar 27 10:03:19 my.server.com systemd[1]: Starting The Rocket.Chat server...
Mar 27 10:03:25 my.server.com rocketchat[15431]: Will load cache for users
Mar 27 10:03:25 my.server.com rocketchat[15431]: 16 records load from users
Mar 27 10:03:25 my.server.com rocketchat[15431]: Will load cache for rocketchat_room
Mar 27 10:03:25 my.server.com rocketchat[15431]: 36 records load from rocketchat_room
Mar 27 10:03:25 my.server.com rocketchat[15431]: Will load cache for rocketchat_subscription
Mar 27 10:03:25 my.server.com rocketchat[15431]: 117 records load from rocketchat_subscription
Mar 27 10:03:25 my.server.com rocketchat[15431]: Will load cache for rocketchat_settings
Mar 27 10:03:25 my.server.com rocketchat[15431]: 628 records load from rocketchat_settings
Mar 27 10:03:28 my.server.com rocketchat[15431]: Exception in added observe/observeChanges callback: TypeError: Cannot read property 'split' of null
Mar 27 10:03:28 my.server.com rocketchat[15431]: at packages/rocketchat:lib/server/lib/validateEmailDomain.js:13:37
Mar 27 10:03:28 my.server.com rocketchat[15431]: at RocketChat.settings.callbacks.(anonymous function).forEach.callback (packages/rocketchat:lib/lib/settings.js:69:61)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Array.forEach (<anonymous>)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at forEach.item (packages/rocketchat:lib/lib/settings.js:69:41)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Array.forEach (<anonymous>)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Object.load (packages/rocketchat:lib/lib/settings.js:67:14)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Object.added (packages/rocketchat:lib/server/functions/settings.js:261:31)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at _CachingChangeObserver.added (packages/minimongo/local_collection.js:1305:28)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at added (packages/minimongo/local_collection.js:707:29)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at runWithEnvironment (packages/meteor.js:1240:24)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at packages/meteor.js:1253:14
Mar 27 10:03:28 my.server.com rocketchat[15431]: at packages/mongo/observe_multiplex.js:182:30
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Array.forEach (<anonymous>)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Function._.each._.forEach (packages/underscore.js:139:11)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Object.task (packages/mongo/observe_multiplex.js:176:9)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Meteor._SynchronousQueue.SQp._run (packages/meteor.js:869:16)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at packages/meteor.js:846:12
Mar 27 10:03:28 my.server.com rocketchat[15431]: Updating process.env.MAIL_URL
Mar 27 10:03:29 my.server.com rocketchat[15431]: Starting Email Intercepter...
Mar 27 10:03:31 my.server.com rocketchat[15431]: Will load cache for rocketchat_permissions
Mar 27 10:03:31 my.server.com rocketchat[15431]: 75 records load from rocketchat_permissions
Mar 27 10:03:31 my.server.com rocketchat[15431]: Will load cache for rocketchat_roles
Mar 27 10:03:31 my.server.com rocketchat[15431]: 11 records load from rocketchat_roles
Mar 27 10:03:35 my.server.com rocketchat[15431]: Warning: connect.session() MemoryStore is not
Mar 27 10:03:35 my.server.com rocketchat[15431]: designed for a production environment, as it will leak
Mar 27 10:03:35 my.server.com rocketchat[15431]: memory, and will not scale past a single process.
Mar 27 10:03:35 my.server.com rocketchat[15431]: Setting default file store to FileSystem
Mar 27 10:03:37 my.server.com systemd[1]: rocketchat.service: main process exited, code=killed, status=11/SEGV
Mar 27 10:03:37 my.server.com systemd[1]: Unit rocketchat.service entered failed state.
Mar 27 10:03:37 my.server.com systemd[1]: rocketchat.service failed.

Restarting again, the server starts successfully but still has the same exception during startup.

cinderblock · 2018-03-28T20:14:03Z

This happened to me again. The server crashed at Mar 27 13:30:17 with no warning on console.

I then modified systemd configuration and made Rocket.Chat restart automatically if it ever crashes or exits and started it again. It worked for a few minutes, then crashed and proceeded to restart 5 times in quick succession before successfully starting.

Of note, I'm playing with some integration scripts and the crash seems to be correlated to saving changes there. Unclear exactly what is failing.

Mar 27 10:03:19 my.server.com systemd[1]: Started The Rocket.Chat server.
Mar 27 10:03:19 my.server.com systemd[1]: Starting The Rocket.Chat server...
Mar 27 10:03:25 my.server.com rocketchat[15431]: Will load cache for users
Mar 27 10:03:25 my.server.com rocketchat[15431]: 16 records load from users
Mar 27 10:03:25 my.server.com rocketchat[15431]: Will load cache for rocketchat_room
Mar 27 10:03:25 my.server.com rocketchat[15431]: 36 records load from rocketchat_room
Mar 27 10:03:25 my.server.com rocketchat[15431]: Will load cache for rocketchat_subscription
Mar 27 10:03:25 my.server.com rocketchat[15431]: 117 records load from rocketchat_subscription
Mar 27 10:03:25 my.server.com rocketchat[15431]: Will load cache for rocketchat_settings
Mar 27 10:03:25 my.server.com rocketchat[15431]: 628 records load from rocketchat_settings
Mar 27 10:03:28 my.server.com rocketchat[15431]: Exception in added observe/observeChanges callback: TypeError: Cannot read property 'split' of null
Mar 27 10:03:28 my.server.com rocketchat[15431]: at packages/rocketchat:lib/server/lib/validateEmailDomain.js:13:37
Mar 27 10:03:28 my.server.com rocketchat[15431]: at RocketChat.settings.callbacks.(anonymous function).forEach.callback (packages/rocketchat:lib/lib/settings.js:69:61)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Array.forEach (<anonymous>)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at forEach.item (packages/rocketchat:lib/lib/settings.js:69:41)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Array.forEach (<anonymous>)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Object.load (packages/rocketchat:lib/lib/settings.js:67:14)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Object.added (packages/rocketchat:lib/server/functions/settings.js:261:31)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at _CachingChangeObserver.added (packages/minimongo/local_collection.js:1305:28)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at added (packages/minimongo/local_collection.js:707:29)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at runWithEnvironment (packages/meteor.js:1240:24)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at packages/meteor.js:1253:14
Mar 27 10:03:28 my.server.com rocketchat[15431]: at packages/mongo/observe_multiplex.js:182:30
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Array.forEach (<anonymous>)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Function._.each._.forEach (packages/underscore.js:139:11)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Object.task (packages/mongo/observe_multiplex.js:176:9)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at Meteor._SynchronousQueue.SQp._run (packages/meteor.js:869:16)
Mar 27 10:03:28 my.server.com rocketchat[15431]: at packages/meteor.js:846:12
Mar 27 10:03:28 my.server.com rocketchat[15431]: Updating process.env.MAIL_URL
Mar 27 10:03:29 my.server.com rocketchat[15431]: Starting Email Intercepter...
Mar 27 10:03:31 my.server.com rocketchat[15431]: Will load cache for rocketchat_permissions
Mar 27 10:03:31 my.server.com rocketchat[15431]: 75 records load from rocketchat_permissions
Mar 27 10:03:31 my.server.com rocketchat[15431]: Will load cache for rocketchat_roles
Mar 27 10:03:31 my.server.com rocketchat[15431]: 11 records load from rocketchat_roles
Mar 27 10:03:35 my.server.com rocketchat[15431]: Warning: connect.session() MemoryStore is not
Mar 27 10:03:35 my.server.com rocketchat[15431]: designed for a production environment, as it will leak
Mar 27 10:03:35 my.server.com rocketchat[15431]: memory, and will not scale past a single process.
Mar 27 10:03:35 my.server.com rocketchat[15431]: Setting default file store to FileSystem
Mar 27 10:03:37 my.server.com systemd[1]: rocketchat.service: main process exited, code=killed, status=11/SEGV
Mar 27 10:03:37 my.server.com systemd[1]: Unit rocketchat.service entered failed state.
Mar 27 10:03:37 my.server.com systemd[1]: rocketchat.service failed.
Mar 27 10:16:42 my.server.com systemd[1]: Started The Rocket.Chat server.
Mar 27 10:16:42 my.server.com systemd[1]: Starting The Rocket.Chat server...
Mar 27 10:16:45 my.server.com rocketchat[17034]: Will load cache for users
Mar 27 10:16:45 my.server.com rocketchat[17034]: 16 records load from users
Mar 27 10:16:45 my.server.com rocketchat[17034]: Will load cache for rocketchat_room
Mar 27 10:16:45 my.server.com rocketchat[17034]: 36 records load from rocketchat_room
Mar 27 10:16:45 my.server.com rocketchat[17034]: Will load cache for rocketchat_subscription
Mar 27 10:16:45 my.server.com rocketchat[17034]: 117 records load from rocketchat_subscription
Mar 27 10:16:45 my.server.com rocketchat[17034]: Will load cache for rocketchat_settings
Mar 27 10:16:45 my.server.com rocketchat[17034]: 628 records load from rocketchat_settings
Mar 27 10:16:47 my.server.com rocketchat[17034]: Exception in added observe/observeChanges callback: TypeError: Cannot read property 'split' of null
Mar 27 10:16:47 my.server.com rocketchat[17034]: at packages/rocketchat:lib/server/lib/validateEmailDomain.js:13:37
Mar 27 10:16:47 my.server.com rocketchat[17034]: at RocketChat.settings.callbacks.(anonymous function).forEach.callback (packages/rocketchat:lib/lib/settings.js:69:61)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at Array.forEach (<anonymous>)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at forEach.item (packages/rocketchat:lib/lib/settings.js:69:41)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at Array.forEach (<anonymous>)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at Object.load (packages/rocketchat:lib/lib/settings.js:67:14)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at Object.added (packages/rocketchat:lib/server/functions/settings.js:261:31)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at _CachingChangeObserver.added (packages/minimongo/local_collection.js:1305:28)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at added (packages/minimongo/local_collection.js:707:29)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at runWithEnvironment (packages/meteor.js:1240:24)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at packages/meteor.js:1253:14
Mar 27 10:16:47 my.server.com rocketchat[17034]: at packages/mongo/observe_multiplex.js:182:30
Mar 27 10:16:47 my.server.com rocketchat[17034]: at Array.forEach (<anonymous>)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at Function._.each._.forEach (packages/underscore.js:139:11)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at Object.task (packages/mongo/observe_multiplex.js:176:9)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at Meteor._SynchronousQueue.SQp._run (packages/meteor.js:869:16)
Mar 27 10:16:47 my.server.com rocketchat[17034]: at packages/meteor.js:846:12
Mar 27 10:16:48 my.server.com rocketchat[17034]: Updating process.env.MAIL_URL
Mar 27 10:16:48 my.server.com rocketchat[17034]: Starting Email Intercepter...
Mar 27 10:16:49 my.server.com rocketchat[17034]: Will load cache for rocketchat_permissions
Mar 27 10:16:49 my.server.com rocketchat[17034]: 75 records load from rocketchat_permissions
Mar 27 10:16:49 my.server.com rocketchat[17034]: Will load cache for rocketchat_roles
Mar 27 10:16:49 my.server.com rocketchat[17034]: 11 records load from rocketchat_roles
Mar 27 10:16:52 my.server.com rocketchat[17034]: Warning: connect.session() MemoryStore is not
Mar 27 10:16:52 my.server.com rocketchat[17034]: designed for a production environment, as it will leak
Mar 27 10:16:52 my.server.com rocketchat[17034]: memory, and will not scale past a single process.
Mar 27 10:16:53 my.server.com rocketchat[17034]: Setting default file store to FileSystem
Mar 27 10:17:00 my.server.com rocketchat[17034]: Tue, 27 Mar 2018 07:17:00 GMT connect deprecated multipart: use parser (multiparty, busboy, formidable) npm module instead at npm/node_modules/connect/lib/middleware/bodyParser.js:56:20
Mar 27 10:17:00 my.server.com rocketchat[17034]: Tue, 27 Mar 2018 07:17:00 GMT connect deprecated limit: Restrict request size at location of read at npm/node_modules/connect/lib/middleware/multipart.js:86:15
Mar 27 10:17:01 my.server.com rocketchat[17034]: {"line":"152","file":"rocketchat_migrations.js","message":"Migrations: Not migrating, already at version 107","time":{"$date":1522135021511},"level":"info"}
Mar 27 10:17:02 my.server.com rocketchat[17034]: Updating process.env.MAIL_URL
Mar 27 10:17:02 my.server.com rocketchat[17034]: Using GridFS for custom sounds storage
Mar 27 10:17:02 my.server.com rocketchat[17034]: Using GridFS for custom emoji storage
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ System ➔ startup
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ +----------------------------------------------------+
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ |                   SERVER RUNNING                   |
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ +----------------------------------------------------+
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ |                                                    |
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ |  Rocket.Chat Version: 0.62.2                       |
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ |       NodeJS Version: 8.10.0 - x64                 |
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ |             Platform: linux                        |
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ |         Process Port: 3001                         |
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ |             Site URL: https://chat.example.com/  |
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ |     ReplicaSet OpLog: Disabled                     |
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ |          Commit Hash: 07f0e3f77c                   |
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ |        Commit Branch: HEAD                         |
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ |                                                    |
Mar 27 10:17:04 my.server.com rocketchat[17034]: ➔ +----------------------------------------------------+
Mar 27 13:30:17 my.server.com systemd[1]: rocketchat.service: main process exited, code=killed, status=11/SEGV
Mar 27 13:30:17 my.server.com systemd[1]: Unit rocketchat.service entered failed state.
Mar 27 13:30:17 my.server.com systemd[1]: rocketchat.service failed.
Mar 28 22:44:36 my.server.com systemd[1]: Started The Rocket.Chat server.
Mar 28 22:44:36 my.server.com systemd[1]: Starting The Rocket.Chat server...
Mar 28 22:44:40 my.server.com rocketchat[24769]: Will load cache for users
Mar 28 22:44:40 my.server.com rocketchat[24769]: 16 records load from users
Mar 28 22:44:40 my.server.com rocketchat[24769]: Will load cache for rocketchat_room
Mar 28 22:44:40 my.server.com rocketchat[24769]: 36 records load from rocketchat_room
Mar 28 22:44:40 my.server.com rocketchat[24769]: Will load cache for rocketchat_subscription
Mar 28 22:44:40 my.server.com rocketchat[24769]: 117 records load from rocketchat_subscription
Mar 28 22:44:40 my.server.com rocketchat[24769]: Will load cache for rocketchat_settings
Mar 28 22:44:40 my.server.com rocketchat[24769]: 628 records load from rocketchat_settings
Mar 28 22:44:43 my.server.com rocketchat[24769]: Exception in added observe/observeChanges callback: TypeError: Cannot read property 'split' of null
Mar 28 22:44:43 my.server.com rocketchat[24769]: at packages/rocketchat:lib/server/lib/validateEmailDomain.js:13:37
Mar 28 22:44:43 my.server.com rocketchat[24769]: at RocketChat.settings.callbacks.(anonymous function).forEach.callback (packages/rocketchat:lib/lib/settings.js:69:61)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at Array.forEach (<anonymous>)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at forEach.item (packages/rocketchat:lib/lib/settings.js:69:41)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at Array.forEach (<anonymous>)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at Object.load (packages/rocketchat:lib/lib/settings.js:67:14)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at Object.added (packages/rocketchat:lib/server/functions/settings.js:261:31)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at _CachingChangeObserver.added (packages/minimongo/local_collection.js:1305:28)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at added (packages/minimongo/local_collection.js:707:29)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at runWithEnvironment (packages/meteor.js:1240:24)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at packages/meteor.js:1253:14
Mar 28 22:44:43 my.server.com rocketchat[24769]: at packages/mongo/observe_multiplex.js:182:30
Mar 28 22:44:43 my.server.com rocketchat[24769]: at Array.forEach (<anonymous>)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at Function._.each._.forEach (packages/underscore.js:139:11)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at Object.task (packages/mongo/observe_multiplex.js:176:9)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at Meteor._SynchronousQueue.SQp._run (packages/meteor.js:869:16)
Mar 28 22:44:43 my.server.com rocketchat[24769]: at packages/meteor.js:846:12
Mar 28 22:44:43 my.server.com rocketchat[24769]: Updating process.env.MAIL_URL
Mar 28 22:44:44 my.server.com rocketchat[24769]: Starting Email Intercepter...
Mar 28 22:44:46 my.server.com rocketchat[24769]: Will load cache for rocketchat_permissions
Mar 28 22:44:46 my.server.com rocketchat[24769]: 75 records load from rocketchat_permissions
Mar 28 22:44:46 my.server.com rocketchat[24769]: Will load cache for rocketchat_roles
Mar 28 22:44:46 my.server.com rocketchat[24769]: 11 records load from rocketchat_roles
Mar 28 22:44:49 my.server.com rocketchat[24769]: Warning: connect.session() MemoryStore is not
Mar 28 22:44:49 my.server.com rocketchat[24769]: designed for a production environment, as it will leak
Mar 28 22:44:49 my.server.com rocketchat[24769]: memory, and will not scale past a single process.
Mar 28 22:44:50 my.server.com rocketchat[24769]: Setting default file store to FileSystem
Mar 28 22:44:59 my.server.com rocketchat[24769]: Wed, 28 Mar 2018 19:44:59 GMT connect deprecated multipart: use parser (multiparty, busboy, formidable) npm module instead at npm/node_modules/connect/lib/middleware/bodyParser.js:56:20
Mar 28 22:44:59 my.server.com rocketchat[24769]: Wed, 28 Mar 2018 19:44:59 GMT connect deprecated limit: Restrict request size at location of read at npm/node_modules/connect/lib/middleware/multipart.js:86:15
Mar 28 22:44:59 my.server.com rocketchat[24769]: {"line":"152","file":"rocketchat_migrations.js","message":"Migrations: Not migrating, already at version 107","time":{"$date":1522266299848},"level":"info"}
Mar 28 22:45:00 my.server.com rocketchat[24769]: Updating process.env.MAIL_URL
Mar 28 22:45:01 my.server.com rocketchat[24769]: Using GridFS for custom sounds storage
Mar 28 22:45:01 my.server.com rocketchat[24769]: Using GridFS for custom emoji storage
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ System ➔ startup
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ +----------------------------------------------------+
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ |                   SERVER RUNNING                   |
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ +----------------------------------------------------+
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ |                                                    |
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ |  Rocket.Chat Version: 0.62.2                       |
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ |       NodeJS Version: 8.10.0 - x64                 |
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ |             Platform: linux                        |
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ |         Process Port: 3001                         |
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ |             Site URL: https://chat.example.com/  |
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ |     ReplicaSet OpLog: Disabled                     |
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ |          Commit Hash: 07f0e3f77c                   |
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ |        Commit Branch: HEAD                         |
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ |                                                    |
Mar 28 22:45:03 my.server.com rocketchat[24769]: ➔ +----------------------------------------------------+
Mar 28 23:02:48 my.server.com systemd[1]: rocketchat.service: main process exited, code=killed, status=11/SEGV
Mar 28 23:02:48 my.server.com systemd[1]: Unit rocketchat.service entered failed state.
Mar 28 23:02:48 my.server.com systemd[1]: rocketchat.service failed.
Mar 28 23:02:48 my.server.com systemd[1]: rocketchat.service holdoff time over, scheduling restart.
Mar 28 23:02:49 my.server.com systemd[1]: Started The Rocket.Chat server.
Mar 28 23:02:49 my.server.com systemd[1]: Starting The Rocket.Chat server...
Mar 28 23:02:51 my.server.com rocketchat[27165]: Will load cache for users
Mar 28 23:02:51 my.server.com rocketchat[27165]: 16 records load from users
Mar 28 23:02:51 my.server.com rocketchat[27165]: Will load cache for rocketchat_room
Mar 28 23:02:51 my.server.com rocketchat[27165]: 36 records load from rocketchat_room
Mar 28 23:02:51 my.server.com rocketchat[27165]: Will load cache for rocketchat_subscription
Mar 28 23:02:52 my.server.com rocketchat[27165]: 118 records load from rocketchat_subscription
Mar 28 23:02:52 my.server.com rocketchat[27165]: Will load cache for rocketchat_settings
Mar 28 23:02:52 my.server.com rocketchat[27165]: 628 records load from rocketchat_settings
Mar 28 23:02:53 my.server.com rocketchat[27165]: Exception in added observe/observeChanges callback: TypeError: Cannot read property 'split' of null
Mar 28 23:02:53 my.server.com rocketchat[27165]: at packages/rocketchat:lib/server/lib/validateEmailDomain.js:13:37
Mar 28 23:02:53 my.server.com rocketchat[27165]: at RocketChat.settings.callbacks.(anonymous function).forEach.callback (packages/rocketchat:lib/lib/settings.js:69:61)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at Array.forEach (<anonymous>)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at forEach.item (packages/rocketchat:lib/lib/settings.js:69:41)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at Array.forEach (<anonymous>)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at Object.load (packages/rocketchat:lib/lib/settings.js:67:14)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at Object.added (packages/rocketchat:lib/server/functions/settings.js:261:31)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at _CachingChangeObserver.added (packages/minimongo/local_collection.js:1305:28)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at added (packages/minimongo/local_collection.js:707:29)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at runWithEnvironment (packages/meteor.js:1240:24)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at packages/meteor.js:1253:14
Mar 28 23:02:53 my.server.com rocketchat[27165]: at packages/mongo/observe_multiplex.js:182:30
Mar 28 23:02:53 my.server.com rocketchat[27165]: at Array.forEach (<anonymous>)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at Function._.each._.forEach (packages/underscore.js:139:11)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at Object.task (packages/mongo/observe_multiplex.js:176:9)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at Meteor._SynchronousQueue.SQp._run (packages/meteor.js:869:16)
Mar 28 23:02:53 my.server.com rocketchat[27165]: at packages/meteor.js:846:12
Mar 28 23:02:54 my.server.com rocketchat[27165]: Updating process.env.MAIL_URL
Mar 28 23:02:55 my.server.com rocketchat[27165]: Starting Email Intercepter...
Mar 28 23:02:56 my.server.com rocketchat[27165]: Will load cache for rocketchat_permissions
Mar 28 23:02:56 my.server.com rocketchat[27165]: 75 records load from rocketchat_permissions
Mar 28 23:02:56 my.server.com rocketchat[27165]: Will load cache for rocketchat_roles
Mar 28 23:02:56 my.server.com rocketchat[27165]: 11 records load from rocketchat_roles
Mar 28 23:02:58 my.server.com rocketchat[27165]: Warning: connect.session() MemoryStore is not
Mar 28 23:02:58 my.server.com rocketchat[27165]: designed for a production environment, as it will leak
Mar 28 23:02:58 my.server.com rocketchat[27165]: memory, and will not scale past a single process.
Mar 28 23:02:58 my.server.com rocketchat[27165]: Setting default file store to FileSystem
Mar 28 23:02:59 my.server.com systemd[1]: rocketchat.service: main process exited, code=killed, status=11/SEGV
Mar 28 23:02:59 my.server.com systemd[1]: Unit rocketchat.service entered failed state.
Mar 28 23:02:59 my.server.com systemd[1]: rocketchat.service failed.
Mar 28 23:02:59 my.server.com systemd[1]: rocketchat.service holdoff time over, scheduling restart.
Mar 28 23:02:59 my.server.com systemd[1]: Started The Rocket.Chat server.
Mar 28 23:02:59 my.server.com systemd[1]: Starting The Rocket.Chat server...
Mar 28 23:03:02 my.server.com rocketchat[27207]: Will load cache for users
Mar 28 23:03:02 my.server.com rocketchat[27207]: 16 records load from users
Mar 28 23:03:02 my.server.com rocketchat[27207]: Will load cache for rocketchat_room
Mar 28 23:03:02 my.server.com rocketchat[27207]: 36 records load from rocketchat_room
Mar 28 23:03:02 my.server.com rocketchat[27207]: Will load cache for rocketchat_subscription
Mar 28 23:03:02 my.server.com rocketchat[27207]: 118 records load from rocketchat_subscription
Mar 28 23:03:02 my.server.com rocketchat[27207]: Will load cache for rocketchat_settings
Mar 28 23:03:02 my.server.com rocketchat[27207]: 628 records load from rocketchat_settings
Mar 28 23:03:04 my.server.com rocketchat[27207]: Exception in added observe/observeChanges callback: TypeError: Cannot read property 'split' of null
Mar 28 23:03:04 my.server.com rocketchat[27207]: at packages/rocketchat:lib/server/lib/validateEmailDomain.js:13:37
Mar 28 23:03:04 my.server.com rocketchat[27207]: at RocketChat.settings.callbacks.(anonymous function).forEach.callback (packages/rocketchat:lib/lib/settings.js:69:61)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at Array.forEach (<anonymous>)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at forEach.item (packages/rocketchat:lib/lib/settings.js:69:41)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at Array.forEach (<anonymous>)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at Object.load (packages/rocketchat:lib/lib/settings.js:67:14)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at Object.added (packages/rocketchat:lib/server/functions/settings.js:261:31)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at _CachingChangeObserver.added (packages/minimongo/local_collection.js:1305:28)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at added (packages/minimongo/local_collection.js:707:29)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at runWithEnvironment (packages/meteor.js:1240:24)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at packages/meteor.js:1253:14
Mar 28 23:03:04 my.server.com rocketchat[27207]: at packages/mongo/observe_multiplex.js:182:30
Mar 28 23:03:04 my.server.com rocketchat[27207]: at Array.forEach (<anonymous>)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at Function._.each._.forEach (packages/underscore.js:139:11)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at Object.task (packages/mongo/observe_multiplex.js:176:9)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at Meteor._SynchronousQueue.SQp._run (packages/meteor.js:869:16)
Mar 28 23:03:04 my.server.com rocketchat[27207]: at packages/meteor.js:846:12
Mar 28 23:03:05 my.server.com rocketchat[27207]: Updating process.env.MAIL_URL
Mar 28 23:03:05 my.server.com rocketchat[27207]: Starting Email Intercepter...
Mar 28 23:03:06 my.server.com rocketchat[27207]: Will load cache for rocketchat_permissions
Mar 28 23:03:06 my.server.com rocketchat[27207]: 75 records load from rocketchat_permissions
Mar 28 23:03:06 my.server.com rocketchat[27207]: Will load cache for rocketchat_roles
Mar 28 23:03:06 my.server.com rocketchat[27207]: 11 records load from rocketchat_roles
Mar 28 23:03:09 my.server.com rocketchat[27207]: Warning: connect.session() MemoryStore is not
Mar 28 23:03:09 my.server.com rocketchat[27207]: designed for a production environment, as it will leak
Mar 28 23:03:09 my.server.com rocketchat[27207]: memory, and will not scale past a single process.
Mar 28 23:03:10 my.server.com systemd[1]: rocketchat.service: main process exited, code=killed, status=11/SEGV
Mar 28 23:03:10 my.server.com systemd[1]: Unit rocketchat.service entered failed state.
Mar 28 23:03:10 my.server.com systemd[1]: rocketchat.service failed.
Mar 28 23:03:10 my.server.com systemd[1]: rocketchat.service holdoff time over, scheduling restart.
Mar 28 23:03:10 my.server.com systemd[1]: Started The Rocket.Chat server.
Mar 28 23:03:10 my.server.com systemd[1]: Starting The Rocket.Chat server...
Mar 28 23:03:13 my.server.com rocketchat[27244]: Will load cache for users
Mar 28 23:03:13 my.server.com rocketchat[27244]: 16 records load from users
Mar 28 23:03:13 my.server.com rocketchat[27244]: Will load cache for rocketchat_room
Mar 28 23:03:13 my.server.com rocketchat[27244]: 36 records load from rocketchat_room
Mar 28 23:03:13 my.server.com rocketchat[27244]: Will load cache for rocketchat_subscription
Mar 28 23:03:13 my.server.com rocketchat[27244]: 118 records load from rocketchat_subscription
Mar 28 23:03:13 my.server.com rocketchat[27244]: Will load cache for rocketchat_settings
Mar 28 23:03:13 my.server.com rocketchat[27244]: 628 records load from rocketchat_settings
Mar 28 23:03:15 my.server.com rocketchat[27244]: Exception in added observe/observeChanges callback: TypeError: Cannot read property 'split' of null
Mar 28 23:03:15 my.server.com rocketchat[27244]: at packages/rocketchat:lib/server/lib/validateEmailDomain.js:13:37
Mar 28 23:03:15 my.server.com rocketchat[27244]: at RocketChat.settings.callbacks.(anonymous function).forEach.callback (packages/rocketchat:lib/lib/settings.js:69:61)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at Array.forEach (<anonymous>)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at forEach.item (packages/rocketchat:lib/lib/settings.js:69:41)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at Array.forEach (<anonymous>)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at Object.load (packages/rocketchat:lib/lib/settings.js:67:14)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at Object.added (packages/rocketchat:lib/server/functions/settings.js:261:31)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at _CachingChangeObserver.added (packages/minimongo/local_collection.js:1305:28)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at added (packages/minimongo/local_collection.js:707:29)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at runWithEnvironment (packages/meteor.js:1240:24)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at packages/meteor.js:1253:14
Mar 28 23:03:15 my.server.com rocketchat[27244]: at packages/mongo/observe_multiplex.js:182:30
Mar 28 23:03:15 my.server.com rocketchat[27244]: at Array.forEach (<anonymous>)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at Function._.each._.forEach (packages/underscore.js:139:11)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at Object.task (packages/mongo/observe_multiplex.js:176:9)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at Meteor._SynchronousQueue.SQp._run (packages/meteor.js:869:16)
Mar 28 23:03:15 my.server.com rocketchat[27244]: at packages/meteor.js:846:12
Mar 28 23:03:15 my.server.com rocketchat[27244]: Updating process.env.MAIL_URL
Mar 28 23:03:16 my.server.com rocketchat[27244]: Starting Email Intercepter...
Mar 28 23:03:17 my.server.com rocketchat[27244]: Will load cache for rocketchat_permissions
Mar 28 23:03:17 my.server.com rocketchat[27244]: 75 records load from rocketchat_permissions
Mar 28 23:03:17 my.server.com rocketchat[27244]: Will load cache for rocketchat_roles
Mar 28 23:03:17 my.server.com rocketchat[27244]: 11 records load from rocketchat_roles
Mar 28 23:03:19 my.server.com rocketchat[27244]: Warning: connect.session() MemoryStore is not
Mar 28 23:03:19 my.server.com rocketchat[27244]: designed for a production environment, as it will leak
Mar 28 23:03:19 my.server.com rocketchat[27244]: memory, and will not scale past a single process.
Mar 28 23:03:20 my.server.com systemd[1]: rocketchat.service: main process exited, code=killed, status=11/SEGV
Mar 28 23:03:20 my.server.com systemd[1]: Unit rocketchat.service entered failed state.
Mar 28 23:03:20 my.server.com systemd[1]: rocketchat.service failed.
Mar 28 23:03:20 my.server.com systemd[1]: rocketchat.service holdoff time over, scheduling restart.
Mar 28 23:03:21 my.server.com systemd[1]: Started The Rocket.Chat server.
Mar 28 23:03:21 my.server.com systemd[1]: Starting The Rocket.Chat server...
Mar 28 23:03:23 my.server.com rocketchat[27281]: Will load cache for users
Mar 28 23:03:23 my.server.com rocketchat[27281]: 16 records load from users
Mar 28 23:03:23 my.server.com rocketchat[27281]: Will load cache for rocketchat_room
Mar 28 23:03:23 my.server.com rocketchat[27281]: 36 records load from rocketchat_room
Mar 28 23:03:23 my.server.com rocketchat[27281]: Will load cache for rocketchat_subscription
Mar 28 23:03:23 my.server.com rocketchat[27281]: 118 records load from rocketchat_subscription
Mar 28 23:03:23 my.server.com rocketchat[27281]: Will load cache for rocketchat_settings
Mar 28 23:03:23 my.server.com rocketchat[27281]: 628 records load from rocketchat_settings
Mar 28 23:03:25 my.server.com rocketchat[27281]: Exception in added observe/observeChanges callback: TypeError: Cannot read property 'split' of null
Mar 28 23:03:25 my.server.com rocketchat[27281]: at packages/rocketchat:lib/server/lib/validateEmailDomain.js:13:37
Mar 28 23:03:25 my.server.com rocketchat[27281]: at RocketChat.settings.callbacks.(anonymous function).forEach.callback (packages/rocketchat:lib/lib/settings.js:69:61)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at Array.forEach (<anonymous>)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at forEach.item (packages/rocketchat:lib/lib/settings.js:69:41)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at Array.forEach (<anonymous>)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at Object.load (packages/rocketchat:lib/lib/settings.js:67:14)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at Object.added (packages/rocketchat:lib/server/functions/settings.js:261:31)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at _CachingChangeObserver.added (packages/minimongo/local_collection.js:1305:28)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at added (packages/minimongo/local_collection.js:707:29)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at runWithEnvironment (packages/meteor.js:1240:24)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at packages/meteor.js:1253:14
Mar 28 23:03:25 my.server.com rocketchat[27281]: at packages/mongo/observe_multiplex.js:182:30
Mar 28 23:03:25 my.server.com rocketchat[27281]: at Array.forEach (<anonymous>)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at Function._.each._.forEach (packages/underscore.js:139:11)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at Object.task (packages/mongo/observe_multiplex.js:176:9)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at Meteor._SynchronousQueue.SQp._run (packages/meteor.js:869:16)
Mar 28 23:03:25 my.server.com rocketchat[27281]: at packages/meteor.js:846:12
Mar 28 23:03:26 my.server.com rocketchat[27281]: Updating process.env.MAIL_URL
Mar 28 23:03:26 my.server.com rocketchat[27281]: Starting Email Intercepter...
Mar 28 23:03:27 my.server.com rocketchat[27281]: Will load cache for rocketchat_permissions
Mar 28 23:03:27 my.server.com rocketchat[27281]: 75 records load from rocketchat_permissions
Mar 28 23:03:27 my.server.com rocketchat[27281]: Will load cache for rocketchat_roles
Mar 28 23:03:27 my.server.com rocketchat[27281]: 11 records load from rocketchat_roles
Mar 28 23:03:30 my.server.com rocketchat[27281]: Warning: connect.session() MemoryStore is not
Mar 28 23:03:30 my.server.com rocketchat[27281]: designed for a production environment, as it will leak
Mar 28 23:03:30 my.server.com rocketchat[27281]: memory, and will not scale past a single process.
Mar 28 23:03:31 my.server.com rocketchat[27281]: Setting default file store to FileSystem
Mar 28 23:03:36 my.server.com rocketchat[27281]: Wed, 28 Mar 2018 20:03:36 GMT connect deprecated multipart: use parser (multiparty, busboy, formidable) npm module instead at npm/node_modules/connect/lib/middleware/bodyParser.js:56:20
Mar 28 23:03:36 my.server.com rocketchat[27281]: Wed, 28 Mar 2018 20:03:36 GMT connect deprecated limit: Restrict request size at location of read at npm/node_modules/connect/lib/middleware/multipart.js:86:15
Mar 28 23:03:36 my.server.com rocketchat[27281]: {"line":"152","file":"rocketchat_migrations.js","message":"Migrations: Not migrating, already at version 107","time":{"$date":1522267416516},"level":"info"}
Mar 28 23:03:37 my.server.com rocketchat[27281]: Updating process.env.MAIL_URL
Mar 28 23:03:37 my.server.com rocketchat[27281]: Using GridFS for custom sounds storage
Mar 28 23:03:37 my.server.com rocketchat[27281]: Using GridFS for custom emoji storage
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ System ➔ startup
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ +----------------------------------------------------+
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ |                   SERVER RUNNING                   |
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ +----------------------------------------------------+
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ |                                                    |
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ |  Rocket.Chat Version: 0.62.2                       |
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ |       NodeJS Version: 8.10.0 - x64                 |
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ |             Platform: linux                        |
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ |         Process Port: 3001                         |
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ |             Site URL: https://chat.example.com/  |
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ |     ReplicaSet OpLog: Disabled                     |
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ |          Commit Hash: 07f0e3f77c                   |
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ |        Commit Branch: HEAD                         |
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ |                                                    |
Mar 28 23:03:40 my.server.com rocketchat[27281]: ➔ +----------------------------------------------------+

cinderblock · 2018-04-11T19:19:59Z

This is still happening on 0.63.1.

Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ +----------------------------------------------------+
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ |                   SERVER RUNNING                   |
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ +----------------------------------------------------+
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ |                                                    |
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ |  Rocket.Chat Version: 0.63.1                       |
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ |       NodeJS Version: 8.11.1 - x64                 |
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ |             Platform: linux                        |
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ |         Process Port: 3001                         |
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ |             Site URL: https://chat.example.com/  |
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ |     ReplicaSet OpLog: Disabled                     |
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ |          Commit Hash: ac16e93869                   |
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ |        Commit Branch: HEAD                         |
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ |                                                    |
Apr 11 17:39:17 chat.example.com rocketchat[14896]: ➔ +----------------------------------------------------+
Apr 11 22:13:00 chat.example.com systemd[1]: rocketchat.service: main process exited, code=killed, status=11/SEGV
Apr 11 22:13:00 chat.example.com systemd[1]: Unit rocketchat.service entered failed state.
Apr 11 22:13:00 chat.example.com systemd[1]: rocketchat.service failed.
Apr 11 22:13:00 chat.example.com systemd[1]: rocketchat.service holdoff time over, scheduling restart.
Apr 11 22:13:00 chat.example.com systemd[1]: Started The Rocket.Chat server.
Apr 11 22:13:00 chat.example.com systemd[1]: Starting The Rocket.Chat server...
Apr 11 22:13:03 chat.example.com rocketchat[15049]: Will load cache for users
Apr 11 22:13:03 chat.example.com rocketchat[15049]: 16 records load from users
Apr 11 22:13:03 chat.example.com rocketchat[15049]: Will load cache for rocketchat_room
Apr 11 22:13:03 chat.example.com rocketchat[15049]: 36 records load from rocketchat_room
Apr 11 22:13:03 chat.example.com rocketchat[15049]: Will load cache for rocketchat_subscription
Apr 11 22:13:03 chat.example.com rocketchat[15049]: 118 records load from rocketchat_subscription
Apr 11 22:13:03 chat.example.com rocketchat[15049]: Will load cache for rocketchat_settings
Apr 11 22:13:03 chat.example.com rocketchat[15049]: 637 records load from rocketchat_settings
Apr 11 22:13:05 chat.example.com rocketchat[15049]: Exception in added observe/observeChanges callback: TypeError: Cannot read property 'split' of null
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at packages/rocketchat:lib/server/lib/validateEmailDomain.js:13:37
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at RocketChat.settings.callbacks.(anonymous function).forEach.callback (packages/rocketchat:lib/lib/settings.js:69:61)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at Array.forEach (<anonymous>)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at forEach.item (packages/rocketchat:lib/lib/settings.js:69:41)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at Array.forEach (<anonymous>)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at Object.load (packages/rocketchat:lib/lib/settings.js:67:14)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at Object.added (packages/rocketchat:lib/server/functions/settings.js:261:31)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at _CachingChangeObserver.added (packages/minimongo/local_collection.js:1305:28)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at added (packages/minimongo/local_collection.js:707:29)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at runWithEnvironment (packages/meteor.js:1238:24)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at packages/meteor.js:1251:14
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at packages/mongo/observe_multiplex.js:182:30
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at Array.forEach (<anonymous>)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at Function._.each._.forEach (packages/underscore.js:139:11)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at Object.task (packages/mongo/observe_multiplex.js:176:9)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at Meteor._SynchronousQueue.SQp._run (packages/meteor.js:869:16)
Apr 11 22:13:05 chat.example.com rocketchat[15049]: at packages/meteor.js:846:12
Apr 11 22:13:06 chat.example.com rocketchat[15049]: Updating process.env.MAIL_URL
Apr 11 22:13:06 chat.example.com rocketchat[15049]: Starting Email Intercepter...
Apr 11 22:13:07 chat.example.com rocketchat[15049]: Will load cache for rocketchat_permissions
Apr 11 22:13:07 chat.example.com rocketchat[15049]: 78 records load from rocketchat_permissions
Apr 11 22:13:07 chat.example.com rocketchat[15049]: Will load cache for rocketchat_roles
Apr 11 22:13:07 chat.example.com rocketchat[15049]: 11 records load from rocketchat_roles
Apr 11 22:13:09 chat.example.com rocketchat[15049]: Warning: connect.session() MemoryStore is not
Apr 11 22:13:09 chat.example.com rocketchat[15049]: designed for a production environment, as it will leak
Apr 11 22:13:09 chat.example.com rocketchat[15049]: memory, and will not scale past a single process.
Apr 11 22:13:10 chat.example.com rocketchat[15049]: Setting default file store to FileSystem
Apr 11 22:13:10 chat.example.com systemd[1]: rocketchat.service: main process exited, code=killed, status=11/SEGV
Apr 11 22:13:10 chat.example.com systemd[1]: Unit rocketchat.service entered failed state.
Apr 11 22:13:10 chat.example.com systemd[1]: rocketchat.service failed.
Apr 11 22:13:10 chat.example.com systemd[1]: rocketchat.service holdoff time over, scheduling restart.
Apr 11 22:13:10 chat.example.com systemd[1]: Started The Rocket.Chat server.
Apr 11 22:13:10 chat.example.com systemd[1]: Starting The Rocket.Chat server...
Apr 11 22:13:13 chat.example.com rocketchat[15087]: Will load cache for users
Apr 11 22:13:13 chat.example.com rocketchat[15087]: 16 records load from users
Apr 11 22:13:13 chat.example.com rocketchat[15087]: Will load cache for rocketchat_room
Apr 11 22:13:13 chat.example.com rocketchat[15087]: 36 records load from rocketchat_room
Apr 11 22:13:13 chat.example.com rocketchat[15087]: Will load cache for rocketchat_subscription
Apr 11 22:13:13 chat.example.com rocketchat[15087]: 118 records load from rocketchat_subscription
Apr 11 22:13:13 chat.example.com rocketchat[15087]: Will load cache for rocketchat_settings
Apr 11 22:13:13 chat.example.com rocketchat[15087]: 637 records load from rocketchat_settings
Apr 11 22:13:14 chat.example.com rocketchat[15087]: Exception in added observe/observeChanges callback: TypeError: Cannot read property 'split' of null
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at packages/rocketchat:lib/server/lib/validateEmailDomain.js:13:37
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at RocketChat.settings.callbacks.(anonymous function).forEach.callback (packages/rocketchat:lib/lib/settings.js:69:61)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at Array.forEach (<anonymous>)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at forEach.item (packages/rocketchat:lib/lib/settings.js:69:41)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at Array.forEach (<anonymous>)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at Object.load (packages/rocketchat:lib/lib/settings.js:67:14)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at Object.added (packages/rocketchat:lib/server/functions/settings.js:261:31)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at _CachingChangeObserver.added (packages/minimongo/local_collection.js:1305:28)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at added (packages/minimongo/local_collection.js:707:29)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at runWithEnvironment (packages/meteor.js:1238:24)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at packages/meteor.js:1251:14
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at packages/mongo/observe_multiplex.js:182:30
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at Array.forEach (<anonymous>)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at Function._.each._.forEach (packages/underscore.js:139:11)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at Object.task (packages/mongo/observe_multiplex.js:176:9)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at Meteor._SynchronousQueue.SQp._run (packages/meteor.js:869:16)
Apr 11 22:13:14 chat.example.com rocketchat[15087]: at packages/meteor.js:846:12
Apr 11 22:13:15 chat.example.com rocketchat[15087]: Updating process.env.MAIL_URL
Apr 11 22:13:16 chat.example.com rocketchat[15087]: Starting Email Intercepter...
Apr 11 22:13:17 chat.example.com rocketchat[15087]: Will load cache for rocketchat_permissions
Apr 11 22:13:17 chat.example.com rocketchat[15087]: 78 records load from rocketchat_permissions
Apr 11 22:13:17 chat.example.com rocketchat[15087]: Will load cache for rocketchat_roles
Apr 11 22:13:17 chat.example.com rocketchat[15087]: 11 records load from rocketchat_roles
Apr 11 22:13:19 chat.example.com rocketchat[15087]: Warning: connect.session() MemoryStore is not
Apr 11 22:13:19 chat.example.com rocketchat[15087]: designed for a production environment, as it will leak
Apr 11 22:13:19 chat.example.com rocketchat[15087]: memory, and will not scale past a single process.
Apr 11 22:13:20 chat.example.com rocketchat[15087]: Setting default file store to FileSystem
Apr 11 22:13:24 chat.example.com rocketchat[15087]: Wed, 11 Apr 2018 19:13:24 GMT connect deprecated multipart: use parser (multiparty, busboy, formidable) npm module instead at npm/node_modules/connect/lib/middleware/bodyParser.js:56:20
Apr 11 22:13:24 chat.example.com rocketchat[15087]: Wed, 11 Apr 2018 19:13:24 GMT connect deprecated limit: Restrict request size at location of read at npm/node_modules/connect/lib/middleware/multipart.js:86:15
Apr 11 22:13:24 chat.example.com rocketchat[15087]: {"line":"152","file":"rocketchat_migrations.js","message":"Migrations: Not migrating, already at version 109","time":{"$date":1523474004675},"level":"info"}
Apr 11 22:13:25 chat.example.com rocketchat[15087]: Updating process.env.MAIL_URL
Apr 11 22:13:25 chat.example.com rocketchat[15087]: Using GridFS for custom sounds storage
Apr 11 22:13:25 chat.example.com rocketchat[15087]: Using GridFS for custom emoji storage
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ System ➔ startup
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ +----------------------------------------------------+
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ |                   SERVER RUNNING                   |
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ +----------------------------------------------------+
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ |                                                    |
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ |  Rocket.Chat Version: 0.63.1                       |
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ |       NodeJS Version: 8.11.1 - x64                 |
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ |             Platform: linux                        |
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ |         Process Port: 3001                         |
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ |             Site URL: https://chat.example.com/  |
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ |     ReplicaSet OpLog: Disabled                     |
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ |          Commit Hash: ac16e93869                   |
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ |        Commit Branch: HEAD                         |
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ |                                                    |
Apr 11 22:13:28 chat.example.com rocketchat[15087]: ➔ +----------------------------------------------------+

cinderblock · 2018-04-11T19:24:41Z

Sometimes Rocket.Chat runs for days without issue.

When it Segfaults, systemd automatically restarts it nicely. Sometimes it comes back after the first restart. Sometimes it fails to start initially, systemd sees the segfault, and restarts the server again. This repeats until Rocket.Chat comes back "permanently", or until it segfaults again...

Are there more verbose logging options I can enable?

TwizzyDizzy · 2018-05-17T09:09:59Z

@geekgonecrazy are snaps already upgraded to nodejs 8.11.2? Is this even applicable? I'm thinking of #10331 here.

Cheers
Thomas

cinderblock · 2018-05-17T20:41:33Z

To be clear, my issues are from a server not using snap. Maybe I actually have a different issue that the OP. My apologies if I've hijacked this issue.

geekgonecrazy · 2018-05-30T06:23:20Z

Please reopen if still happening

cinderblock · 2018-05-31T21:47:05Z

The exception is still happening on the latest version for me. It no longer seems to crash rocket.chat but I still see the exception during startup logs:

May 31 01:44:50 myserver.mydomain.com systemd[1]: Started The Rocket.Chat server.
May 31 01:44:50 myserver.mydomain.com systemd[1]: Starting The Rocket.Chat server...
May 31 01:44:54 myserver.mydomain.com rocketchat[4926]: Will load cache for users
May 31 01:44:54 myserver.mydomain.com rocketchat[4926]: 16 records load from users
May 31 01:44:54 myserver.mydomain.com rocketchat[4926]: Will load cache for rocketchat_room
May 31 01:44:54 myserver.mydomain.com rocketchat[4926]: 40 records load from rocketchat_room
May 31 01:44:54 myserver.mydomain.com rocketchat[4926]: Will load cache for rocketchat_subscription
May 31 01:44:54 myserver.mydomain.com rocketchat[4926]: 127 records load from rocketchat_subscription
May 31 01:44:54 myserver.mydomain.com rocketchat[4926]: Will load cache for rocketchat_settings
May 31 01:44:54 myserver.mydomain.com rocketchat[4926]: 688 records load from rocketchat_settings
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: Exception in added observe/observeChanges callback: TypeError: Cannot read property 'split' of null
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at packages/rocketchat:lib/server/lib/validateEmailDomain.js:13:37
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at RocketChat.settings.callbacks.(anonymous function).forEach.callback (packages/rocketchat:lib/lib/settings.js:69:61)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at Array.forEach (<anonymous>)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at forEach.item (packages/rocketchat:lib/lib/settings.js:69:41)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at Array.forEach (<anonymous>)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at Object.load (packages/rocketchat:lib/lib/settings.js:67:14)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at Object.added (packages/rocketchat:lib/server/functions/settings.js:264:31)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at _CachingChangeObserver.added (packages/minimongo/local_collection.js:1305:28)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at added (packages/minimongo/local_collection.js:707:29)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at runWithEnvironment (packages/meteor.js:1238:24)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at packages/meteor.js:1251:14
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at packages/mongo/observe_multiplex.js:182:30
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at Array.forEach (<anonymous>)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at Function._.each._.forEach (packages/underscore.js:139:11)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at Object.task (packages/mongo/observe_multiplex.js:176:9)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at Meteor._SynchronousQueue.SQp._run (packages/meteor.js:869:16)
May 31 01:44:56 myserver.mydomain.com rocketchat[4926]: at packages/meteor.js:846:12
May 31 01:44:57 myserver.mydomain.com rocketchat[4926]: Updating process.env.MAIL_URL
May 31 01:44:57 myserver.mydomain.com rocketchat[4926]: Starting Email Intercepter...
May 31 01:44:59 myserver.mydomain.com rocketchat[4926]: Will load cache for rocketchat_permissions
May 31 01:44:59 myserver.mydomain.com rocketchat[4926]: 80 records load from rocketchat_permissions
May 31 01:44:59 myserver.mydomain.com rocketchat[4926]: Will load cache for rocketchat_roles
May 31 01:44:59 myserver.mydomain.com rocketchat[4926]: 11 records load from rocketchat_roles
May 31 01:45:02 myserver.mydomain.com rocketchat[4926]: Warning: connect.session() MemoryStore is not
May 31 01:45:02 myserver.mydomain.com rocketchat[4926]: designed for a production environment, as it will leak
May 31 01:45:02 myserver.mydomain.com rocketchat[4926]: memory, and will not scale past a single process.
May 31 01:45:02 myserver.mydomain.com rocketchat[4926]: Setting default file store to FileSystem
May 31 01:45:08 myserver.mydomain.com rocketchat[4926]: Wed, 30 May 2018 22:45:08 GMT connect deprecated multipart: use parser (multiparty, busboy, formidable) npm module instead at npm/node_modules/connect/lib/middleware/bodyParser.js:56:20
May 31 01:45:08 myserver.mydomain.com rocketchat[4926]: Wed, 30 May 2018 22:45:08 GMT connect deprecated limit: Restrict request size at location of read at npm/node_modules/connect/lib/middleware/multipart.js:86:15
May 31 01:45:09 myserver.mydomain.com rocketchat[4926]: {"line":"160","file":"rocketchat_migrations.js","message":"Migrations: Not migrating, already at version 121","time":{"$date":1527720309270},"level":"info"}
May 31 01:45:09 myserver.mydomain.com rocketchat[4926]: Updating process.env.MAIL_URL
May 31 01:45:10 myserver.mydomain.com rocketchat[4926]: Using GridFS for custom sounds storage
May 31 01:45:10 myserver.mydomain.com rocketchat[4926]: Using GridFS for custom emoji storage
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ System ➔ startup
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ +----------------------------------------------------+
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ |                   SERVER RUNNING                   |
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ +----------------------------------------------------+
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ |                                                    |
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ |  Rocket.Chat Version: 0.65.1                       |
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ |       NodeJS Version: 8.11.2 - x64                 |
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ |             Platform: linux                        |
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ |         Process Port: 3001                         |
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ |             Site URL: https://chat.mydomain.com/  |
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ |     ReplicaSet OpLog: Disabled                     |
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ |          Commit Hash: 8349c36de0                   |
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ |        Commit Branch: HEAD                         |
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ |                                                    |
May 31 01:45:13 myserver.mydomain.com rocketchat[4926]: ➔ +----------------------------------------------------+
May 31 03:56:53 myserver.mydomain.com rocketchat[4926]: ...

geekgonecrazy · 2018-06-01T05:46:52Z

Perfect an exception that doesn't block startup is progress 🙂

HorlogeSkynet · 2018-06-11T17:20:31Z

Confirming this is still happening on the latest version, but not blocking the startup process.
This issue should be re-opened 👍

geekgonecrazy closed this as completed May 30, 2018

geekgonecrazy reopened this Jun 13, 2018

geekgonecrazy closed this as completed Dec 1, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Exception when freshly installed from snap #9580

Exception when freshly installed from snap #9580

Upgreydd commented Feb 2, 2018

cinderblock commented Mar 27, 2018 •

edited

Loading

cinderblock commented Mar 28, 2018

cinderblock commented Apr 11, 2018

cinderblock commented Apr 11, 2018

TwizzyDizzy commented May 17, 2018

cinderblock commented May 17, 2018

geekgonecrazy commented May 30, 2018

cinderblock commented May 31, 2018 •

edited

Loading

geekgonecrazy commented Jun 1, 2018

HorlogeSkynet commented Jun 11, 2018

Exception when freshly installed from snap #9580

Exception when freshly installed from snap #9580

Comments

Upgreydd commented Feb 2, 2018

Description:

Server Setup Information:

Steps to Reproduce:

Expected behavior:

Actual behavior:

Relevant logs:

cinderblock commented Mar 27, 2018 • edited Loading

cinderblock commented Mar 28, 2018

cinderblock commented Apr 11, 2018

cinderblock commented Apr 11, 2018

TwizzyDizzy commented May 17, 2018

cinderblock commented May 17, 2018

geekgonecrazy commented May 30, 2018

cinderblock commented May 31, 2018 • edited Loading

geekgonecrazy commented Jun 1, 2018

HorlogeSkynet commented Jun 11, 2018

cinderblock commented Mar 27, 2018 •

edited

Loading

cinderblock commented May 31, 2018 •

edited

Loading