Question regarding log error - VisualCron - Forum

Community forum

lal
  •  lal
  • No customer Topic Starter
2008-08-21T09:46:05Z
We were experiencing some issues with VC, and restarted the VC server. We found that it did not resume the server log until after midnight. When looking at the issue more closely, I found that the previous day, the tray client and API log showed errors, and at the same time the memory cleanup routine that you normally see every 5 minutes in the server log stopped running; like the server log logging, the memory cleanup routine didn't resume until after midnight, rather than after the restart.

The tray client error was this, and it cleared up immediately after the VC server restart:

8/17/2008 5:33:39 AM Ping failed, ex: System.NullReferenceException: Object reference not set to an instance of an object.
at 9xipJ.6MQkHMHFWWgxw.6MQkHMHFWWgxw() in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line

The API error at the time of failure was this:

8/17/2008 5:32:11 AM IPC send failed, ex: Port is Busy: All pipe instances are busy.

During the VC server restart we saw this for the API log:

8/18/2008 3:10:49 PM IPC send failed, ex: Failed to read from an IPC Port: The pipe has been ended.
8/18/2008 3:11:19 PM IPC send failed, ex: Failed to connect to an IPC Port: The system cannot find the file specified.

The second line "...cannot find file..." has continued to repeat, even after midnight the next day, and everything else looked normal. Tonight (it's about 2:40AM), a new API log has not been started at all so far - from old logs, it looks like this is usually written to continuously.

The questions are:

1) Will the ongoing API error (or lack of activity at all at the moment, at least that we can see by the log) have an impact; and if so, what can we do to fix it?
2) If we notice that VC is not logging to the server log after a VC restart, is there something we can do to get the logging to resume, or will we need to wait until after midnight? Is this connected to the ongoing API error?
Support
2008-08-21T09:51:50Z
First, I am not sure if you are getting this error from the API, or if you are just looking at the normal API log?

Is the Server installed on this computer?
Henrik
Support
http://www.visualcron.com 
Please like  VisualCron on facebook!
lal
  •  lal
  • No customer Topic Starter
2008-08-21T21:35:31Z
The errors are appearing in the regular API log.

Is your question whether the server is installed on the same server that the log is located at? (Yes.)
Support
2008-08-21T21:44:47Z
Ok,

the connection problem is only related to the Tray Client and has no other impact if you are not running foreground Tasks - which the Tray Client execute. It is hard to say what is going wrong. What the Server does is trying to set up a named pipe (for IPC connection). This is currently used only by the Tray Client. In the next version we will provide Client access to IPC which is about 10x faster than normal connection. Then it is interesting to get this right. But perhaps we can try that with the new beta that will be released soon as lot of small connection matters are fixed.
Henrik
Support
http://www.visualcron.com 
Please like  VisualCron on facebook!
matt.w
2008-10-17T18:25:24Z
Hello...

We're currently experiencing this same issue on one of our machines responsible for scheduling. Going back in the logs reveals that this started happening on 8/31/2008 with version 4.9.11 (we're currently on 4.9.26).

I've noticed that when this issue appears no connections, IPC or TCP/IP are allowed and jobs cease to process. A restart of the VisualCronService restores the ability to connect remotely via TCP/IP but IPC connections are still denied with the error:

10/16/2008 11:31:42 AM IPC send failed, ex: Port is Busy: All pipe instances are busy.

At that moment in the 'log_trayclient20081016.txt' a line stating "10/16/2008 11:31:42 AM Connecting to VisualCron Server" repeats several times before reporting the following error:

10/16/2008 11:32:25 AM Ping failed, ex: VisualCronAPI.Server+ReplyTimeoutException: Expected reply has not been received within time period.
at VisualCronAPI.Server.ENj6S8T4O(String )
at VisualCronAPI.Server.Ping()
at 7E4kXZ7MrfOZ05.8FEenpoGEZIB5.8FEenpoGEZIB5() in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 73

... and ...

10/16/2008 11:32:46 AM Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
at 7E4kXZ7MrfOZ05.8FEenpoGEZIB5.8L3BGnyBl1(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 120

Unfortunately this error went unchecked for almost an entire day. The following morning (today) yields these three errors in log 'log_api20081017.txt':

10/17/2008 9:14:31 AM IPC send failed, ex: Failed to read from an IPC Port: The pipe has been ended.
10/17/2008 9:15:02 AM IPC send failed, ex: Failed to connect to an IPC Port: The system cannot find the file specified.
10/17/2008 9:16:18 AM IPC send failed, ex: Port is Busy: All pipe instances are busy.

which repeat for the extent of the outage until we restarted the machine.

I'm unsure of an exact time of failure on 10/16. The logs appear to point somewhere between 8:30am and 11:30am. During that time we don't have any scheduled jobs except for the daily backup/export job.


Thanks,

Matt
Support
2008-10-17T21:41:37Z
Just to get information about where the the problem is located and bound to I wonder if it is enough to restart the VisualCron Service of if you have to restart the whole machine to get it working again? Could you send the log_serverXXX.txt from the time it was down to support@visualcron.com?
Henrik
Support
http://www.visualcron.com 
Please like  VisualCron on facebook!
ErikC
2009-12-30T12:55:50Z
I had the simular problem over here with versiopn 4.9.40 twice.

Both times I had to restart the whole machine.

12/30/2009 8:34:07 AM	Info	Job completed: _Elektronische Postbus - Verwerk modificaties
12/30/2009 8:35:07 AM	Debug	Saving Jobs
12/30/2009 8:39:18 AM	Info	User "VisualCron Tray Client User" - Logged in succesfully through IPC (c46b2ccc-4950-4ade-b7f8-2c25754f7d12)
12/30/2009 8:39:18 AM	Debug	Updating login status for: c46b2ccc-4950-4ade-b7f8-2c25754f7d12
12/30/2009 8:39:18 AM	Comm	IN: SERVERSETTINGSREQ
12/30/2009 8:39:18 AM	Comm	IN: LICENSEREQ
12/30/2009 11:43:05 AM	Debug	InternalWorkerThreadClass was created
12/30/2009 11:43:09 AM	Info	VisualCron - Server: 4.9.40 - build: 21545 - protocol: 5.0.0
12/30/2009 11:43:10 AM	Debug	Loading license file
12/30/2009 11:43:10 AM	Debug	License file was succesfully loaded
12/30/2009 11:43:10 AM	Debug	Saving license file
12/30/2009 11:43:10 AM	Debug	License file was saved successfully


I restarted the server at 11:39.

2009-12-30 08:39:13		Tray Client is starting up
2009-12-30 08:39:14		Loading exit codes
2009-12-30 08:39:16		Loaded language files.
2009-12-30 08:39:16		InitServiceController
2009-12-30 08:39:16		Running as user name: XXX.XXX, user domain name: XXX, interactive: True
2009-12-30 08:39:17		Connecting to VisualCron Server
12/30/2009 8:39:30 AM		Connecting to VisualCron Server
12/30/2009 8:39:33 AM		Connecting to VisualCron Server
12/30/2009 8:39:59 AM		Connecting to VisualCron Server
12/30/2009 8:40:02 AM		Ping failed, ex: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dxrHI2c3NarEJ() in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 73
12/30/2009 8:40:02 AM		Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dG1XEbUvgf(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 120
12/30/2009 8:40:29 AM		Ping failed, ex: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dxrHI2c3NarEJ() in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 73
12/30/2009 8:40:29 AM		Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dG1XEbUvgf(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 120
12/30/2009 8:40:32 AM		Ping failed, ex: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dxrHI2c3NarEJ() in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 73
12/30/2009 8:40:32 AM		Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dG1XEbUvgf(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 120
12/30/2009 8:40:59 AM		Ping failed, ex: System.NullReferenceException: Object reference not set to an instance of an object.
...
...
...
12/30/2009 11:38:56 AM		Starting VisualCron Client, path: F:\apps\VisualCron 4\VisualCronClient.exe
12/30/2009 11:38:59 AM		Ping failed, ex: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dxrHI2c3NarEJ() in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 73
12/30/2009 11:38:59 AM		Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dG1XEbUvgf(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 120
12/30/2009 11:39:02 AM		Ping failed, ex: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dxrHI2c3NarEJ() in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 73
12/30/2009 11:39:02 AM		Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dG1XEbUvgf(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 120
12/30/2009 11:39:03 AM		Stopping VisualCron service
12/30/2009 11:39:11 AM		Starting VisualCron service
12/30/2009 11:39:11 AM		Error starting VisualCron service, err: Cannot start service VisualCron4 on computer '.'.
12/30/2009 11:39:29 AM		Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dG1XEbUvgf(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 117
12/30/2009 11:39:32 AM		Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dG1XEbUvgf(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 117
12/30/2009 11:39:59 AM		Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dG1XEbUvgf(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 117
12/30/2009 11:40:02 AM		Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dG1XEbUvgf(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 117
12/30/2009 11:40:29 AM		Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dG1XEbUvgf(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 117
12/30/2009 11:40:32 AM		Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dG1XEbUvgf(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 117
12/30/2009 11:40:59 AM		Error in PingCheck, err: System.NullReferenceException: Object reference not set to an instance of an object.
   at iuGyVgfk.dxrHI2c3NarEJ.dG1XEbUvgf(Object ) in C:\sourcefiles\code\VCTray\Connection\ConnectionAPI.vb:line 117
12/30/2009 11:44:55 AM		Tray Client is starting up
12/30/2009 11:44:56 AM		Loading exit codes
12/30/2009 11:44:57 AM		Loaded language files.
12/30/2009 11:44:57 AM		InitServiceController
12/30/2009 11:44:57 AM		Running as user name: XXX.XXX, user domain name: XXX, interactive: True
12/30/2009 11:44:57 AM		Connecting to VisualCron Server
12/30/2009 11:45:00 AM		Connected to Server


I'm going to install the new version 5 in a few weeks (frozen period over here in the IT departement) and I hope to resolve this issue.

Regards
Erik
Uses Visualcron since 2006.
Support
2009-12-30T18:01:54Z
Yes, we had a problem in an older version with closing the "pipe" connection. This should have been resolved now.
Henrik
Support
http://www.visualcron.com 
Please like  VisualCron on facebook!
Scroll to Top