Some of the Secondary SUM's not updating from Primary

We have 9 secondary SUM's updating from the 1 Primary SUM. Until recently, everything was working fine, but noticed 3 Secondaries not updating. Tried restarting servers, services etc. but to no avail.

I re-installed the 3 SUM's and immediately after they were detected in the EC, 2 of them updated fine, and the 3rd stuck on last updated "Never" 

I noticed the following:

1. 2 of the SUM's details display incorrect IP address in the EC. They have 169.x.x.x. assigned IP's even though they are configured correctly with static IP's.

2. If i edit the  3 x problematic SUM's login credentials under sources tab, they eventually time out. The working SUM's have exactly the same username\password configured but they are accepted.

3. Problematic servers can access UNC path to the primary SUM fine and share permission also checked out.

4. Primary SUM sync's perfectly with external update source.

5. password for updating is not locked out.

 

 

  • Hello Quicksilver,

    so the SUMs get the updates from the parent via UNC, correct?

    they eventually time out
    please restart the Sophos Update Manger service on a "problem" SUM (perhaps the one with Never), then edit the Sources, after it has timed out check the latest SUMTrace log
    in %ProgramData%\Sophos\Update Manager\Logs\.

    169.x.x.x
    The address RMS 4.x reports should better reflect the IP address of the managed client. You could check on the SUM with netstat -n|find "<SECserverIP>:8194".

    Christian

  • In reply to QC:

    Hi Christian,

    All the secondary SUM's get their updates via UNC from parent. Only the 3 that i have reinstalled time out. The other 6 do not time out and accepts the configurations with exactly the same credentials. 

     

    extract from the sumtracelog on SUM that has never updated after servcie restart:

    2017-10-05 12:14:26 : Cmd-ALL << [S0008][F26F7EC0-1302-4DA7-8B6B-A5383051D41A][RECOMMENDED] Generation of CID from package 'F26F7EC0-1302-4DA7-8B6B-A5383051D41A' with requested version 'RECOMMENDED' was successful.
    2017-10-05 12:14:26 : Cmd-ALL << [I0009][ActionGenerateCid-Sub0][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionGenerateCid-Sub0' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' succeeded!
    2017-10-05 12:14:26 : Cmd-ALL << [I1021][ActionDeployCids-Sub0-0][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionDeployCids-Sub0-0' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' started...
    2017-10-05 12:14:26 : Cmd-ALL << [I0010][C:\ProgramData\Sophos\Update Manager\Update Manager\CIDs\S000][SAVSCFXP][F26F7EC0-1302-4DA7-8B6B-A5383051D41A][RECOMMENDED] The deployment to share 'C:\ProgramData\Sophos\Update Manager\Update Manager\CIDs\S000' was skipped because the version was unchanged.
    2017-10-05 12:14:26 : Cmd-ALL << [I0009][ActionDeployCids-Sub0-0][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionDeployCids-Sub0-0' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' succeeded!
    2017-10-05 12:14:26 : Cmd-ALL << [I1021][ActionGatherCurrencyData-Sub1][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionGatherCurrencyData-Sub1' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' started...
    2017-10-05 12:14:26 : GatherCurrencyData: Considering payload Payload-Sub1...
    2017-10-05 12:14:26 : GatherCurrencyData: Payload version information has changed, proceeding.
    2017-10-05 12:14:26 : GatherCurrencyData: Obtaining currency data...
    2017-10-05 12:14:27 : GatherCurrencyData: ReleaseHasRole(EPS) threw an exception, returning false. Details: Attribute not found.
    2017-10-05 12:14:27 : GatherCurrencyData: No relevant attributes found for this payload.
    2017-10-05 12:14:27 : Cmd-ALL << [I0009][ActionGatherCurrencyData-Sub1][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionGatherCurrencyData-Sub1' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' succeeded!
    2017-10-05 12:14:27 : Cmd-ALL << [I1021][ActionGatherCurrencyData-Sub2][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionGatherCurrencyData-Sub2' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' started...
    2017-10-05 12:14:27 : GatherCurrencyData: Considering payload Payload-Sub2...
    2017-10-05 12:14:27 : GatherCurrencyData: Payload version information has changed, proceeding.
    2017-10-05 12:14:27 : GatherCurrencyData: Obtaining currency data...
    2017-10-05 12:14:27 : GatherCurrencyData: ReleaseHasRole(EPS) threw an exception, returning false. Details: Attribute not found.
    2017-10-05 12:14:27 : GatherCurrencyData: No relevant attributes found for this payload.
    2017-10-05 12:14:27 : Cmd-ALL << [I0009][ActionGatherCurrencyData-Sub2][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionGatherCurrencyData-Sub2' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' succeeded!
    2017-10-05 12:14:27 : Cmd-ALL << [I1021][ActionGatherCurrencyData-SDDM][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionGatherCurrencyData-SDDM' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' started...
    2017-10-05 12:14:27 : GatherCurrencyData: Considering payload Payload-SDDM...
    2017-10-05 12:14:27 : GatherCurrencyData: Payload version information has changed, proceeding.
    2017-10-05 12:14:27 : GatherCurrencyData: Obtaining currency data...
    2017-10-05 12:14:27 : GatherCurrencyData: ReleaseHasRole(EPS) threw an exception, returning false. Details: Attribute not found.
    2017-10-05 12:14:27 : GatherCurrencyData: No relevant attributes found for this payload.
    2017-10-05 12:14:27 : Cmd-ALL << [I0009][ActionGatherCurrencyData-SDDM][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionGatherCurrencyData-SDDM' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' succeeded!
    2017-10-05 12:14:27 : Cmd-ALL << [I1021][ActionDecodeEverything-SDDM][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionDecodeEverything-SDDM' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' started...
    2017-10-05 12:14:28 : Cmd-ALL << [S001A][C:\ProgramData\Sophos\Update Manager\Working\.\Decoded-SDDM\A845A8B5-6532-4EF1-B19E-1DB2B3CB73D1][sum][A845A8B5-6532-4EF1-B19E-1DB2B3CB73D1][RECOMMENDED] The decode operation was successful (and NULL).
    2017-10-05 12:14:28 : Cmd-ALL << [S0013][C:\ProgramData\Sophos\Update Manager\Working\.\Decoded-SDDM] The decode operation was successful, and no new data files were decoded.
    2017-10-05 12:14:28 : Cmd-ALL << [I0009][ActionDecodeEverything-SDDM][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionDecodeEverything-SDDM' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' succeeded!
    2017-10-05 12:14:28 : Cmd-ALL << [I1021][ActionSelfUpdate-SDDM][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionSelfUpdate-SDDM' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' started...
    2017-10-05 12:14:28 : SelfUpdateOperation::Execute has started.
    2017-10-05 12:14:28 : SelfUpdateOperation: No previous self-update to clean up, starting a new one.
    2017-10-05 12:14:28 : SelfUpdateOperation: Evaluating whether SUM needs to self-update...
    2017-10-05 12:14:28 : SelfUpdateOperation: Self update not required, exiting.
    2017-10-05 12:14:28 : Cmd-ALL << [S001C][Payload-SDDM][67.7] Self-update from payload 'Payload-SDDM' with version 67.7 skipped, because the version has not changed.
    2017-10-05 12:14:28 : Cmd-ALL << [I0009][ActionSelfUpdate-SDDM][DispatcherPrograms-2017-10-05T10-13-52-1] Action 'ActionSelfUpdate-SDDM' with caller 'DispatcherPrograms-2017-10-05T10-13-52-1' succeeded!
    2017-10-05 12:14:28 : Cmd-ALL << [S000A][DispatcherPrograms-2017-10-05T10-13-52-1] Event with dispatcher ID 'DispatcherPrograms-2017-10-05T10-13-52-1' completed successfully.
    2017-10-05 12:14:28 : Cmd-ALL << [I1020][DispatcherPrograms-2017-10-05T10-13-52-1] All events with dispatcher ID 'DispatcherPrograms-2017-10-05T10-13-52-1' complete.
    2017-10-05 12:14:28 : Cmd-Sock-684 >> DumpConfigXML default
    2017-10-05 12:14:28 : Cmd-Sock-684 << [R0000][<?xml version="1.0" encoding="utf-8" ?><Config><Action><ID>ActionDecodeEverything-SDDM</ID><Operation>Decode</Operation><Payload>Payload-SDDM</Payload><BaseDecodePath>./Decoded-SDDM</BaseDecodePath></Action><Action><ID>ActionDecodeEverything-Sub0</ID><Operation>Decode</Operation><Payload>Payload-Sub0</Payload><BaseDecodePath>./Decoded-Sub0</BaseDecodePath></Action><Action><ID>ActionDeployCids-Sub0-0</ID><Operation>CIDDeploy</Operation><Library>CIDGen.dll</Library><Dependency>ActionGenerateCid-Sub0</Dependency><CIDGenAction>ActionGenerateCid-Sub0</CIDGenAction><NewCidDir>C:\ProgramData\Sophos\Update Manager\Update Manager\CIDs\S000</NewCidDir><Username></Username><Password obfuscated="true"></Password><Security>Sizes</Security><MakeBootable></MakeBootable></Action><Action><ID>ActionGatherCurrencyData-SDDM</ID><Operation>GatherCurrencyData</Operation><Payload>Payload-SDDM</Payload><DisableReentrancyOptimisation></DisableReentrancyOptimisation></Action><Action><ID>ActionGatherCurrencyData-Sub0</ID><Operation>GatherCurrencyData</Operation><Payload>Payload-Sub0</Payload><DisableReentrancyOptimisation></DisableReentrancyOptimisation></Action><Action><ID>ActionGatherCurrencyData-Sub1</ID><Operation>GatherCurrencyData</Operation><Payload>Payload-Sub1</Payload><DisableReentrancyOptimisation></DisableReentrancyOptimisation></Action><Action><ID>ActionGatherCurrencyData-Sub2</ID><Operation>GatherCurrencyData</Operation><Payload>Payload-Sub2</Payload><DisableReentrancyOptimisation></DisableReentrancyOptimisation></Action><Action><ID>ActionGenerateCid-Sub0</ID><Operation>CIDGenerate</Operation><Library>CIDGen.dll</Library><Dependency>ActionDecodeEverything-Sub0</Dependency><DecodeAction>ActionDecodeEverything-Sub0</DecodeAction><Payload>Payload-Sub0</Payload></Action><Action><ID>ActionSelfUpdate-SDDM</ID><Operation>SelfUpdate</Operation><Dependency>ActionDecodeEverything-SDDM</Dependency><DecodeAction>ActionDecodeEverything-SDDM</DecodeAction><Payload>Payload-SDDM</Payload></Action><Action><ID>ActionSyncPrograms</ID><Operation>Synchronise</Operation><Subscription>SubscriptionGlobal</Subscription></Action><Action><ID>ActionSyncSupplements</ID><Operation>Synchronise</Operation><Subscription>SubscriptionGlobal</Subscription><SupplementsOnly></SupplementsOnly></Action><Action><ID>ActionUpdateLogViewerDictionaries</ID><CorrelationId>0</CorrelationId><Operation>UpdateLogViewerDictionary</Operation><Uri>\\IDTHQAV02\SophosUpdate\Warehouse</Uri><TopLevelCatalogue>sdds.local</TopLevelCatalogue><User>IDT\SophosIDT</User><Password obfuscated="true">BwjpgoSGsX3z3+Qw3V8RdORCKs8VnmDA1y4=</Password></Action><Action><ID>ActionUpdateMetadata</ID><CorrelationId>0</CorrelationId><Operation>WarehouseStatus</Operation><Uri>\\IDTHQAV02\SophosUpdate\Warehouse</Uri><TopLevelCatalogue>sdds.local</TopLevelCatalogue><User>IDT\SophosIDT</User><Password obfuscated="true">BwjpgoSGsX3z3+Qw3V8RdORCKs8VnmDA1y4=</Password></Action><Dispatcher><ID>DispatcherPrograms</ID><Type>Programs</Type><Schedule>SchedulePrograms</Schedule><Event>EventUpdateMetadata</Event><Event>EventPrograms</Event></Dispatcher><Dispatcher><ID>DispatcherSupplements</ID><Type>Supplements</Type><Schedule>ScheduleSupplements</Schedule><Event>EventSupplements</Event></Dispatcher><Event><ID>EventPrograms</ID><Action>ActionUpdateLogViewerDictionaries</Action><Action>ActionSyncPrograms</Action><Action>ActionGatherCurrencyData-Sub0</Action><Action>ActionDecodeEverything-Sub0</Action><Action>ActionGenerateCid-Sub0</Action><Action>ActionDeployCids-Sub0-0</Action><Action>ActionGatherCurrencyData-Sub1</Action><Action>ActionGatherCurrencyData-Sub2</Action><Action>ActionGatherCurrencyData-SDDM</Action><Action>ActionDecodeEverything-SDDM</Action><Action>ActionSelfUpdate-SDDM</Action></Event><Event><ID>EventSupplements</ID><Action>ActionSyncSupplements</Action><Action>ActionGatherCurrencyData-Sub0</Action><Action>ActionDecodeEverything-Sub0</Action><Action>ActionGenerateCid-Sub0</Action><Action>ActionDeployCids-Sub0-0</Action><Action>ActionGatherCurrencyData-Sub1</Action><Action>ActionGatherCurrencyData-Sub2</Action><Action>ActionGatherCurrencyData-SDDM</Action><Action>ActionDecodeEverything-SDDM</Action></Event><Event><ID>EventUpdateMetadata</ID><Action>ActionUpdateMetadata</Action></Event><LogSettings><ID>LangIndLog</ID><MaxAge>20</MaxAge><MaxSize>500</MaxSize></LogSettings><Payload><ID>Payload-SDDM</ID><Warehouse>sdds.local</Warehouse><RigidName>A845A8B5-6532-4EF1-B19E-1DB2B3CB73D1</RigidName><Version>RECOMMENDED</Version><BaseVersion>1</BaseVersion></Payload><Payload><ID>Payload-Sub0</ID><Warehouse>sdds.local</Warehouse><RigidName>F26F7EC0-1302-4DA7-8B6B-A5383051D41A</RigidName><Version>RECOMMENDED</Version><BaseVersion>10</BaseVersion></Payload><Payload><ID>Payload-Sub1</ID><Warehouse>sdds.local</Warehouse><RigidName>7D48A012-0C64-4F21-BA27-A9CEDF442749</RigidName><Version>0.0.0</Version><BaseVersion></BaseVersion></Payload><Payload><ID>Payload-Sub2</ID><Warehouse>sdds.local</Warehouse><RigidName>2DE69C24-D975-47b2-8D2F-6BEA861A9C75</RigidName><Version>RECOMMENDED</Version><BaseVersion>3</BaseVersion></Payload><Schedule><ID>SchedulePrograms</ID><TimeBlock>TimeBlock-Programs-0</TimeBlock></Schedule><Schedule><ID>ScheduleSupplements</ID><TimeBlock>TimeBlock-Supplements-0</TimeBlock></Schedule><Subscription><ID>SubscriptionGlobal</ID><UpdateSource>UpdateSource0</UpdateSource><Payload>Payload-Sub0</Payload><Payload>Payload-Sub1</Payload><Payload>Payload-Sub2</Payload><Payload>Payload-SDDM</Payload></Subscription><TimeBlock><ID>TimeBlock-Programs-0</ID><StartTime>0:00</StartTime><Duration>24:00</Duration><Interval>1:00</Interval></TimeBlock><TimeBlock><ID>TimeBlock-Supplements-0</ID><StartTime>0:00</StartTime><Duration>24:00</Duration><Interval>0:10</Interval></TimeBlock><UpdateSource><ID>UpdateSource0</ID><Path>\\IDTHQAV02\SophosUpdate\Warehouse</Path><UserName>IDT\SophosIDT</UserName><Password obfuscated="true">BwjpgoSGsX3z3+Qw3V8RdORCKs8VnmDA1y4=</Password><Ordinal>0</Ordinal></UpdateSource></Config>] Dumped 29 objects.
    2017-10-05 12:14:28 : Cmd-Sock-684 <<
    2017-10-05 12:14:28 : Cmd-Sock-684 >> DumpDefaultTargetSite
    2017-10-05 12:14:28 : Cmd-Sock-684 << [R0000][C:\ProgramData\Sophos\Update Manager\Update Manager\][\\IDTGAUDC01\SophosUpdate][IDT\SophosIDT][BwjYmPjKg0yJR2n3OupYRQl/6VR3Db6VWgk=] Local path: C:\ProgramData\Sophos\Update Manager\Update Manager\ Remote path: \\IDTGAUDC01\SophosUpdate Username: IDT\SophosIDT Obfuscated password: BwjYmPjKg0yJR2n3OupYRQl/6VR3Db6VWgk=
    2017-10-05 12:14:28 : Cmd-Sock-684 <<
    2017-10-05 12:14:53 : Thu Oct 05 12:14:53 2017 - No action
    2017-10-05 12:14:53 : Thu Oct 05 12:14:53 2017 - No action
    2017-10-05 12:14:53 : Thu Oct 05 12:14:53 2017 - No action

  • In reply to Quicksilver:

    Hello Quicksilver,

    according to this log the SUM does update its only subscription to SAVXP. There is no indication of an error.
    This is why I asked that you edit the sources and check the corresponding part of the log. The edit should create and execute a CheckWarehouseEvent (something that can easily be identified in the log) on the SUM. It should show whether communication or an issue with accessing the source is the cause for the timeout. From the above log I'd assume the former but a  test should give a more definite answer.

    Christian

  • In reply to Quicksilver:

    Christian,

    Some more info on 1 of the troublesome SUM's:

     

    2017/10/05 12:05:02 PM Error Event for dispatcher 'DispatcherSupplements-2017-10-05T10-04-56-20' failed to execute.
    2017/10/05 12:05:02 PM Error Action 'ActionDecodeEverything-SDDM' failed.
    2017/10/05 12:05:02 PM Error Decoding of product release Sophos Update Manager version RECOMMENDED was not done because the synchronization failed.
    2017/10/05 12:05:02 PM Error Version information for product 'Sophos Update Manager' was not gathered by dispatcher 'DispatcherSupplements-2017-10-05T10-04-56-20', as the last synchronization of that product failed.
    2017/10/05 12:05:02 PM Error Version information for product 'Sophos Patch Server' was not gathered by dispatcher 'DispatcherSupplements-2017-10-05T10-04-56-20', as the last synchronization of that product failed.
    2017/10/05 12:05:02 PM Error Version information for product 'Sophos Enterprise Console' was not gathered by dispatcher 'DispatcherSupplements-2017-10-05T10-04-56-20', as the last synchronization of that product failed.
    2017/10/05 12:05:02 PM Error Action 'ActionDecodeEverything-Sub0' failed.
    2017/10/05 12:05:02 PM Error Decoding of product release Windows Endpoint Security and Control version RECOMMENDED was not done because the synchronization failed.
    2017/10/05 12:05:01 PM Error Version information for product 'Windows Endpoint Security and Control' was not gathered by dispatcher 'DispatcherSupplements-2017-10-05T10-04-56-20', as the last synchronization of that product failed.
    2017/10/05 12:05:01 PM Error Action 'ActionSyncSupplements' failed.
    2017/10/05 12:05:01 PM Error The protection data for product release 'Sophos Update Manager' could not be updated because the synchronize operation has failed due to an earlier error.
    2017/10/05 12:05:01 PM Error The protection data for product release 'Sophos Patch Server' could not be updated because the synchronize operation has failed due to an earlier error.
    2017/10/05 12:05:01 PM Error The protection data for product release 'Sophos Enterprise Console' could not be updated because the synchronize operation has failed due to an earlier error.
    2017/10/05 12:05:01 PM Error The protection data for product release 'Windows Endpoint Security and Control' could not be updated because the synchronize operation has failed due to an earlier error.

  • In reply to Quicksilver:

    Hello Quicksilver,

    please don't post more or less arbitrary parts of the logs. There are errors but they are talking about due to an earlier error and because the synchronization failed.
    If edit sources is unfeasible then search the SUMTrace log for the string Cmd-ALL << [I1018][DispatcherPrograms. This indicates the start of an update attempt. The error is "somewhere further down", a synchronization error should show some ten lines after Cmd-ALL << [I1021][ActionSyncPrograms].

    Christian

  • In reply to QC:

    Christian,

     

    The SUMtrace log depicts only successful synchronization events after the Cmd-ALL << [I1021][ActionSyncPrograms], no error entries.

  • In reply to Quicksilver:

    Hello Quicksilver,

    so the 1 where Some more info on 1 (which contained synchronization errors) is from no longer shows errors?
    The SUMs still showing as not updating or Never?

    Christian