ACE Weekly 09/30/2009 - 10/06/2009 All ACE spacecraft subsystems are performing nominally. ======================================================================== Orbit/Attitude: No maneuvers have been completed this week. The next attitude maneuver is scheduled for Friday 10/16/2009. Three passes were made no-ranging following AR#G09-0053 to allow for 45 extra minutes of SSR playback. As of DOY 279, there have been 13 ranging passes (4 Madrid, 4 Canberra, 5 Goldstone) in the 13 days since SK-52. ======================================================================= OCRs: DOY 265 (09/22/2009) GND-199 Update Symantec AntiVirus Symantec AntiVirus was removed from the SLE linux workstations on 10/01/2009. The AC1SLE1 workstation was restored from backup after AR#G09-0053. ======================================================================== Activities: DOY 279 10/06/2009 - Multi-Mission Operations Center (MMOC) Test There were no problems receiving telemetry or sending commands with DSS-45. The spacecraft was commanded to high-rate and SSR data from the previous pass was redumped. The SSR TwosComplementChecksum was correctly populated by ITOS. ACE reformatted data was forwarded for NOAA space weather for the entire pass. Data Capture: 99.99% DOY 270-277 2009 31 second gap during SSR failover (DOY 275 2009 06:31:19-06:31:49) After AR#G09-0053 (Thursday 10/1/2009), the SSR playback will not be caught up until Saturday 10/10/2009. Three passes have been converted to no-ranging to allow 45 extra minutes of SSR playback. DSN availability will improve in the coming week. DSS-24 painting is scheduled to be completed 10/6/2009. DSS-54 ACQ AID INSTALL is scheduled to be completed 10/4/2009. LCROSS lunar impact is scheduled for 10/9/2009. ======================================================================== Anomalies: DOY 274 10/01/2009 S-ACE-0462 G09-0053 ACE SLE/Symantec AntiVirus Symantec AntiVirus was installed on the SLE computers on 09/30/2009. The SLE did not start for the pass on 10/01/2009. SysAdmins and SLE developer analyzed the problem. AntiVirus uninstall did not resolve the problem. The SLE developer was able to start SLE manually. After the pass, the AC1SLE1 workstation was restored from backup and SLE now starts without problems. Impact: SLE was started manually with 85 minutes left in the pass. However, AR#G09-0054, caused the pass to be lost. DOY 274 10/01/2009 S-ACE-0463 G09-0054 TPOCC Telecommand Failure In the first 30 minutes of the pass, TPOCC Telecommand socket had disconnected. The reason is unknown. It may be unrelated to the SLE/AntiVirus problems since it occurred on a separate workstation and before any SLE troubleshooting had begun. Impact: At the time of the TPOCC failure, resources were focusing on the SLE problems. After the SLE problems were resolved, there was insufficient time to restart TPOCC and start the playback. The pass was lost; SSR failover occurred on DOY 275. SSR playback will be behind schedule for 10 days. DOY 277 10/04/2009 S-ACE-0464 S09-0007 ROBOTT Timing/SSR Stuck Plbk The MOC automation software (ROBOTT/C&C) is designed to Idle the SSR 15 minutes before End Of Track and perform redumps with the time remaining. However, the automation software failed to execute this procedure. The SSR was still in playback when the spacecraft transitioned to low-rate. When this occurs, the SSR remains stuck in playback mode. Impact: The ground procedures are designed to handle this contingency by idling the SSR at the beginning of the next support and redumping any missing data. This has occurred 3 other times in the past (01/12/2005 AR#S05-0002; 12/01/2005 AR#G05-0148; 11/04/2008 AR#G08-0109). DOY 278 10/05/2009 S-ACE-0465 G09-0055 ROBOTT Froze/Proc Re-Executed The MOC automation software (ROBOTT/C&C) froze during initial commanding. ROBOTT/C&C was restarted and re-executed the initial commanding sequence. Impact: The ground procedures are designed to handle this contingency. The SSR playback in progress was not stopped.