Citrix and Sophos products have been impacted by leap year flaws, leading to unexpected problems in their products.
Leap years solve the synchronization problem caused by the Gregorian calendar measuring a year in 365 days, while the astronomical year is 365.24 days. During leap years, an extra day is added to February, the 29th, to correct this discrepancy.
However, the leap-year solution can cause problems in computer systems because their software may not be programmed to account for that extra day, causing unexpected errors.
Citrix hit with leap year bug
The first signs of problems became apparent earlier today when multiple users reported on the vendor's support forums that the Citrix HDX HTML5 Video Redirection Service stopped working on all Virtual Delivery Agent (VDA) machines.
The service is part of Citrix's suite of virtualization products, used in remote work, education, content delivery, and multimedia applications. It enhances the user experience when streaming video content in a virtual desktop or app session via playback optimizations that redirect HTML5 video processing from the server to the client.
Users reported that the service termination affected environments with various configurations, matching a problem described on a thread first created on February 29th, 2020, when the last leap year occurred.
Soon, users made the connection between today's date and the thread's creation, realizing that they were dealing with a leap-year bug causing unexpected behavior.
Some users have suggested changing the system date back to February 28th, 2024, and quickly restarting the Citrix service without rebooting, which reportedly worked.
Unfortunately, this solution is impractical for those managing many servers, as they have to manually perform the time change for each of the impacted endpoints, and rebooting servers could disrupt operations.
Eventually, Citrix responded to the user reports with a bulletin, saying that the issue was triggered only after a restart of the VDA, with the vendor suggesting the following workaround until a permanent fix is ready:
- Stop the time service so that it does not automatically change to the correct date
- Change the date to March 1st 2024
- Stop and start the CtxHdxWebSocketService (Citrix HDX HTML5 Video Redirection Service)
- Start the time service again.
Alternatively, users can run the following command through an elevated command prompt as an administrator:
net stop w32time & date 03-01-2024 & net start CtxHdxWebSocketService & net start w32time
Citrix says its engineering team is working on a fix for the issue so that users won't have this problem during the next leap year, on February 29th, 2028.
It is unclear if this "glitch" will resolve itself tomorrow, March 1st, 2024, or if it will cause a permanent hang that might persist until an official fix is issued.
Sophos impacted too
Sophos also announced that Sophos Endpoint, Sophos Server, and Sophos Home may experience problems in the form of unexpected security certification validation warnings for HTTPS websites if devices are rebooted on February 29th, 2024.
This bug only pops up if the 'SSL/TLS decryption of HTTPS websites' setting is enabled in the antivirus software, which is used to decrypt secure web connections so that the contents can be scanned for malicious scripts. This setting is disabled by default for all users of the security software.
The vendor has provided various solutions for the impacted products, summarized as follows:
- Sophos Endpoint - Sophos automatically disabled SSL/TLS decryption for all customers to prevent issues. An upcoming software update will fix this, after which users should revert any manual decryption disablements.
- Sophos Server version 2023.1.x - If facing issues, disable SSL/TLS decryption manually; from March 1st, 2024, rebooting servers will address the problem, and settings should be reverted as desired.
- Sophos Server versions 2023.2.x - Sophos has disabled SSL/TLS decryption via policy override for all. A software update is planned to revert this change, and users should subsequently adjust their settings back if they had manually disabled decryption.
- Sophos Home - Users experiencing issues should disable SSL/TLS decryption. It is recommended to reboot and re-enable decryption settings on or after March 1st, 2024.
Worldwide leap year problems
The leap year has caused multiple issues with computer systems worldwide today, with the most notable maybe being an outage on the self-service fueling stations of Allied Petroleum in New Zealand.
Another victim of a leap year glitch appears to be Sweden’s leading grocery store retailer, ICA, which has reportedly been unable to accept card payments today "due to an internal problem caused by the date."
Also, reports from Japan say the leap year has disrupted driver's license issuance in four prefectures, forcing the authorities to perform an emergency transition to non-impacted systems.
Comments
stryqx - 4 months ago
Google Maps Timeline and Google Photos were both doing some off-by-one calculations when used on 29/02, so these can be added to the list as well.
cs_280zx - 4 months ago
Of course Citrix was impacted. Citrix is rubbish
tverweij - 4 months ago
24 years later.
And we still didn't learn.
tech_engineer - 4 months ago
We are in 2024, with advanced super computers, many programming languages, all the studies and information on how to make everything, even AI that can write code, and yet software out there can't still handle leap years or correct daylight savings :/