Client crashes with 'System.UnauthorizedAccessException' errors in the application event log.

Client crashes with 'System.UnauthorizedAccessException' errors in the application event log.

When working in the client, under some rare conditions the TIBCO Spotfire Analyst client crashes with no errors shown or logged in the Spotfire log file.
Inspecting the application event log you can see these kinds of errors:
 

Spotfire.Dxp.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: System.UnauthorizedAccessException
  at System.IO.Directory.DeleteHelper(System.String, System.String, Boolean, Boolean, WIN32_FIND_DATA ByRef)
  at System.IO.Directory.Delete(System.String, System.String, Boolean, Boolean)
  at Spotfire.Dxp.Application.Insights.DataCorrelation.DataCorrelationInsightModule.<Dispose>b__16_0()
  at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
  at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
  at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
  at System.Threading.ThreadHelper.ThreadStart()