Problem Summary:
When large amount of data is imported into Spotfire Server Library, import process performance can be very slow, including very long pauses, as could be seen in Spotfire Server's impex.log file:
[2024-04-15T22:06:29,283-0700] "jobid:ff9bf19a-ab4c-45bd-add5-81cd0cba1d8c, Starting import of: library_data.part0.zip"
[2024-04-15T22:07:33,085-0700] "jobid:ff9bf19a-ab4c-45bd-add5-81cd0cba1d8c, Found 3341 items to import."
[2024-04-15T22:17:53,147-0700] "jobid:ff9bf19a-ab4c-45bd-add5-81cd0cba1d8c, 100 of 3341 items inserted."
...
[2024-04-15T23:11:19,173-0700] "jobid:ff9bf19a-ab4c-45bd-add5-81cd0cba1d8c, 1100 of 3341 items inserted."
...
[2024-04-16T01:16:17,914-0700] "jobid:ff9bf19a-ab4c-45bd-add5-81cd0cba1d8c, 1400 of 3341 items inserted."
...
[2024-04-16T03:15:24,226-0700] "jobid:ff9bf19a-ab4c-45bd-add5-81cd0cba1d8c, 1900 of 3341 items inserted."
...
[2024-04-16T05:30:18,842-0700] "jobid:ff9bf19a-ab4c-45bd-add5-81cd0cba1d8c, 2500 of 3341 items inserted."
...
[2024-04-16T08:26:00,090-0700] "jobid:ff9bf19a-ab4c-45bd-add5-81cd0cba1d8c, 3300 of 3341 items inserted."
[2024-04-16T08:41:09,882-0700] "jobid:ff9bf19a-ab4c-45bd-add5-81cd0cba1d8c, All 3341 items inserted."
[2024-04-16T08:41:09,883-0700] "jobid:ff9bf19a-ab4c-45bd-add5-81cd0cba1d8c, Handling dependencies."
[2024-04-16T08:43:20,034-0700] "jobid:ff9bf19a-ab4c-45bd-add5-81cd0cba1d8c, Post processing 4771 imported items of types: join, datasource, procedure, query, column, filter."
...
[2024-04-16T09:32:23,878-0700] "jobid:ff9bf19a-ab4c-45bd-add5-81cd0cba1d8c, Import done"
Solution:
In some situations, it's possible that "check for LDAP external users" configuration option could cause significant import process slowdowns. To resolve the issue, this LDAP check for external users should be disabled:
1. On Spotfire Server, open Spotfire Server Configuration Tool.
2. From System Status -> "Specify Configuration" section, use "Export configuration from database" to export the latest server configuration.
3. Open the exported configuration.xml file in a text editor.
4. Locate 'check-external-users' element:
<check-external-users>true</check-external-users>
Set it to 'false':
<check-external-users>false</check-external-users>
5. Save the configuration file.
6. Load the modified configuration.xml file using Spotfire Server Configuration Tool (System Status -> "Specify Configuration" -> "Load configuration from file").
7. Save the configuration to the database (Configuration > "Save configuration").
8. Restart the Spotfire Server service and run import process again.
Comments
0 comments
Article is closed for comments.