Spotfire Server: How to calculate engine.queue.size, engine.session.max and logical processors in Spotfire TERR service

Resolution

If your CPU is capable of hyperthreading,  each core can handle two threads so that an 8-core CPU will have 8 * 2 = 16 logical processors. In Windows Task Manager, click on the performance tab and check the logical processors/ virtual processors count:

Note:

• Virtual Processors on the virtual machine are not always the same as the Logical Processors - it’s a physical processor TimeSlot that will be given to the virtual machine. Please refer to the attached referenced link for more info.
• In Linux OS, the CPU(s) value indicates the number of logical cores i.e. logical processors. the "lscpu" command displays the result.

Here's the method to calculate the engine-queue-size and engine-session-max parameters:

• default engine.queue.size should be 4 ( 0.25 * 16 logical processors), i.e. one-quarter of the number of logical processors on the host as per the document.
• default engine.session.max should be 15 (16 logical processors -1), It is the capacity that you see on the "Monitoring and Diagnostics".

The total number of engines that can run simultaneously is the sum of engine.session.max + engine.queue.size. i.e. 15+4 = 19.
You can think of engine-queue-size as a pool of pre-warmed idle engines which are assigned when a new (engine) session is created so it is a balance of inflow of new sessions vs "engine warmup time".

IMPORTANT: If you do not set these values, the services will take the default values based on the logical processors you have on the server machine.
 

On Spotfire Server's "Monitoring and Diagnostics" page, the "Capacity" column in the Python/ TERR/ R Service instances is the engine session max.

Note:  Similarly, the same calculation method is used for the R, TERR, and Python services. Please refer to the reference documents links attached.