MicroStrategy ONE

Memory Usage Breakdown

When the Intelligence server enters Memory Contract Manager (MCM) denial state or shuts down due to an extended timeout limit of the MCM denial state, it may be difficult to understand and troubleshoot the issue. Starting in MicroStrategy 2021 Update 1, the overall memory usage breakdown information is logged by default in the DSSErrors.log to help troubleshoot such issue.

When is it Logged? 

A breakdown of memory usage is logged when:

  • The Intelligence server enters MCM denial state for the first time. There are two cases of this:

    1. The Intelligence server has never entered MCM denial state and this is the first time doing so.

    2. The Intelligence server has entered MCM denial state, but recovers and then works as expected. After some time, it enters MCM denial state again.

    However, if the Intelligence server has been in MCM denial state, to the subsequent continuous request rejects, a memory usage breakdown is not logged.

  • The Intelligence server shuts down due to being in MCM denial state for an extended time.

    If the Intelligence server stalls for too long due to MCM denial, it shuts down. For this shutdown, a memory usage breakdown is logged as well.

What Information is Collected?

The Intelligence server does two things when outputting memory usage breakdown information in DSSErrors.log.

  • Collect system memory usage counters and format them in a string. Key system memory counters are collected and divided into two parts:

    1. Virtual memory usage counters:

      • Total System Virtual Memory (GB)
      • Total In Use Virtual Memory for Other Processes (MB)
      • Total In Use Virtual Memory for Intelligence Server (MB) Including MMF Virtual Size
      • Total SmartHeap Cached Memory Utilization (MB)
      • Max Memory Available to the Intelligence Server Based on the Memory Contract Manager (MB)
    2. Physical memory usage counters:
      • Total System Physical Memory (GB)
      • Total In Use Physical Memory for Intelligence Server (MB)
      • Total In Use Physical Memory for Other Processes (MB)

      • Total Physical Memory for File Caches (MB)

        This is specific to Linux.

  • Collect object cache related memory usage counters and format them in a string. Key object cache related memory counters are collected from the Performance Monitor. These counters include:
    • Report Caches In Memory (MB)
    • Document Caches In Memory (MB)
    • Cube Caches In Memory (MB)
    • Object Server Caches In Memory (MB)
    • Element Server Caches In Memory (MB)
    • Total Working Set Memory Utilization (MB)
    • Total Size Of Physical Memory Used For Memory Mapped Files (MB)
    • MMF Virtual Memory Size (MB)
    • Cube Size Growth In Memory Including Indexes (MB)
      • Memory Used by Cube Element Blocks (KB)
      • Memory Used by Cube Index Keys (KB)
      • Memory Used by Cube Rowmaps (KB)

    The following table maps the item names in the memory usage breakdown information to the names in the MicroStrategy Diagnostics and Performance Logging Tool.

    Memory Usage Breakdown Information in DSSErros.log

    MicroStrategy Diagnostics and Performance Logging Tool

    Report Caches In Memory (MB)

    Memory Used by Report Caches (MB)

    Document Caches In Memory (MB)

    Total Size (in MB) of Document Caches Loaded in Memory

    Cube Caches In Memory (MB)

    Total Size (in MB) of Cubes Loaded in Memory

    Object Server Caches In Memory (MB)

    Object Server Cache (KB)

    Element Server Caches In Memory (MB)

    Element Server Cache (KB)

    Cube Components Using Memory-mapped Files (MB)

    Total Size of Physical Memory (Workingset/RSS) Used for Memory Mapped Files (MB)

     

    Total Working Set Memory Utilization (MB)

    Working Set Cache RAM Usage (MB)

    MMF Virtual Memory Size (MB)

    Total Memory Mapped Files Size (MB)

    Cube Size Growth In Memory Including Indexes (MB)

     

    Memory Used by Cube Element Blocks (KB)

    Memory Used by Cube Index Keys (KB)

    Memory Used by Cube Rowmaps(KB)

All collected memory counters are formatted to a message. In the messages, the counters are hierarchically ordered.

The following are complete output examples of the memory breakdown information on Linux and Windows.

All values in the MCM memory breakdown information are rounded to the integer part. For example, the total system physical memory of 15.999 GB appears as 15 GB in the memory breakdown information.

  • Windows
  • Linux
Copy 
2021-02-20 03:18:00.008-05:00 [HOST:tec-l-002717][SERVER:CastorServer][PID:27649][THR:139735680997120][Kernel][Info][UID:0][SID:0][OID:0] IServer enters MCM denial state. The breakdown of memory usage is:
Total System Physical Memory(GB): 11
    Total In Use Physical Memory For Intelligence Server(MB): 1075
        Total Size Of Physical Memory Used For Memory Mapped Files(MB): 38
    Total In Use Physical Memory For Other Processes(MB): 1706
    Total Physical Memory For File Cache(MB): 1579
Total System Virtual Memory(GB): 21
    Total In Use Virtual Memory For Other Processes(MB): 3646
    Max memory Available to the Intelligence Server Based On Memory Contract Manager(MB): 0
    Total In Use Virtual Memory For Intelligence Server(MB): 3323
         Report Caches In Memory(MB): 0
         Document Caches In Memory(MB): 0
         Cube Caches In Memory(MB): 255
            Cube Size Growth In Memory Including Indexes(MB): 0
            MMF Virtual Memory Size(MB): 53
        Object Server Caches In Memory(MB): 27
        Element Server Caches In Memory(MB): 0
        Total Working Set Memory Utilization(MB): 0
        Total SmartHeap Cached Memory Utilization(MB):95
        Other Memory In Intelligence Server(MB): 2946
Note: Other memory In Intelligence Server may include part of the memory for runtime jobs that is not included in the above counters
Working set includes runtime memory necessary for Document execution While the Document instance is in use
SmartHeap cache memory is used for performance improvements
Copy 
2021-02-20 03:19:00.009-05:00 [HOST:tec-l-002717][SERVER:CastorServer][PID:27649][THR:139735680997120][Kernel][Info][UID:0][SID:0][OID:0] IServer will shut down soon as the time of MCM denial exceeds the limit(timeout setting is 30). The breakdown of memory usage is:
Total System Physical Memory(GB): 11
    Total In Use Physical Memory For Intelligence Server(MB): 1075
        Total Size Of Physical Memory Used For Memory Mapped Files(MB): 38
    Total In Use Physical Memory For Other Processes(MB): 1706
    Total Physical Memory For File Cache(MB): 1579
Total System Virtual Memory(GB): 21
    Total In Use Virtual Memory For Other Processes(MB): 3646
    Max memory Available to the Intelligence Server Based On Memory Contract Manager(MB): 0
    Total In Use Virtual Memory For Intelligence Server(MB): 3323
        Report Caches In Memory(MB): 0
        Document Caches In Memory(MB): 0
        Cube Caches In Memory(MB): 255
            Cube Size Growth In Memory Including Indexes(MB): 0
            MMF Virtual Memory Size(MB): 53
    Object Server Caches In Memory(MB): 27
    Element Server Caches In Memory(MB): 0
    Total Working Set Memory Utilization(MB): 0
    Total SmartHeap Cached Memory Utilization(MB):95
    Other Memory In Intelligence Server(MB): 2946
Note: Other memory In Intelligence Server may include part of the memory for runtime jobs that is not included in the above counters
Working set includes runtime memory necessary for Document execution While the Document instance is in use
SmartHeap cache memory is used for performance improvements
Copy 
When the Intelligence server enters MCM denial state
                     2021-02-20 04:14:08.452-05:00 [HOST:tec-w-012230][SERVER:CastorServer][PID:12596][THR:8832][Kernel][Info][UID:54F3D26011D2896560009A8E67019608][SID:FFD6204FF8703C3F5AD905A6D7ECA083][OID:57EC44DA4B2497EA71574A9ED1577689] IServer enters MCM denial state. The breakdown of memory usage is:
Total System Physical Memory(GB): 15
    Total In Use Physical Memory For Intelligence Server(MB): 900
        Total Size Of Physical Memory Used For Memory Mapped Files(MB): 33
    Total In Use Physical Memory For Other Processes(MB): 11174
Total System Virtual Memory(GB): 21
    Total In Use Virtual Memory For Other Processes(MB): 14995
    Max memory Available to the Intelligence Server Based On Memory Contract Manager(MB): 0
    Total In Use Virtual Memory For Intelligence Server(MB): 1088
        Report Caches In Memory(MB): 0
        Document Caches In Memory(MB): 0
        Cube Caches In Memory(MB): 246
            Cube Size Growth In Memory Including Indexes(MB): 0
            MMF Virtual Memory Size(MB): 43
        Object Server Caches In Memory(MB): 24
        Element Server Caches In Memory(MB): 0
        Total Working Set Memory Utilization(MB): 0
        Total SmartHeap Cached Memory Utilization(MB):10
        Other Memory In Intelligence Server(MB): 808
Note: Other memory In Intelligence Server may include part of the memory for runtime jobs that is not included in the above counters
Working set includes runtime memory necessary for Document execution While the Document instance is in use
SmartHeap cache memory is used for performance improvements
Copy 
2021-02-20 04:15:46.664-05:00 [HOST:tec-w-012230][SERVER:CastorServer][PID:12596][THR:7376][Kernel][Info][UID:54F3D26011D2896560009A8E67019608][SID:FFD6204FF8703C3F5AD905A6D7ECA083][OID:0] IServer will shut down soon as the time of MCM denial exceeds the limit(timeout setting is 60). The breakdown of memory usge is:
Total System Physical Memory(GB): 15
    Total In Use Physical Memory For Intelligence Server(MB): 900
        Total Size Of Physical Memory Used For Memory Mapped Files(MB): 33
    Total In Use Physical Memory For Other Processes(MB): 10797
Total System Virtual Memory(GB): 21
    Total In Use Virtual Memory For Other Processes(MB): 14596
    Max memory Available to the Intelligence Server Based On Memory Contract Manager(MB): 0
    Total In Use Virtual Memory For Intelligence Server(MB): 1088
        Report Caches In Memory(MB): 0
        Document Caches In Memory(MB): 0
        Cube Caches In Memory(MB): 246
        Cube Size Growth In Memory Including Indexes(MB): 0
             MMF Virtual Memory Size(MB): 43
            Object Server Caches In Memory(MB): 24
        Element Server Caches In Memory(MB): 0
        Total Working Set Memory Utilization(MB): 0
        Total SmartHeap Cached Memory Utilization(MB):12
        Other Memory In Intelligence Server(MB): 806
Note: Other memory In Intelligence Server may include part of the memory for runtime jobs that is not included in the above counters
Working set includes runtime memory necessary for Document execution While the Document instance is in use
SmartHeap cache memory is used for performance improvements