Version 2020

Verify the Initial Load of Object Telemetry

To verify whether the initial load process was successful, review the MetadataObjectTelemetry log file.

By default, the MetadataObjectTelemetry log is enabled. To turn off the log, navigate to the MicroStrategy Diagnostics and Performance Logging Tool and uncheck the MetadataObjectTelemetry log.

  • On Windows, this file is located in <install_path>\Common Files\MicroStrategy\Log\MetadataObjectTelemetry.log.
  • On Linux, this file is located in /var/log/MicroStrategy/MetadataObjectTelemetry.log.

Understanding the MetadataObjectTelemetry Log

This log file provides detailed information on the status of your initial load, such as if the initial load was successfully triggered and how many projects were loaded.

There are three types of messages in this log file:

Metadata Object Telemetry Message

The first message on the log file is the metadata object telemetry start message. If the initial load is successfully triggered, you will see the following information:

  • Metadata object telemetry start: Indicates the initial load has started.
  • ObjectTelemetryID: Indicates the unique identifier of the initial load. Each triggered initial load has a unique ID.
  • Project distribution info: Indicates the host and projects that are being loaded. If you are using a clustered environment, each node will appear in this section with its associated projects.

For Example

2019-09-02 04:32:59.416-04:00 [HOST:tec-w-004718][SERVER:CastorServer][PID:3208][THR:1600][MetadataObjectTelemetry][Info][UID:54F3D26011D2896560009A8E67019608][SID:5068987ECF4302F929BA2DCF45DF405D][OID:0] [ObjectTelemetryID:5707FDFC4046F238782CC89C8DA94DD8] Metadata object telemetry start. Project distribution info: (tec-w-004718, [Human Resources Analysis Module, MicroStrategy Tutorial, Platform Analytics, Configuration]).

The above message indicates that the initial load was triggered since the Metadata object telemetry start message appears. This load is also given a unique identifier: ObjectTelemetryID:5707FDFC4046F238782CC89C8DA94DD8. This identifier will appear in subsequent messages related to this initial load.

This message also provides a record of how many projects are going to load. The Project distribution info line indicates the node, tec-w-004718, that contains four projects: Human Resources Analysis Module, MicroStrategy Tutorial, Platform Analytics, and Configuration.

If this were a clustered environment, the Project distribution info line would contain each node with its associated projects. For example, (TEC-W-002270, [MicroStrategy Tutorial]), (TEC-W-002613, [New Project, Configuration]).

Project Object Telemetry Message

This message is logged when each project starts, progresses, and is finished with the object telemetry process. It's only logged by the node that is the primary server of the project.

The project object telemetry messages appear as:

  • Project object telemetry start: Indicates the project has started the object telemetry process and how many objects will be sent to Kafka from the project.
  • Project object telemetry in progress: Indicates the number of objects sent to Kafka, the number of objects that failed to be sent to Kafka, and the number of objects that need to be sent to Kafka.
  • Project object telemetry finish: Indicates the project has finished the object telemetry process and how many objects were successfully sent to Kafka.

For Example: Project Object Telemetry Start

2019-09-02 04:32:59.437-04:00 [HOST:tec-w-004718][SERVER:CastorServer][PID:3208][THR:1600][MetadataObjectTelemetry][Info][UID:54F3D26011D2896560009A8E67019608][SID:5068987ECF4302F929BA2DCF45DF405D][OID:0] [ObjectTelemetryID:5707FDFC4046F238782CC89C8DA94DD8] Project 'Configuration' object telemetry start. About 588 objects will be sent.

This is the project's start message. It indicates that the project, Configuration, is beginning the object telemetry process and that there are 588 objects that will be sent to Kafka from the project.

This number may not represent the final number of objects sent to Kafka because objects can be added or deleted when the project object telemetry is being sent.

For Example: Project Object Telemetry In Progress

2019-09-02 04:32:59.524-04:00 [HOST:tec-w-004718][SERVER:CastorServer][PID:3208][THR:1600][MetadataObjectTelemetry][Info][UID:54F3D26011D2896560009A8E67019608][SID:5068987ECF4302F929BA2DCF45DF405D][OID:0] [ObjectTelemetryID:5707FDFC4046F238782CC89C8DA94DD8] Project 'Configuration' object telemetry in progress. 46 objects are sent to Kafka successfully, 0 objects failed to send to Kafka. A total of about 588 objects need to be sent.
2019-09-02 04:32:59.610-04:00 [HOST:tec-w-004718][SERVER:CastorServer][PID:3208][THR:1600][MetadataObjectTelemetry][Info][UID:54F3D26011D2896560009A8E67019608][SID:5068987ECF4302F929BA2DCF45DF405D][OID:0] [ObjectTelemetryID:5707FDFC4046F238782CC89C8DA94DD8] Project 'Configuration' object telemetry in progress. 147 objects are sent to Kafka successfully, 0 objects failed to send to Kafka. A total of about 588 objects need to be sent.

This is an example of two project object telemetry in progress messages. Each time 100 objects are sent to Kafka, a new in progress message is logged. In the first log, 46 objects were sent to Kafka. The second log appeared when 147 objects were successfully sent to Kafka. In both logs, 0 objects failed to send.

For Example: Project Object Telemetry Finish

2019-09-02 04:33:00.013-04:00 [HOST:tec-w-004718][SERVER:CastorServer][PID:3208][THR:1600][MetadataObjectTelemetry][Info][UID:54F3D26011D2896560009A8E67019608][SID:5068987ECF4302F929BA2DCF45DF405D][OID:0] [ObjectTelemetryID:5707FDFC4046F238782CC89C8DA94DD8] Project 'Configuration' object telemetry finish. 588 objects were sent in total.

This is the project's finished message. The project, Configuration, has successfully sent 588 objects to Kafka.

Subscription Telemetry Message

This message is logged when the cluster node starts, progresses, and is finished with the subscription instance telemetry process.

The subscription telemetry messages appear as:

  • Subscription instance telemetry start: Indicates the node has started the subscription instance telemetry and how many subscription instances will be sent to Kafka from the project.
  • Subscription instance telemetry progress: Indicates the number of subscription instances sent to Kafka, the number of subscription instances that failed to be sent to Kafka, and the total subscriptions that need to be sent to Kafka.
  • Subscription instance telemetry finish: Indicates the node has finished the subscription instance telemetry and how many objects were successfully sent to Kafka.

For Example: Subscription Instance Telemetry Start

2019-09-03 22:39:14.977-04:00 [HOST:tec-w-004718][SERVER:CastorServer][PID:3208][THR:12568][MetadataObjectTelemetry][Info][UID:54F3D26011D2896560009A8E67019608][SID:CFEEB1FA81CFBF01553D3E9EE9F6CEE1][OID:0] [ObjectTelemetryID:974CB30B43A997627A648E89D786C438] Subscription instance telemetry start. About 26 objects will be sent.

This message indicates the subscription instance telemetry process has started and that 26 objects will be sent to Kafka.

For Example: Subscription Instance Telemetry Progress

2019-09-03 22:39:14.980-04:00 [HOST:tec-w-004718][SERVER:CastorServer][PID:3208][THR:12568][MetadataObjectTelemetry][Info][UID:54F3D26011D2896560009A8E67019608][SID:CFEEB1FA81CFBF01553D3E9EE9F6CEE1][OID:0] [ObjectTelemetryID:974CB30B43A997627A648E89D786C438] Subscription instance telemetry in progress. 26 objects are sent to Kafka successfully, 0 objects failed to send to Kafka. A total of about 26 objects need to be sent.

This message indicates that the subscription instance telemetry process is in progress. Each time 100 objects are sent to Kafka, a new progress message is logged. In this log, only 26 objects needed to be sent to Kafka and 26 objects were successfully sent.

For Example: Subscription Instance Telemetry Finish

2019-09-03 22:39:14.982-04:00 [HOST:tec-w-004718][SERVER:CastorServer][PID:3208][THR:12568][MetadataObjectTelemetry][Info][UID:54F3D26011D2896560009A8E67019608][SID:CFEEB1FA81CFBF01553D3E9EE9F6CEE1][OID:0] [ObjectTelemetryID:974CB30B43A997627A648E89D786C438] Subscription instance telemetry finish. 26 objects were sent in total. 

This message indicates that the current node finished the subscription instance telemetry progress and that 26 subscriptions were successfully sent to Kafka.