MicroStrategy ONE

Enable the Google BigQuery Storage API

The BigQuery Storage API provides quick access to BigQuery-managed storage using an RPC‑based protocol.

The BigQuery Storage API provides a third option that represents an improvement over prior options. When you use the BigQuery Storage API, structured data is sent over the wire in a binary serialization format. This allows for additional parallelism among multiple consumers for a set of results.

The driver can leverage the BigQuery Storage API, which allows higher throughput than the standard API. This enables the driver to handle large result sets more efficiently.

  1. In the GCP console, go to APIs and services in your project.
  2. Search for BigQuery Storage API.
  3. Click Enable.

Once this feature is enabled the driver checks the number of rows in a result set table, and the number of pages needed to retrieve all of the results. If the number of rows and pages exceeds the defined threshold, the driver begins using the BigQuery Storage API. For more information, see BigQuery Storage API Overview.

You can customize the thresholds for using the BigQuery Storage API using the following properties in the JDBC connection string:

  • EnableHighThroughputAPI

    This option specifies whether the driver uses the BigQuery Storage API for large result sets.

    • 1: The driver uses the Storage API for result sets that exceed the activation ratio.
    • 0: The driver does not use the Storage API.

  • HighThroughputActivationRatio

    • When the number of pages in your query results exceeds this number, and the number of rows in the results exceeds the HighThroughPutMinTableSize value, the driver switches to using the BigQuery Storage API instead of the standard API. If you define this value, you must also set the EnableHighThroughPutAPI option to 1.
    • The default value is 3.

  • HighThroughputMinTableSize

    • When the number of table rows in your query results exceeds this number (and the number of pages in the results exceeds the HighThroughPuRatio value) the driver switches to suing the BigQuery Storage API instead of the Standard API. If you define this value, you must also set the EnableHighThroughPut API option to 1.
    • The default value is 100.

These properties have been added to the JDBC connection string in 2019 Update 2.