GCP – Instant insights: Gemini CLI’s New Pre-Configured Monitoring Dashboards

Observability is a key component to understand how tools are helping you and your teams. 

We’re excited to announce a significant set of updates that enhance the Gemini CLI’s telemetry capabilities, making it easier than ever to gain immediate visibility into adoption, interaction patterns, and performance, by leveraging pre-configured Google Cloud Monitoring dashboards. You may also use the raw logs available to you to customize the data visualization based on your needs, leveraging OpenTelemetry.

Immediate Value with Out-of-the-Box Dashboards

Without writing a single query, you will get access to a dashboard that will provide you with immediate, high-level visibility into your CLI usage and performance metrics, such as Monthly and Daily active users, Number of Installs, Lines of code added and removed, Token consumption, API and Tool calls, among others.

To take advantage of this dashboard, simply configure OpenTelemetry in your Gemini CLI project and export the data to Google Cloud. This dashboard can be found under Google Cloud Monitoring Dashboard Templates as “Gemini CLI Monitoring.”

Advanced Analysis with Raw OpenTelemetry Data

For projects where Gemini CLI telemetry has been enabled, you will be able to track Logs and Metrics under the Google Cloud Console.

By combining the raw information provided via OpenTelemetry, you can answer complex questions such as:

• How much is the Gemini CLI tool being utilized across my team, by counting unique values of user.email.

• How reliable is the tool, by looking at certain status_code.

• What is the current usage volume, by looking at entries where api_method is present.

• Which developers are power users, by looking at input_tokens and output_tokens per user.email.

• What area is my budget going to by looking at tokens per command type.

• What are my top 10 users by token usage.

OpenTelemetry

With the goal of streamlining the collection of metrics and logs, Gemini CLI relies on OpenTelemetry, a vendor-neutral, industry-standard observability framework providing:

• Universal Compatibility: Export to any OpenTelemetry backend (Google Cloud, Jaeger, Prometheus, Datadog, etc). To ensure this compatibility, our metrics, logs and traces comply with the GenAI OpenTelemetry convention.

• Standardized Data: Use consistent formats and collection methods across your toolchain.

• Future-Proof Integration: Connect with existing and future observability infrastructure.

• No Vendor Lock-in: Switch between backends without changing your instrumentation.

Get your data in Google Cloud in three steps

We have created a direct way of exporting your data into Google Cloud in three steps:

1. Set up your Google Cloud project ID.

2. Authenticate with Google Cloud, ensuring you have the right IAM roles and APIs enabled.

3. Introducing Direct GCP Exporters: With the addition of direct Google Cloud Platform (GCP) exporters via OpenTelemetry (OTel), CLI can now bypass intermediate OTLP collector configurations, allowing for simpler setup. You will just need to update your .gemini/settings.json.

See detailed set up instructions.

By providing these foundational tools, we empower you to focus less on infrastructure setup and more on building and iterating on your applications.

Get Started Today

The latest telemetry enhancements and the new Google Cloud Monitoring dashboard are now publicly available. 

Check out our telemetry guide for Gemini CLI, the Cloud Monitoring dashboard template and start understanding how you and your teams take advantage of Gemini CLI!