Tools Connect: Amazon Q (Beta)

Allstacks now supports a Beta integration with Amazon Q, these metrics allow teams to monitor performance, usage, and health of AWS Q Developer services.

1 Important Notes
2 Prerequisites
3 How We Connect
4 Metrics We Show from Amazon Q
- 4.1 1. Daily Active Users
- 4.2 2. Monthly Active Users
- 4.3 3 Generated Lines
- 4.4 4 Total Actions
5 Code Examples & Results

Important Notes

Beta Status: This integration is in Beta and hidden behind a feature flag. Please contact your Allstacks Customer Success (CS) representative to enable it.
Active User: Data presented in Allstacks will be from the last 90 days.
Generated Lines and Total Action: Data presented in Allstacks will be from the last 15 days.
Live Data: Metrics refresh every time you reload the page, as fresh data is fetched on each load.
Please do not use the Access Portal credentials for this setup, as those are temporary keys and will expire.

Prerequisites

You will need to:

Create an IAM user in AWS
Assign the following permissions to this IAM user:
- cloudwatch:GetMetricData
- cloudwatch:GetMetricStatistics
- cloudwatch:ListMetrics
  - You can reference the AWS CloudWatch permissions here: https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/permissions-reference-cw.html
  - Example JSON Policy:

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "Statement1",
            "Effect": "Allow",
            "Action": [
                "cloudwatch:GetMetricData",
                "cloudwatch:GetMetricStatistics",
                "cloudwatch:ListMetrics"
            ],
            "Resource": [
                "*"
            ]
        }
    ]
}

Create credentials for this IAM User
- During the creation you will select Other as the user case
- On the Retrieve Access Key step, copy the Access Key and Secret Access Key. You’ll need to enter this information into the Allstacks tool configuration.

How We Connect

Allstacks connects to Amazon Q using IAM credentials to fetch CloudWatch Metrics data.

Once the feature flag is enabled for the Amazon Q, you should see Q Usage Metrics become available in your Configure section to navigate to.
Once on the Amazon Q Usage Metrics dashboard page, top-right, click the Configure button. You will receive a pop-up window which will allow you to enter in your IAM credentials, data region and save it to start pulling in data.

We use the following metrics to pull data which you can also validate to ensure Allstacks is representing the same data you are seeing in Amazon Q.

Metrics We Show from Amazon Q

Once configuration is completed, Allstacks displays the following metrics:

1. Daily Active Users

Shows how many people are using the product every day.
Why it matters: it tells you if users find value daily and keeps you aware of short-term engagement trends.

2. Monthly Active Users

Measures unique users in a month.
Why it matters: it shows the broader reach of the product and helps track long-term adoption, not just daily spikes.

3 Generated Lines

Counts how many lines of code were generated by Amazon Q Developer.
Why it matters: it reflects how much users rely on the tool to get work done, showing productivity impact.

4 Total Actions

Tracks the total number of times users invoke the tool.
Why it matters: it captures overall usage volume and highlights how central the tool is in workflows.

Add label

Code Examples & Results

https://allstacks.atlassian.net/wiki/x/L4B00g