Artillery Playwright Not Capturing Specified Metrics

Question

I am using Artillery with Playwright to measure performance metrics of a website, but I am not getting the metrics I specified in the configuration. Instead, I am seeing only browser-related metrics.

My Artillery Configuration:

import { Page } from "@playwright/test";

export const config = {
  target: "https://www.artillery.io",
  defaults: {
    capture: {
      response: ["status_code", "latency"],
      metrics: [
        "http.response_time.p50",
        "http.response_time.p95",
        "http.response_time.p99",
         "http.response_time.min",
         "http.response_time.max",
        "http.request_rate",
        "http.codes.200",
        "http.codes.4xx",
        "http.codes.5xx",
      ],
    },
  },
  plugins: {
    expect: { enabled: true },
    ensure: {
      thresholds: {
        "browser.page.TTFB.https://www.artillery.io/": { p95: 100 },
        "vusers.session_length.min": 1000,
        "browser.page.codes.404": 0,
      },
    },
  },
  engines: {
    playwright: { showAllPageMetrics: false },
  },
  phases: [{ duration: 10, arrivalRate: 1, name: "Usersarrival" }],
};

export const scenarios = [
  {
    engine: "playwright",
    testFunction: helloWorld,
  },
];

export async function helloWorld(page: Page) {
  await page.goto("https://www.artillery.io/");
  await page.click("text=Docs");
}

Issue: I expected to see http.response_time.p50, http.response_time.p95, etc., in my report. However, when I run the test, I only get browser-level metrics:

browser.page.TTFB.https://www.artillery.io/: min: 49.7, max: 111, p95: 63.4 browser.page.FCP.https://www.artillery.io/: min: 348.7, max: 921.8, p95: 528.6 browser.page.codes.200: 580 browser.page.codes.404: 10 vusers.session_length: min: 717.4, max: 2245.9, p95: 1353.1

Can someone please help me with this?

Hassy Veldstra · Accepted Answer · 2025-01-30 09:38:36Z

1

Setting config.defaults.capture has no effect as it's not a recognized configuration option for Artillery. (It looks like it was possibly suggested by an AI copilot?)

You're not seeing http.-prefixed metrics you've defined in that block because Playwright-based tests don't capture those metrics. You can see the list of metrics reported by those tests in the official docs here: https://www.artillery.io/docs/reference/engines/playwright#metrics-reported-by-the-engine

answered Jan 30 at 9:38

Hassy Veldstra

3361 silver badge9 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Jayz Jan 30 at 11:55

Yes, Now I understand. I tried to fix that out using Artillery's metrics

Jayz Jan 30 at 12:07

Could you please help with this also? stackoverflow.com/questions/79399814/…

Collectives™ on Stack Overflow

Artillery Playwright Not Capturing Specified Metrics

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related