2,828 questions
0
votes
0
answers
26
views
Datadog APM traces not appearing for AWS Lambda with Node.js despite metrics working
Problem
I'm trying to set up Datadog APM tracing for my AWS Lambda functions (Node.js/TypeScript), but traces are not appearing in the Datadog APM UI. Custom metrics are being collected successfully, ...
0
votes
2
answers
65
views
API request tracing with NextJS, Nginx and Django
I’m trying to measure the exact time spent in each stage of my API request flow — starting from the browser, through Nginx, into Django, then the database, and back out through Django and Nginx to the ...
1
vote
0
answers
78
views
Istio tracing issue
Does Istio’s VirtualService routing and header manipulation apply to tracing traffic generated by istio-proxy itself?
Here’s the situation: I have Istio configured to send spans to an external tracing ...
- 11
0
votes
1
answer
119
views
Python execution log with call stack
I have complicated Python code which I wish to trace. I want to have a log file that will list all function calls in the order in which they are called, and for each call:
the current call stack
...
- 499
2
votes
0
answers
39
views
What's the difference between trace and seq_trace?
OTP 27 offers two tracing modules: trace and seq_trace. They both seem to do the same thing, except the other one is called "sequential". What does this mean and what is the difference ...
- 7,413
0
votes
0
answers
42
views
can skywalking OAP receive opentelemetry trace
I have a question when using opentelemetry and skywalking. In java project, use opentelemetry to generate trace and span infomation, then I want to collect these trace to skywalking aop to analysis ...
1
vote
1
answer
246
views
Langfuse trace graph for multi-agent runs is ambiguous / broken — bug or my trace format?
I’m seeing confusing / broken graphs in the Langfuse dashboard for multi-agent traces and I’m not sure if it’s a Langfuse bug or something I’m doing wrong.
What I did:
I run a multi-agent system using ...
- 11
0
votes
0
answers
40
views
Should I use traceAsync to profile a suspend function?
I'm trying to solve a perf issue in my Android library. I use androidx.tracing to add trace events in system trace. My question is that should I use trace() or traceAsync() for a suspend function?
...
- 138
1
vote
1
answer
155
views
How to rehydrate current span in Rust tracing/otel
I'm writing a Pingora proxy instance. It uses multiple async functions from a trait to indicate various stages. There is a common context that I can provide. I am trying to instrument the whole ...
- 192k
0
votes
0
answers
60
views
stack_trace : Is there any potential issue with wrapping my app in Chain.capture()
I'm working on a Flutter app and want to improve my error reporting, especially for async errors. I came across the stack_trace package and its Chain.capture method, which seems to provide much better ...
- 49
1
vote
0
answers
188
views
How do I set the TraceId in an ASP.NET Core GRPC call
I suspect this is not possible, but someone may have an interesting solution.
I want to set the TraceId on a gRPC call. This will allow me continuity of trace across a variety of boundaries. For ...
- 31
0
votes
0
answers
229
views
Baileys crashes with TypeError: logger.trace is not a function
I'm trying to build a basic WhatsApp bot using the @whiskeysockets/baileys library. I’ve set up the bot to connect using QR authentication, and it connects successfully. However, when I send or ...
1
vote
1
answer
93
views
How can I filter trace spans by duration?
Using tracing_subscriber, How can I log span duration with Rust tracing? explains how to trace span durations. But I have a lot, and I only want to see slow ones.
I have tried this but I'm not sure ...
- 4,525
1
vote
1
answer
63
views
Avoid tracing the outer exec() wrapper when debugging a Python script using sys.settrace()
I'm building a custom Python debugger using sys.settrace() to inspect and log execution events. My script accepts a .py input fil eas a parameter and inspects every event within it using:
code_str = ...
- 55
0
votes
1
answer
121
views
Variable traceability in C++
I have a somewhat global issue, I don’t know if someone can help me, I’m working on a big project with a somewhat old codebase, I’m trying to find a solution but I feel like there’s nothing on the ...
1
vote
0
answers
77
views
How to analyze the microarchitecture resource requirements based on the trace generated by program execution?
I'm doing an in-depth CPU microarchitectural resource analysis. I want to know the requirements of my program on processor microarchitectural resources and compare the requirements of different ...
- 455
0
votes
0
answers
49
views
OpenTelemetry within a .Net console application without ServiceCollection. TraceProvider and MeterProvider need to live through the app lifecycle
I have a .NET console application where I want to add Open telemetry traces to be sent to Grafana. The app does not use Service Collection and DI. Instead we use the AppBuilder for all the application ...
0
votes
0
answers
47
views
Trace Elasticsearch API call
TL;DR: I implemented a clumsy way to track a search request through various points in the network. Is there a better way?
I'm using the Elasticsearch SDK to perform searches. The search call traverses ...
- 63
6
votes
1
answer
157
views
How print every line of a php script as its being executed?
How to print every line of a php script as it's being executed?
For example in Python you can do
$ cat test.py
import time
print('hello')
time.sleep(3)
print('goodbye')
$ python -m trace -t test.py
...
- 22.4k
1
vote
0
answers
147
views
How to trace PyTorch Dataloader workers with VizTracer?
I'm using VizTracer to debug performance issues in my PyTorch data loading pipeline. Specifically, I'm using a DataLoader with num_workers > 0 to load data in parallel using multiple subprocesses.
...
- 53
1
vote
2
answers
50
views
How to combine unittest with trace module to produce coverage like report?
I know how to use coverage module to get "human readable" coverage output (using popular third party coverage module). This can be used with pytest or unittest (with some differences in the ...
- 2,138
0
votes
1
answer
65
views
Do perf filters work inside containers (when tracing with Intel PT)?
(This post is based on a mailing list post I submitted yesterday)
I'm writing a userspace application that interacts directly with
perf_event_open() in order to trace control flow with Intel PT.
...
- 3,685
2
votes
0
answers
143
views
The sched_blocked_reason tracepoint in Linux does not emit events
I am attempting to capture events from sched/sched_block_reason on a Linux system, with the eventual goal of getting sched/sched_block_reason working with a visualization tool called Perfetto.
This ...
- 1,035
0
votes
1
answer
66
views
Is it possible to trace a line after it's executed in Python?
sys.settrace and Bdb.trace_dispatch can trace events. But the "line" event is triggered before the execution of the line.
I'm trying to get information exactly after the line being executed, ...
- 41
0
votes
1
answer
342
views
Stop Otel from tracing its own internal metric exporting activity
I've implemented Otel for my python app sending telemetry to GCP backend. I'm seeing these trace spans for https://otel-collector-xxx.asia-southeast1.run.app/opentelemetry.proto.collector.metrics.v1....
- 479
16
votes
1
answer
657
views
Why does R behave differently for auto-printed objects?
I have encountered two instances where it seems that R treats obj and print(obj) differently. I would like to know more about the nature of this difference.
First instance
I can run
trace("print....
- 508
2
votes
0
answers
99
views
Trouble Capturing Process Start Events with ETW in User-Mode Application
I have a question regarding ETW (Event Tracing for Windows) programming.
My goal is simple: I want to use ETW base program to record every user-launched program on Windows.
I have already implemented ...
- 111
0
votes
0
answers
48
views
Attaching to and receiving a process's own utrace events (dtrace USDT probe points)
Is it possible for a process to probe dtrace/perf/etc USDTs for its own process (or even better, process group or uid) without needing elevated privileges or being able to trace processes with other ...
- 329k
0
votes
0
answers
28
views
Use trace module from Spyder console
I was looking for how to echo commands to the console as a Python script is executing. Google pointed me to the trace module, but what I found online shows that it must be specified when invoking ...
- 1,265
0
votes
0
answers
65
views
TRACE_DRIVER Undeclared Identifier in KMDF Project After Rename to C++
Environment and Project
Visual Studio 2022
Kernel Mode Driver (KMDF)
Trace Lines
TraceEvents(TRACE_LEVEL_INFORMATION, TRACE_DRIVER, "%!FUNC! Entry");
TraceEvents(TRACE_LEVEL_ERROR, ...
- 15.7k
0
votes
1
answer
72
views
Is there a way to instrument python code like this to run my tracing function on it? [duplicate]
So for example if I have this python code
def adder(x,y):
return x + y
So I am tracing the values of variables for python source code and I want to run the sys.settrace using my trace function on ...
0
votes
0
answers
33
views
How to collect instruction traces that can be used by the gem5 simulator?
I want to analyze the impact of different microarchitecture designs on a certain workload, so I would like to collect traces on a machine running that workload and use those traces in the gem5 ...
- 809
0
votes
0
answers
25
views
How to calculate size of traces logged per minute configured with rsyslog log rotation
I'm working on a script that logs messages using rsyslog, and I want to calculate the total size of log entries (traces) generated per minute. My rsyslog configuration is set up to rotate logs based ...
- 195
0
votes
1
answer
203
views
What is the simplest way to add corellationId to logging.pattern.console?
Initially I had such logging configuration in my spring boot 3.4 app:
logging:
...
pattern:
file: "%d [%thread] %-5level %-50logger{40}- %n"
console: "%d [%thread]%-...
- 36.9k
0
votes
1
answer
67
views
How to replace ZipkinSpanExporter to my Own in spring boot application?
I have an application based on spring boot 3.4
I have application.properties with lines:
management.tracing.sampling.probability=1
management.zipkin.tracing.export.enabled=false
and dependencies:
// ...
- 36.9k
2
votes
0
answers
80
views
Failed to attach eBPF codes to kprobe?
My Linux system is WSL2 with kernel-5.15.133, and I wrote a eBPF codes to count calling of kmalloc in kernel with kprobe.
The code failed with kprobe attach failed: Invalid argument.
// ...
- 1,307
0
votes
1
answer
58
views
How to propagate micrometer traces to Ldap server using unboundId sdk?
Based on
official spring boot documentation
Propagating Traces
To automatically propagate traces over the network, use the auto-configured RestTemplateBuilder,
RestClient.Builder or WebClient.Builder ...
- 36.9k
0
votes
1
answer
77
views
Is there way to persist traces on a disk instead of sending them to Zipkin?
I have spring boot 3.4 application configured for metrics.
I've added dependencies:
implementation("io.micrometer:micrometer-tracing-bridge-otel")
implementation("io....
- 36.9k
0
votes
1
answer
111
views
How to put argument values to traces of method annotated with @Observed
I have a method annotated with @Observed annotation:
@Observed(
name = "foo",
contextualName = "foo",
)
fun foo(arg1: String, arg2: Integer){...}
When I go to Zipkin I see ...
- 36.9k
0
votes
1
answer
338
views
What is micrometer performance impact/overhead for tracing? Is it performance safe to have enabled tracing in production?
I try to add observability support to my spring boot 3 application and I've found out that by default there only 10% of traces are collected. To collect all traces I've added following config
...
- 36.9k
0
votes
0
answers
29
views
Using hunter to trace test calls misses certain invocations — how to capture more complete code dependencies?
I’m working on a project with the following goal: extract a self-contained set of Python modules and their corresponding test cases from a PyPI package, so that this extracted code (plus tests) can ...
- 1
-1
votes
1
answer
463
views
What is "Baggage" in spring boot tracing?
I read spring boot documentaion about observability and see the section about Baggage
You can create baggage with the Tracer API:
@Component
class CreatingBaggage {
private final Tracer tracer;
...
- 36.9k
0
votes
0
answers
109
views
Ingesting manual spans to Grafana Tempo via OpenTelemetry in Python
I am running Grafana Tempo with the example docker-compose local configuration from https://github.com/grafana/tempo/tree/main/example/docker-compose/local. To keep the traces clear, I disabled the ...
- 172
0
votes
0
answers
12
views
Scatter express looks odd when trying to add lines to bin edges in histogram marginals
I am trying to show a scatter plot in plotly express (to my understanding PX is the way to go since I can tweak the traces for formatting efficiently)
This is what I got from searching online
import ...
- 19
0
votes
1
answer
30
views
Python trace module does not display calling relationships when running pytest
I would like to track the functions invoked by pytest test cases. I use this test file in xarray as an example. I use the following command to trace
python -m trace --trackcalls --module pytest -rA ...
- 901
0
votes
0
answers
48
views
How to connect my custom trace context to an observability platform?
I am developing a microservices system in PHP and have implemented a TraceContext class to manage trace information (trace_id, span_id, parent_id). My goal is to send this information to an ...
0
votes
0
answers
93
views
Using OpenTelemetry with .Net gives me the correct traces in Jaeger UI ONLY in local testing
I'm using OpenTelemetry to track a Kafka message throughout its entire lifespan. Here's my current approach:
On the sender side, I extract the Activity.Id (which contains both TraceId and SpanId), ...
0
votes
1
answer
191
views
Having trouble implemeting a circular trace file in WCF client
We have a .NET Framework 4.8 WCF client that has tracing enabled.
Problem is that the trace file is over 10GB and counting.
I want to implement a circular trace file microsoft link.
I took file ...
- 145
2
votes
1
answer
93
views
Getting a trace of memory address accesses using Valgrind
I have a microbenchmark which I'm using to generate memory traffic. I've profiled the application and it seems to constantly hit in L1 cache. I have a Core i5-7260U.
I want to understand the actual ...
- 579
2
votes
0
answers
79
views
Can I draw arrows between arrows in Chrome trace?
When I create a chrome trace (in protobuf binary or json format) and open it in Perfetto, it shows thread activity as in the example below. I would like Perfetto to draw an arrow between rows ...
- 4,219