|
1 | 1 | # SQS
|
2 | 2 |
|
3 |
| -SQS is amazon's managed message queue. Thus, it should follow the [OpenTelemetry specification for Messaging systems](https://github.com/open-telemetry/opentelemetry-specification/blob/master/specification/trace/semantic_conventions/messaging.md). |
| 3 | +SQS is Amazon's managed message queue. Thus, it should follow the [OpenTelemetry specification for Messaging systems](https://opentelemetry.io/docs/specs/semconv/messaging/messaging-spans/). |
4 | 4 |
|
5 | 5 | ## Specific trace semantic
|
6 | 6 |
|
7 | 7 | The following methods are automatically enhanced:
|
8 | 8 |
|
9 | 9 | ### sendMessage / sendMessageBatch
|
10 | 10 |
|
11 |
| -- [Messaging Attributes](https://github.com/open-telemetry/opentelemetry-specification/blob/master/specification/trace/semantic_conventions/messaging.md#messaging-attributes) are added by this instrumentation according to the spec. |
| 11 | +- [Messaging Attributes](https://opentelemetry.io/docs/specs/semconv/messaging/messaging-spans/#messaging-attributes) are added by this instrumentation according to the spec. |
12 | 12 | - OpenTelemetry trace context is injected as SQS MessageAttributes, so the service receiving the message can link cascading spans to the trace which created the message.
|
13 | 13 |
|
14 | 14 | ### receiveMessage
|
15 | 15 |
|
16 |
| -- [Messaging Attributes](https://github.com/open-telemetry/opentelemetry-specification/blob/master/specification/trace/semantic_conventions/messaging.md#messaging-attributes) are added by this instrumentation according to the spec. |
17 |
| -- Additional "processing spans" are created for each message received by the application. |
18 |
| - If an application invoked `receiveMessage`, and received a 10 messages batch, a single `messaging.operation` = `receive` span will be created for the `receiveMessage` operation, and 10 `messaging.operation` = `process` spans will be created, one for each message. |
19 |
| - Those processing spans are created by the library. This behavior is partially implemented, [See discussion below](#processing-spans). |
20 |
| -- Sets the inter process context correctly, so that additional spans created through the process will be linked to parent spans correctly. |
21 |
| - This behavior is partially implemented, [See discussion below](#processing-spans). |
| 16 | +- [Messaging Attributes](https://opentelemetry.io/docs/specs/semconv/messaging/messaging-spans/#messaging-attributes) are added by this instrumentation according to the spec. |
| 17 | +- Sets the inter process context correctly, so that additional spans created through the process will be linked to parent spans correctly. |
| 18 | + When multiple messages are received, the instrumentation will attach spank links to the receiving span containing the trace context and message ID of each message. |
22 | 19 | - Extract trace context from SQS MessageAttributes, and set span's `parent` and `links` correctly according to the spec.
|
23 |
| - |
24 |
| -#### Processing Spans |
25 |
| - |
26 |
| -See GH issue [here](https://github.com/open-telemetry/opentelemetry-js-contrib/issues/707) |
27 |
| - |
28 |
| -According to OpenTelemetry specification (and to reasonable expectation for trace structure), user of this library would expect to see one span for the operation of receiving messages batch from SQS, and then, **for each message**, a span with it's own sub-tree for the processing of this specific message. |
29 |
| - |
30 |
| -For example, if a `receiveMessages` returned 2 messages: |
31 |
| - |
32 |
| -- `msg1` resulting in storing something to a DB. |
33 |
| -- `msg2` resulting in calling an external HTTP endpoint. |
34 |
| - |
35 |
| -This will result in a creating a DB span that would be the child of `msg1` process span, and an HTTP span that would be the child of `msg2` process span (in opposed to mixing all those operations under the single `receive` span, or start a new trace for each of them). |
36 |
| - |
37 |
| -Unfortunately, this is not so easy to implement in JS: |
38 |
| - |
39 |
| -1. The SDK is calling a single callback for the messages batch, and it's not straightforward to understand when each individual message processing starts and ends (and set the context correctly for cascading spans). |
40 |
| -2. If async/await is used, context can be lost when returning data from async functions, for example: |
41 |
| - |
42 |
| -```js |
43 |
| -async function asyncRecv() { |
44 |
| - const data = await sqs.receiveMessage(recvParams).promise(); |
45 |
| - // context of receiveMessage is set here |
46 |
| - return data; |
47 |
| -} |
48 |
| - |
49 |
| -async function poll() { |
50 |
| - const result = await asyncRecv(); |
51 |
| - // context is lost when asyncRecv returns. following spans are created with root context. |
52 |
| - await Promise.all( |
53 |
| - result.Messages.map((message) => this.processMessage(message)) |
54 |
| - ); |
55 |
| -} |
56 |
| -``` |
57 |
| - |
58 |
| -Current implementation partially solves this issue by patching the `map` \ `forEach` \ `Filter` functions on the `Messages` array of `receiveMessage` result. This handles issues like the one above, but will not handle situations where the processing is done in other patterns (multiple map\forEach calls, index access to the array, other array operations, etc). This is currently an open issue in the instrumentation. |
59 |
| - |
60 |
| -User can add custom attributes to the `process` span, by setting a function to `sqsProcessHook` in instrumentation config. For example: |
61 |
| - |
62 |
| -```js |
63 |
| -awsInstrumentationConfig = { |
64 |
| - sqsProcessHook: (span, message) => { |
65 |
| - span.setAttribute("sqs.receipt_handle", message.params?.ReceiptHandle); |
66 |
| - }, |
67 |
| -}; |
68 |
| -``` |
0 commit comments