Can i use OTEL collector as a receiver for logs over HTTP

[kushal-ti]

I'm trying to send application logs to the otel collector over HTTP,

this is how i'm setting up by log ransport with winston

const logger = winston.createLogger({
  level: 'info',
  transports: [
    new winston.transports.Http({
      host: 'localhost',
      port: 4318,
      path: '/v1/logs',
      batch: true,
      batchCount: 1,
    }),
  ],
});

I have an otel collector running locally with the following configuration

extensions:
  health_check:
  pprof:
    endpoint: 0.0.0.0:1777
  zpages:
    endpoint: 0.0.0.0:55679

receivers:
  otlp:
    protocols:
      grpc:
      http:
        cors:
          allowed_origins:
            - http://localhost:3000
            - http://localhost:3001

  # Collect own metrics
  # prometheus:
  #   config:
  #     scrape_configs:
  #       - job_name: "otel-collector"
  #         scrape_interval: 10s
  #         static_configs:
  #           - targets: ["0.0.0.0:8888"]

processors:
  batch:

exporters:
  logging:
    loglevel: debug
  jaeger:
    endpoint: "localhost:14250"
    tls:
      insecure: true
  file:
    path: /home/kushal/traces.json

service:
  pipelines:
    traces:
      receivers: [otlp]
      processors: [batch]
      exporters: [jaeger]

    # metrics:
    #   receivers: [otlp, prometheus]
    #   processors: [batch]
    #   exporters: [logging]

    logs:
      receivers: [otlp]
      processors: [batch]
      exporters: [logging]

  extensions: [health_check, pprof, zpages]

but when i run this with my application, and check the traces in jaeger, i see that wherever i'm trying to send the logs, i get an error

My server which is trying to send the logs is running on 3001. Can any one tell me what i'm doing wrong ?

[pmm-sumo]

The configuration in JS is sending data using winston-specific format, while OpenTelemetry Collector expects OTLP Logs. I believe OTLP Logs are not supported yet in JS, but it's best to ask there

[pysarenko-bohdan]

// const { NodeTracerProvider } = require('@opentelemetry/sdk-trace-node');
const logsAPI = require('@opentelemetry/api-logs');
const {
    LoggerProvider,
    SimpleLogRecordProcessor,
    BatchLogRecordProcessor,
    ConsoleLogRecordExporter,
} = require('@opentelemetry/sdk-logs');
const { WinstonInstrumentation } = require('@opentelemetry/instrumentation-winston');
const { registerInstrumentations } = require('@opentelemetry/instrumentation');

// const tracerProvider = new NodeTracerProvider();
// tracerProvider.register();

// To start a logger, you first need to initialize the Logger provider.
const loggerProvider = new LoggerProvider();
const { OTLPLogExporter } = require('@opentelemetry/exporter-logs-otlp-http');
// exporter options. see all options in OTLPExporterConfigBase
const collectorOptions = {
    // url: '<opentelemetry-collector-url>', // url is optional and can be omitted - default is http://localhost:4318/v1/logs
    headers: {}, // an optional object containing custom headers to be sent with each request
    concurrencyLimit: 1, // an optional limit on pending requests
  };
// const collectorAddress = 'http://local.codefresh.io:4318'; // Replace with your collector address

const exporter = new OTLPLogExporter(collectorOptions);
// Add a processor to export log record
loggerProvider.addLogRecordProcessor(
    // new SimpleLogRecordProcessor(new ConsoleLogRecordExporter())
    new BatchLogRecordProcessor(exporter)
);
logsAPI.logs.setGlobalLoggerProvider(loggerProvider);
registerInstrumentations({
    instrumentations: [
        new WinstonInstrumentation({
            // See below for Winston instrumentation options.
        }),
    ],
});

it works for me.