Skip to content

Commit

Permalink
Update ingestion.md
Browse files Browse the repository at this point in the history
  • Loading branch information
lmangani authored Feb 16, 2024
1 parent c4bdcad commit e6fb799
Showing 1 changed file with 74 additions and 0 deletions.
74 changes: 74 additions & 0 deletions docs/telemetry/ingestion.md
Original file line number Diff line number Diff line change
Expand Up @@ -122,6 +122,9 @@ otel-collector:
- "24224:24224". # Fluent Forward
restart: on-failure
```
#### Inserts to ClickHouse
Insert logs, metrics, traces and profiling data directly to ClickHouse bypassing the qryn ingestion APIs.
###### qryn collector `config.taml`
The following example enables all the supported formats at once. Filter the required sections to build your configuration.
Expand Down Expand Up @@ -233,6 +236,77 @@ service:
exporters: [qryn]
```

#### Inserts to API

Insert logs, metrics, traces and profiling data in ClickHouse through the qryn ingestion APIs.

###### qryn collector `config.taml`
The following example outlines the usage of exporters with the qryn or qryn.cloud endpoints.
```
receivers:
otlp:
protocols:
grpc:
endpoint: 0.0.0.0:4317
http:
endpoint: 0.0.0.0:4318
jaeger:
protocols:
grpc:
endpoint: 0.0.0.0:14250
thrift_http:
endpoint: 0.0.0.0:14268
zipkin:
endpoint: 0.0.0.0:9411
fluentforward:
endpoint: 0.0.0.0:24224
prometheus:
config:
scrape_configs:
- job_name: 'otel-collector'
scrape_interval: 5s
static_configs:
- targets: ['exporter:8080']

exporters:
otlphttp:
endpoint: https://<API_KEY>:<API_SECRET>@qryn.gigapipe.com
timeout: 30s
loki:
endpoint: https://<API_KEY>:<API_SECRET>@qryn.gigapipe.com/loki/api/v1/push
timeout: 30s
prometheusremotewrite:
endpoint: https://<API_KEY>:<API_SECRET>@qryn.gigapipe.com/prom/remote/write
timeout: 30s
processors:
attributes:
actions:
- action: insert
key: loki.attribute.labels
value: sender

extensions:
health_check:
pprof:
zpages:
memory_ballast:
size_mib: 1000

service:
pipelines:
traces:
receivers: [zipkin]
exporters: [otlphttp]
logs:
receivers: [loki]
processors: [attributes]
exporters: [loki]
metrics:
receivers: [hostmetrics]
exporters: [prometheusremotewrite]
```
?> _That's it!_ You're now _tracing spans to **qryn** using OTLP Collector!
Expand Down

0 comments on commit e6fb799

Please sign in to comment.