Trying to ingest data into thanos-receive without prometheus

[pmcarreiro]

Hello all,

I have a request to ingest data into thanos-receive without using Prometheus. I have made a client in Python, but when I send the information I'm getting the following in Thanos-receive logs:
ts=2025-01-29T17:45:06.364294622Z caller=handler.go:535 level=error component=receive component=receive-handler tenant=default-tenant msg="snappy decode error" err="s2: corrupt input"

Attached my python file, i want to know if some one can help on this.

The thanos version that i'm using is 0.3
sendtoprometheus.txt
7.2

Many thanks and best regards,
Paulo

[dosubot[bot]]

Hello @pmcarreiro,

I'm here to help you with any bugs, questions, or contributions. Let's work together to solve this issue.

Dosu

The "snappy decode error" with the message "s2: corrupt input" suggests that there might be an issue with how the data is being encoded or compressed before being sent to Thanos-receive. Thanos-receive expects data in the Prometheus remote-write format, which uses protobuf messages and typically involves snappy compression.

Here are a few steps you can take to troubleshoot and resolve this issue:

1. Ensure Correct Encoding: Verify that your Python client is correctly encoding the data into a protobuf message. The Prometheus remote-write protocol requires the data to be serialized in this format.

2. Check Compression: Make sure that the data is being compressed using the "snappy" algorithm. If your client is not using snappy compression, or if the compression is not implemented correctly, it could lead to the "corrupt input" error.

3. Review the Payload: Double-check the structure of the payload being sent. Each payload should contain a list of time-series samples and labels, with at most one sample per time series.

4. Use a Known Library: Consider using a library that already implements the Prometheus remote-write protocol in Python. This can help ensure that the data is correctly formatted and compressed.

If you continue to encounter issues, reviewing the specific implementation details in your Python client might be necessary to identify any discrepancies in the data formatting or compression process.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}