Disk buffering span exporter to avoid data loss (existing Java feature)

[mfarzami]

What problem do you want to solve?

The current span exporter offerings may drop spans under high traffic if the buffer overflows.

Describe the solution you'd like

I am looking for a Python version of the disk buffering span exporters that were released in Java (https://github.com/open-telemetry/opentelemetry-java-contrib/tree/main/disk-buffering). These exporters store telemetry data in files which can be sent later on demand. There is a thread buffering the spans to a disk and a thread reading the spans from the disk.

Describe alternatives you've considered

Writing a custom span exporter that uses queueing/local storage to avoid overload, which would be complicated.

Additional Context

No response

Would you like to implement a fix?

None

[aabmass]

Describe alternatives you've considered

Writing a custom span exporter that uses queueing/local storage to avoid overload, which would be complicated.

Isn't that the feature request here?

[mfarzami]

Thanks for your quick response! Yes it is, I meant that the alternative to an OpenTelemetry feature would be to write a custom exporter myself for my use case, but I believe the exporter would be a feature that benefits other users as well (as illustrated by the decision to create a Java version). Let me know your thoughts!