Skip to content

Avoid the exporter for being stuck when telemetry data is bigger than batch.max_size #12982

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

iblancasa
Copy link
Contributor

@iblancasa iblancasa commented May 7, 2025

Description

This change fixes a bug where the exporter would get stuck when the telemetry data is bigger than batch.max_size. The bug was causing the OpenTelemetry Collector to hang and being OOM Killed at some point.

Link to tracking issue

Fixes #12893

@iblancasa iblancasa requested review from bogdandrutu, dmitryax and a team as code owners May 7, 2025 11:05
Copy link

codecov bot commented May 7, 2025

Codecov Report

Attention: Patch coverage is 98.21429% with 2 lines in your changes missing coverage. Please review.

Project coverage is 91.28%. Comparing base (c9aaed8) to head (d535853).

Files with missing lines Patch % Lines
...xporterhelper/internal/queuebatch/shard_batcher.go 94.11% 0 Missing and 2 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main   #12982      +/-   ##
==========================================
- Coverage   91.29%   91.28%   -0.01%     
==========================================
  Files         509      510       +1     
  Lines       28735    28819      +84     
==========================================
+ Hits        26233    26307      +74     
- Misses       1988     1996       +8     
- Partials      514      516       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@dmitryax
Copy link
Member

@iblancasa can you please split the PR in two? One fixes the bug, another adds the telemetry

@iblancasa
Copy link
Contributor Author

@iblancasa can you please split the PR in two? One fixes the bug, another adds the telemetry

Sure :)

@iblancasa iblancasa force-pushed the 12893 branch 2 times, most recently from a129a87 to 5b46dc5 Compare May 28, 2025 11:37
@iblancasa
Copy link
Contributor Author

@dmitryax the PR is ready for another review

@iblancasa iblancasa force-pushed the 12893 branch 2 times, most recently from 70aae5f to 16d9ebd Compare June 6, 2025 15:09
… batch.max_size

Signed-off-by: Israel Blancas <iblancasa@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[exporterhelper] A collector is eventually OOMKilled when one telemetry data is bigger than a batch max_size and the request sizer is bytes
3 participants
pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy