Strimzi
Replies: 13 comments 4 replies
-
|
I guess a start would be to explain what exactly you are doing, share your configurations, full logs, explain what exactly you see and where etc. |
Beta Was this translation helpful? Give feedback.
-
|
We are simulating the traffic with 3 kafka broker Pods. One cruise control Pod running which monitors the 3 kafka broker pods. Producer and consumer traffic running. during traffic handling time, below warning error reported: "Skip generating metric sample for broker 2 because all broker metrics are missing.", "metadata": {"container_name": "cruise-control", "pod_name": "cruise-control-5489c5488f-nld6q"}, "extra_data": {"file": "SamplingUtils.java", "line": "295", "mbkf_cluster_name" |
Beta Was this translation helpful? Give feedback.
-
|
"warning", "service_id": "Skip generating metric sample for broker 2 because all broker metrics are missing.", "metadata": {"container_name": "cruise-control", "pod_name": "cruise-control-5489c5488f-nld6q"}, "extra_data": {"file": "SamplingUtils.java", "line": "295", "mbkf_cluster_name"}} |
Beta Was this translation helpful? Give feedback.
-
|
Please share your analysis. Is there possibility to disable the warning. |
Beta Was this translation helpful? Give feedback.
-
|
Hi @nsettipa, here you can find more info about this warning. If you don't share your Strimzi configuration, we won't be able to help. You can use this tools to collect configurations and logs from your cluster. |
Beta Was this translation helpful? Give feedback.
-
|
Pls find enclosed configuration and cruise-control logs where warnings are reported for broker pods, metrics missing. |
Beta Was this translation helpful? Give feedback.
-
|
Configuration:
|
Beta Was this translation helpful? Give feedback.
-
|
Hi,
Is there possibility to provide the solution or recommends. I downloaded
cruise-control and found that below code, where this warning reported.
private static boolean skipBuildingBrokerMetricSample(BrokerLoad
brokerLoad, int brokerId) {
if (brokerLoad == null) {
LOG.warn("{}broker {} because all broker metrics are missing.",
SKIP_BUILDING_SAMPLE_PREFIX, brokerId);
return true;
when workLoad is null, this warning reported. when this warning will be
reported. what is the interpretation of brokerLoad null.
This is found in cruisecontrol/monitor/sampling/SamplingUtils.jav
Thank you.
Rgds,
Narasimham
On Tue, 24 Sept 2024 at 10:27, Narasimham Settipalli ***@***.***>
wrote:
… Pls find enclosed cluster configuration for message bus and kafka,
cruise-control and also collected logs.
On Mon, 23 Sept 2024 at 21:34, Federico Valeri ***@***.***>
wrote:
> Hi @nsettipa <https://github.com/nsettipa>, here
> <https://github.com/linkedin/cruise-control/wiki/Troubleshooting#warn-skip-generating-metric-sample-for-broker-because-all-broker-metrics-are-missing>
> you can find more info about this warning. If you don't share your Strimzi
> configuration, we won't be able to help. You can use this tools
> <https://github.com/strimzi/strimzi-kafka-operator/blob/main/tools/report.sh>
> to collect configurations and logs from your cluster.
>
> —
> Reply to this email directly, view it on GitHub
> <#10626 (comment)>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AC7EJS7FOFFA7VDAG5VWQXDZYA3X7AVCNFSM6AAAAABOWCUFA6VHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTANZSHA2TGMI>
> .
> You are receiving this because you were mentioned.Message ID:
> <strimzi/strimzi-kafka-operator/repo-discussions/10626/comments/10728531@
> github.com>
>
|
Beta Was this translation helpful? Give feedback.
-
|
Any update on this ticket. Could you pls confirm whether it can be fixed on
cruisecontrol side or any specific broker side changes needed
Broker side kakfa cruise control reporter jar exists.
On Fri, 27 Sept, 2024, 15:15 Narasimham Settipalli, ***@***.***>
wrote:
… Hi,
Is there possibility to provide the solution or recommends. I downloaded
cruise-control and found that below code, where this warning reported.
private static boolean skipBuildingBrokerMetricSample(BrokerLoad
brokerLoad, int brokerId) {
if (brokerLoad == null) {
LOG.warn("{}broker {} because all broker metrics are missing.",
SKIP_BUILDING_SAMPLE_PREFIX, brokerId);
return true;
when workLoad is null, this warning reported. when this warning will be
reported. what is the interpretation of brokerLoad null.
This is found in cruisecontrol/monitor/sampling/SamplingUtils.jav
Thank you.
Rgds,
Narasimham
On Tue, 24 Sept 2024 at 10:27, Narasimham Settipalli ***@***.***>
wrote:
> Pls find enclosed cluster configuration for message bus and kafka,
> cruise-control and also collected logs.
>
> On Mon, 23 Sept 2024 at 21:34, Federico Valeri ***@***.***>
> wrote:
>
>> Hi @nsettipa <https://github.com/nsettipa>, here
>> <https://github.com/linkedin/cruise-control/wiki/Troubleshooting#warn-skip-generating-metric-sample-for-broker-because-all-broker-metrics-are-missing>
>> you can find more info about this warning. If you don't share your Strimzi
>> configuration, we won't be able to help. You can use this tools
>> <https://github.com/strimzi/strimzi-kafka-operator/blob/main/tools/report.sh>
>> to collect configurations and logs from your cluster.
>>
>> —
>> Reply to this email directly, view it on GitHub
>> <#10626 (comment)>,
>> or unsubscribe
>> <https://github.com/notifications/unsubscribe-auth/AC7EJS7FOFFA7VDAG5VWQXDZYA3X7AVCNFSM6AAAAABOWCUFA6VHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTANZSHA2TGMI>
>> .
>> You are receiving this because you were mentioned.Message ID:
>> <strimzi/strimzi-kafka-operator/repo-discussions/10626/comments/10728531
>> @github.com>
>>
>
|
Beta Was this translation helpful? Give feedback.
-
|
Any update on the analysis. Any correction would be expected for this issue. Please let me know. Thanks a lot. |
Beta Was this translation helpful? Give feedback.
-
|
TBH, I'm not sure what exactly you expect here. Nothing that you shared is properly formatted and is there fore unreadable. More over, Strimzi just orchestrates Kafka and Cruise Control. It might not be able to give you an answer for low-level questions about them. You might need to ask about it in the respective communities of given projects. |
Beta Was this translation helpful? Give feedback.
-
|
The cruise-control log shows below warning: In the function: private static boolean skipBuildingBrokerMetricSample Looks like brokerLoad is null, when this could happen. Is it that, broker metrics not received. we ensured metrics reporting jar is running on all kafka broker pods. |
Beta Was this translation helpful? Give feedback.
-
|
Ok - so this kind of question is probably something to ask in the Cruise Control community. Please ask there. I'm not sure if anyone in Strimzi has this level of deep source code knowledge of Cruise Control. |
Beta Was this translation helpful? Give feedback.
-
|
Could you pls provide community details. I will raise there. Thank you.
…On Fri, 4 Oct 2024, 18:05 Jakub Scholz, ***@***.***> wrote:
Ok - so this kind of question is probably something to ask in the Cruise
Control community. Please ask there. I'm not sure if anyone in Strimzi has
this level of deep source code knowledge of Cruise Control.
—
Reply to this email directly, view it on GitHub
<#10626 (reply in thread)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AC7EJSZ3PN37RG3LCF3G62LZZ2DRJAVCNFSM6AAAAABOWCUFA6VHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTAOBUGM4TAMQ>
.
You are receiving this because you were mentioned.Message ID:
<strimzi/strimzi-kafka-operator/repo-discussions/10626/comments/10843902@
github.com>
|
Beta Was this translation helpful? Give feedback.
-
|
The Cruise Control project is on GitHub. Not sure if the use GitHub discussions, issues, if they have some Slack channel etc. You would have to check it out. |
Beta Was this translation helpful? Give feedback.
-
|
Hi,
I was unable to create ticket/issue/clarifications on cruise-control. could
you please help regarding this?.
Thanks in advance.
Rgds,
Narasimham
…On Fri, 4 Oct 2024 at 18:14, Jakub Scholz ***@***.***> wrote:
The Cruise Control project is on GitHub. Not sure if the use GitHub
discussions, issues, if they have some Slack channel etc. You would have to
check it out.
—
Reply to this email directly, view it on GitHub
<#10626 (reply in thread)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AC7EJSZA2M5GEE7FPHRFGALZZ2ESHAVCNFSM6AAAAABOWCUFA6VHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTAOBUGM4TSOA>
.
You are receiving this because you were mentioned.Message ID:
<strimzi/strimzi-kafka-operator/repo-discussions/10626/comments/10843998@
github.com>
|
Beta Was this translation helpful? Give feedback.
-
|
What was so hard to go here https://github.com/linkedin/cruise-control/issues and click on the "New Issue" button? |
Beta Was this translation helpful? Give feedback.
-
Bug Description
we are using kafka for messaging and events generation. Producer and consumer traffic ongoing and once in a while below warning reported for metrics collection.
Skip generating metric sample for broker 1 because all broker metrics are missing.
This warning reported for cruisecontrol when kubectl logs captured and analyzed the logs.
This warning reported while traffic running.
Does this have any impact on metrics collection or brokers performance as such. This issue observed on latest cruise-control and kafka versions.
Steps to reproduce
No response
Expected behavior
we would like to know if this warning can be ignored or causing functional impact.
Strimzi version
latest strimzi version
Kubernetes version
1.29
Installation method
installed pods through k apply -f kafka yaml where cruisecontrol also activated
Infrastructure
K8s cluster on linux
Configuration files and logs
No response
Additional context
No response
Beta Was this translation helpful? Give feedback.
All reactions