Jul 23 00:04:18.021733 ip-10-0-137-249 systemd[1]: Starting Kubernetes Kubelet... Jul 23 00:04:18.395757 ip-10-0-137-249 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 00:04:18.395757 ip-10-0-137-249 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 00:04:18.395757 ip-10-0-137-249 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 00:04:18.395757 ip-10-0-137-249 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 00:04:18.395757 ip-10-0-137-249 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 00:04:18.398488 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.398317 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 00:04:18.402136 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402118 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 00:04:18.402136 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402136 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402140 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402144 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402147 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402150 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402153 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402156 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402159 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402163 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402166 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402174 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402177 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402180 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402183 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402185 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402188 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402190 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402193 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402196 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402198 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 00:04:18.402209 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402201 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402203 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402206 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402209 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402212 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402214 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402217 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402220 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402222 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402225 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402228 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402230 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402233 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402235 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402238 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402240 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402243 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402249 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402251 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402254 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 00:04:18.402679 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402256 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402259 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402261 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402264 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402267 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402269 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402271 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402274 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402276 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402279 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402282 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402284 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402286 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402289 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402292 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402298 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402302 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402306 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402309 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 00:04:18.403192 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402312 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402315 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402317 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402320 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402323 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402326 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402329 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402332 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402334 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402337 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402339 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402342 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402345 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402347 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402350 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402352 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402355 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402357 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402360 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402362 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 00:04:18.403658 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402365 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402368 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402371 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402373 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402376 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402391 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402394 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402398 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402401 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402405 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402410 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402413 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402417 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402420 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402424 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402428 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402431 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402434 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 00:04:18.404128 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.402437 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 00:04:18.405196 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405182 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 00:04:18.405196 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405194 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405199 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405202 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405205 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405208 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405211 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405214 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405216 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405219 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405222 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405225 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405228 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405230 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405233 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405236 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405238 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405241 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405243 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405246 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405250 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 00:04:18.405255 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405253 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405256 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405259 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405262 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405265 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405268 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405271 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405273 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405276 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405278 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405281 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405284 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405286 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405289 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405292 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405294 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405297 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405300 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405308 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 00:04:18.405794 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405312 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405316 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405319 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405322 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405324 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405327 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405329 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405331 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405334 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405336 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405339 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405342 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405344 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405346 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405349 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405352 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405355 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405358 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405360 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405363 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 00:04:18.406265 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405366 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405369 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405371 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405374 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405394 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405399 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405403 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405406 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405408 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405411 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405414 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405417 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405420 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405422 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405424 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405427 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405431 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405435 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405438 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 00:04:18.406768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405440 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405443 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405446 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405449 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405451 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405454 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405456 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405459 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405464 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405467 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405470 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405473 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405475 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405478 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405480 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405483 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405485 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405488 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405490 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405493 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 00:04:18.407235 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405875 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405882 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405886 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405889 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405893 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405896 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405899 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405902 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405905 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405908 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405911 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405913 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405916 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405920 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405923 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405926 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405929 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405931 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405934 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 00:04:18.407728 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405936 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405940 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405944 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405946 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405949 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405951 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405961 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405964 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405966 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405969 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405971 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405974 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405976 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405978 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405981 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405983 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405985 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405988 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405996 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 00:04:18.408190 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.405998 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406001 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406003 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406006 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406009 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406012 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406015 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406017 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406020 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406023 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406026 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406028 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406031 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406033 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406036 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406039 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406042 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406044 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406047 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406050 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 00:04:18.408660 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406052 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406055 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406057 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406060 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406062 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406065 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406067 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406070 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406073 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406075 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406077 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406081 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406084 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406086 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406089 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406091 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406094 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406096 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406100 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 00:04:18.409139 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406103 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406105 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406108 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406110 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406113 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406115 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406118 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406120 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406123 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406125 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406128 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406131 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406133 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406135 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406138 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406141 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406143 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406146 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406148 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406151 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 00:04:18.409615 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406153 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406156 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406230 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406238 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406245 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406250 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406271 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406275 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406280 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406285 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406289 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406292 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406295 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406299 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406302 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406305 2574 flags.go:64] FLAG: --cgroup-root="" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406308 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406311 2574 flags.go:64] FLAG: --client-ca-file="" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406314 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406316 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406320 2574 flags.go:64] FLAG: --cluster-domain="" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406323 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406326 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406329 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 00:04:18.410095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406333 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406337 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406340 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406343 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406346 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406350 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406353 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406356 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406359 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406362 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406367 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406369 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406373 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406376 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406392 2574 flags.go:64] FLAG: --enable-server="true" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406404 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406414 2574 flags.go:64] FLAG: --event-burst="100" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406417 2574 flags.go:64] FLAG: --event-qps="50" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406420 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406424 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406427 2574 flags.go:64] FLAG: --eviction-hard="" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406431 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406434 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406437 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406440 2574 flags.go:64] FLAG: --eviction-soft="" Jul 23 00:04:18.410673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406443 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406446 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406448 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406451 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406454 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406457 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406460 2574 flags.go:64] FLAG: --feature-gates="" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406464 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406467 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406470 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406473 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406476 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406479 2574 flags.go:64] FLAG: --help="false" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406482 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406485 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406488 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406492 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406495 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406499 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406502 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406505 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406507 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406510 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 00:04:18.411314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406519 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406523 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406526 2574 flags.go:64] FLAG: --kube-reserved="" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406529 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406532 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406535 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406538 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406541 2574 flags.go:64] FLAG: --lock-file="" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406544 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406546 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406549 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406555 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406558 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406561 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406564 2574 flags.go:64] FLAG: --logging-format="text" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406567 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406570 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406573 2574 flags.go:64] FLAG: --manifest-url="" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406579 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406583 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406586 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406591 2574 flags.go:64] FLAG: --max-pods="110" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406594 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406597 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406599 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 00:04:18.411899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406602 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406605 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406608 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406611 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406619 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406622 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406625 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406628 2574 flags.go:64] FLAG: --pod-cidr="" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406637 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406643 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406646 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406649 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406652 2574 flags.go:64] FLAG: --port="10250" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406655 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406658 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f983eacda7314aff" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406661 2574 flags.go:64] FLAG: --qos-reserved="" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406664 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406667 2574 flags.go:64] FLAG: --register-node="true" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406670 2574 flags.go:64] FLAG: --register-with-taints="" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406674 2574 flags.go:64] FLAG: --registry-burst="10" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406676 2574 flags.go:64] FLAG: --registry-qps="5" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406679 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406682 2574 flags.go:64] FLAG: --reserved-memory="" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406685 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406688 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 00:04:18.412516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406692 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406695 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406698 2574 flags.go:64] FLAG: --runonce="false" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406701 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406705 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406707 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406710 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406713 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406716 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406720 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406723 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406725 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406728 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406731 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406734 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406737 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406740 2574 flags.go:64] FLAG: --system-cgroups="" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406745 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406750 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406753 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406756 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406763 2574 flags.go:64] FLAG: --tls-min-version="" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406766 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406768 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406771 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 00:04:18.413133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406774 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406778 2574 flags.go:64] FLAG: --v="2" Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406782 2574 flags.go:64] FLAG: --version="false" Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406786 2574 flags.go:64] FLAG: --vmodule="" Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406790 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.406793 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406924 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406930 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406933 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406936 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406938 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406941 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406944 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406946 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406949 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406951 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406954 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406956 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406959 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406961 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406964 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 00:04:18.413878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406967 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406969 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406972 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406977 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406979 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406982 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406985 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406988 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406990 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406992 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406995 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.406998 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407001 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407003 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407006 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407010 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407014 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407017 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407021 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407024 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 00:04:18.414404 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407026 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407029 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407031 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407034 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407037 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407041 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407044 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407047 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407049 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407052 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407055 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407058 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407062 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407065 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407067 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407072 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407075 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407078 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407081 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407083 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 00:04:18.414938 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407086 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407089 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407091 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407093 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407096 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407099 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407101 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407104 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407106 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407109 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407116 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407119 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407121 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407124 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407126 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407129 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407132 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407134 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407137 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407139 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 00:04:18.415432 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407142 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407145 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407147 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407150 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407153 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407155 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407158 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407162 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407165 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407168 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407170 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407173 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407175 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407178 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407180 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407183 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407186 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407188 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407191 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407193 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 00:04:18.415921 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407196 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407198 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407203 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.407206 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.407739 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.415173 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.415191 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.415867 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.415876 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415938 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415944 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415947 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415951 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415954 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415957 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 00:04:18.416526 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415960 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415963 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415966 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415969 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415972 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415975 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415979 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415983 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415985 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415988 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415991 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415993 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415996 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.415998 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416001 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416003 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416006 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416009 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416012 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416014 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 00:04:18.416917 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416017 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416020 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416023 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416026 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416030 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416032 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416035 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416038 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416040 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416043 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416046 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416049 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416051 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416054 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416056 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416059 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416061 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416066 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416070 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416073 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 00:04:18.417494 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416076 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416079 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416082 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416085 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416087 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416090 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416093 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416095 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416098 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416100 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416103 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416105 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416108 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416111 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416115 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416119 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416123 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416126 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416128 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 00:04:18.417969 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416131 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416134 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416138 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416142 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416145 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416148 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416151 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416154 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416157 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416160 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416163 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416166 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416169 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416172 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416176 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416178 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416181 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416183 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416186 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 00:04:18.418442 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416206 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416210 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416213 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416215 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416218 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416221 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416224 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416227 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416231 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416234 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416237 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416240 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416243 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416246 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416248 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 00:04:18.418893 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.416253 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416399 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416405 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416409 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416413 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416416 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416420 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416423 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416425 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416429 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416431 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416434 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416437 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416440 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416443 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416445 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416448 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416451 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416453 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 00:04:18.419282 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416456 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416460 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416463 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416466 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416469 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416473 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416475 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416478 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416481 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416484 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416487 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416490 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416493 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416496 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416498 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416501 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416503 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416506 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416509 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416511 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 00:04:18.419753 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416514 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416516 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416520 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416522 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416525 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416527 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416531 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416533 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416536 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416539 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416542 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416545 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416547 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416549 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416552 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416554 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416557 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416559 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416562 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416565 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 00:04:18.420259 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416569 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416572 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416575 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416578 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416580 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416583 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416586 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416588 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416591 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416593 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416596 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416599 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416601 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416604 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416607 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416610 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416613 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416616 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416618 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 00:04:18.420800 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416622 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416624 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416627 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416629 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416632 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416635 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416637 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416639 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416642 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416644 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416647 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416649 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416652 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416655 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416658 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416660 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416662 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416665 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416668 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416670 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 00:04:18.421254 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416673 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 00:04:18.421758 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:18.416675 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 00:04:18.421758 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.416680 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 00:04:18.421758 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.416819 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 00:04:18.421758 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.418766 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 00:04:18.421758 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.419949 2574 server.go:1019] "Starting client certificate rotation" Jul 23 00:04:18.421758 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.420050 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 00:04:18.421758 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.420096 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 00:04:18.422138 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.422122 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 00:04:18.427536 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.427509 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 00:04:18.437016 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.436993 2574 log.go:25] "Validated CRI v1 runtime API" Jul 23 00:04:18.438928 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.438909 2574 log.go:25] "Validated CRI v1 image API" Jul 23 00:04:18.440577 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.440560 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 00:04:18.442721 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.442693 2574 fs.go:135] Filesystem UUIDs: map[38d4be46-93e7-45db-850e-6fd1b7c4655a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ad46a79d-ed6b-4408-8694-310e987c246b:/dev/nvme0n1p3] Jul 23 00:04:18.442791 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.442720 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 00:04:18.448356 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.448234 2574 manager.go:216] Machine: {Timestamp:2026-07-23 00:04:18.447073528 +0000 UTC m=+0.311242691 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099608 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec217097afe8d9ee7c61c1203d77ea0b SystemUUID:ec217097-afe8-d9ee-7c61-c1203d77ea0b BootID:6c43fa7b-aea4-4c8c-9ac5-426dccce2f3e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b3:51:d1:f7:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b3:51:d1:f7:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:be:8a:95:5f:bd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 00:04:18.448356 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.448350 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 00:04:18.448500 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.448455 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 00:04:18.450432 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.450415 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 00:04:18.451150 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.451118 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 00:04:18.451291 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.451155 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-249.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 00:04:18.451747 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.451736 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 00:04:18.451784 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.451749 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 00:04:18.451784 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.451757 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 00:04:18.452254 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.452244 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 00:04:18.453923 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.453909 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 00:04:18.456673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.456659 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 23 00:04:18.456807 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.456797 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 00:04:18.456846 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.456829 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 23 00:04:18.456846 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.456840 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 00:04:18.456903 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.456856 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 00:04:18.456903 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.456866 2574 kubelet.go:398] "Adding apiserver pod source" Jul 23 00:04:18.456903 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.456875 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 00:04:18.457368 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.457348 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 00:04:18.457368 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.457371 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 00:04:18.459119 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.459102 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 00:04:18.460519 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.460506 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 00:04:18.460561 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.460536 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 00:04:18.461214 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461202 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 00:04:18.461247 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461223 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 00:04:18.461247 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461233 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 00:04:18.461247 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461241 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 00:04:18.461328 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461254 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 00:04:18.461328 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461263 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 00:04:18.461328 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461275 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 00:04:18.461328 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461283 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 00:04:18.461328 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461294 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 00:04:18.461328 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461303 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 00:04:18.461328 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461326 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 00:04:18.461522 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461335 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 00:04:18.461957 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461947 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 00:04:18.462000 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.461958 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 00:04:18.465265 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.465251 2574 server.go:1268] "Started kubelet" Jul 23 00:04:18.465426 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.465351 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 00:04:18.465511 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.465472 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 00:04:18.468118 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.468076 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 00:04:18.468427 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.468405 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 00:04:18.468900 ip-10-0-137-249 systemd[1]: Started Kubernetes Kubelet. Jul 23 00:04:18.470064 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.469832 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 00:04:18.470064 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.469895 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-249.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 00:04:18.470064 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.469930 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 00:04:18.470585 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.470559 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 00:04:18.471714 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.471701 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 23 00:04:18.474299 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.474279 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b2mrf" Jul 23 00:04:18.474582 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.473723 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-249.ec2.internal.18c4c25d555952d7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-249.ec2.internal,UID:ip-10-0-137-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-249.ec2.internal,},FirstTimestamp:2026-07-23 00:04:18.465223383 +0000 UTC m=+0.329392579,LastTimestamp:2026-07-23 00:04:18.465223383 +0000 UTC m=+0.329392579,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-249.ec2.internal,}" Jul 23 00:04:18.476452 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.476435 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 00:04:18.476608 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.476527 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 00:04:18.476608 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.476533 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found" Jul 23 00:04:18.477100 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.477066 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 00:04:18.477100 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.477066 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 00:04:18.477100 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.477103 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 00:04:18.477258 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.477185 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 23 00:04:18.477258 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.477195 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 23 00:04:18.477519 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.477499 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 00:04:18.477519 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.477519 2574 factory.go:55] Registering systemd factory Jul 23 00:04:18.477649 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.477529 2574 factory.go:223] Registration of the systemd container factory successfully Jul 23 00:04:18.477792 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.477776 2574 factory.go:153] Registering CRI-O factory Jul 23 00:04:18.477847 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.477797 2574 factory.go:223] Registration of the crio container factory successfully Jul 23 00:04:18.477847 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.477825 2574 factory.go:103] Registering Raw factory Jul 23 00:04:18.477847 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.477842 2574 manager.go:1196] Started watching for new ooms in manager Jul 23 00:04:18.478378 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.478362 2574 manager.go:349] Starting recovery of all containers Jul 23 00:04:18.484022 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.483995 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b2mrf" Jul 23 00:04:18.486114 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.486085 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 00:04:18.486232 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.486206 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 00:04:18.489401 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.489381 2574 manager.go:354] Recovery completed Jul 23 00:04:18.491571 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.491541 2574 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 23 00:04:18.494708 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.494695 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 00:04:18.496656 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.496587 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory" Jul 23 00:04:18.496656 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.496623 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 00:04:18.496656 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.496640 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID" Jul 23 00:04:18.497284 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.497254 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 00:04:18.497284 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.497272 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 00:04:18.497492 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.497273 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 00:04:18.497492 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.497341 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 23 00:04:18.498176 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.498160 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory" Jul 23 00:04:18.498239 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.498189 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 00:04:18.498239 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.498200 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID" Jul 23 00:04:18.498540 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.498523 2574 policy_none.go:49] "None policy: Start" Jul 23 00:04:18.498632 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.498547 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 00:04:18.498632 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.498563 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 00:04:18.498887 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.498807 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-249.ec2.internal.18c4c25d57382107 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-249.ec2.internal,UID:ip-10-0-137-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-249.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-249.ec2.internal,},FirstTimestamp:2026-07-23 00:04:18.496602375 +0000 UTC m=+0.360771548,LastTimestamp:2026-07-23 00:04:18.496602375 +0000 UTC m=+0.360771548,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-249.ec2.internal,}" Jul 23 00:04:18.499655 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.499639 2574 policy_none.go:47] "Start" Jul 23 00:04:18.535435 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.535195 2574 manager.go:337] "Starting Device Plugin manager" Jul 23 00:04:18.535577 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.535456 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 00:04:18.535577 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.535472 2574 server.go:87] "Starting device plugin registration server" Jul 23 00:04:18.535786 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.535771 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 00:04:18.535832 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.535786 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 00:04:18.535919 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.535902 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 00:04:18.536002 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.535990 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 00:04:18.536054 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.536004 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 00:04:18.536588 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.536566 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 00:04:18.536690 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.536616 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-249.ec2.internal\" not found" Jul 23 00:04:18.639110 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.639071 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 00:04:18.640284 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.640272 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory" Jul 23 00:04:18.640345 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.640304 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 00:04:18.640345 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.640321 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID" Jul 23 00:04:18.640427 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.640354 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.646992 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.646914 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 00:04:18.648252 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.648232 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 00:04:18.648364 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.648272 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 00:04:18.648364 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.648304 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 00:04:18.648364 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.648349 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 00:04:18.650713 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.650693 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.650810 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.650719 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-249.ec2.internal\": node \"ip-10-0-137-249.ec2.internal\" not found" Jul 23 00:04:18.651559 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.651538 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 00:04:18.701103 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.701071 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found" Jul 23 00:04:18.750760 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.750719 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"] Jul 23 00:04:18.750872 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.750816 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 00:04:18.752659 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.752622 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory" Jul 23 00:04:18.752659 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.752654 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 00:04:18.752659 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.752665 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID" Jul 23 00:04:18.754041 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.754026 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 00:04:18.754167 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.754150 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.754245 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.754199 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 00:04:18.754849 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.754832 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory" Jul 23 00:04:18.754938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.754861 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 00:04:18.754938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.754872 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID" Jul 23 00:04:18.755441 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.755418 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory" Jul 23 00:04:18.755514 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.755447 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 00:04:18.755514 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.755459 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID" Jul 23 00:04:18.756722 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.756700 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.756788 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.756726 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 00:04:18.757457 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.757439 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory" Jul 23 00:04:18.757538 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.757471 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 00:04:18.757538 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.757487 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID" Jul 23 00:04:18.778922 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.778888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29a3b8849e7de9826bbe69d4f142303f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"29a3b8849e7de9826bbe69d4f142303f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.778922 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.778924 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9eae42e7d66416d6ea3b4d6c66b2c30-config\") pod \"kube-apiserver-proxy-ip-10-0-137-249.ec2.internal\" (UID: \"f9eae42e7d66416d6ea3b4d6c66b2c30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.779127 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.778951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/29a3b8849e7de9826bbe69d4f142303f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"29a3b8849e7de9826bbe69d4f142303f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.780248 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.780226 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-249.ec2.internal\" not found" node="ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.785345 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.785323 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-249.ec2.internal\" not found" node="ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.801186 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.801152 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found" Jul 23 00:04:18.879618 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.879584 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29a3b8849e7de9826bbe69d4f142303f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"29a3b8849e7de9826bbe69d4f142303f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.879618 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.879621 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9eae42e7d66416d6ea3b4d6c66b2c30-config\") pod \"kube-apiserver-proxy-ip-10-0-137-249.ec2.internal\" (UID: \"f9eae42e7d66416d6ea3b4d6c66b2c30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.879872 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.879638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/29a3b8849e7de9826bbe69d4f142303f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"29a3b8849e7de9826bbe69d4f142303f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.879872 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.879681 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/29a3b8849e7de9826bbe69d4f142303f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"29a3b8849e7de9826bbe69d4f142303f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.879872 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.879702 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29a3b8849e7de9826bbe69d4f142303f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"29a3b8849e7de9826bbe69d4f142303f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.879872 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:18.879706 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9eae42e7d66416d6ea3b4d6c66b2c30-config\") pod \"kube-apiserver-proxy-ip-10-0-137-249.ec2.internal\" (UID: \"f9eae42e7d66416d6ea3b4d6c66b2c30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" Jul 23 00:04:18.902269 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:18.902202 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found" Jul 23 00:04:19.003600 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.003562 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found" Jul 23 00:04:19.082664 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.082636 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" Jul 23 00:04:19.090292 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.090257 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" Jul 23 00:04:19.104203 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.104170 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found" Jul 23 00:04:19.205315 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.205212 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found" Jul 23 00:04:19.305878 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.305841 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found" Jul 23 00:04:19.406341 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.406300 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found" Jul 23 00:04:19.414258 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.414223 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 00:04:19.419685 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.419658 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 00:04:19.419838 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.419807 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 00:04:19.419881 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.419833 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 00:04:19.435674 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.435643 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 00:04:19.458539 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.458458 2574 apiserver.go:52] "Watching apiserver" Jul 23 00:04:19.466179 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.466141 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 00:04:19.466546 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.466524 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5t84s","openshift-multus/network-metrics-daemon-dfb42","openshift-network-diagnostics/network-check-target-zh42k","openshift-network-operator/iptables-alerter-dklz5","openshift-ovn-kubernetes/ovnkube-node-qgr7w","kube-system/konnectivity-agent-cbcfq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt","openshift-cluster-node-tuning-operator/tuned-c8dz9","openshift-dns/node-resolver-6d6zq","openshift-image-registry/node-ca-c6qqx","openshift-multus/multus-additional-cni-plugins-jmnw5","openshift-multus/multus-xcffm"] Jul 23 00:04:19.468262 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.468245 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:19.468351 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.468326 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:19.469742 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.469723 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:19.470049 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.470016 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:19.472633 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.472614 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:19.472749 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.472677 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:19.473772 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.473753 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dklz5" Jul 23 00:04:19.475345 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.475323 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.476617 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.476598 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 00:04:19.476617 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.476607 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cbcfq" Jul 23 00:04:19.476823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.476806 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" Jul 23 00:04:19.478164 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.478147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.479540 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.479520 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 00:04:19.479636 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.479581 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dv6z7\"" Jul 23 00:04:19.479636 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.479611 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.480534 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.480519 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 00:04:19.480593 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.480520 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 00:04:19.480665 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.480650 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 00:04:19.480882 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.480868 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lljm4\"" Jul 23 00:04:19.480948 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.480933 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6d6zq" Jul 23 00:04:19.480995 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.480979 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 00:04:19.482473 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.482441 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c6qqx" Jul 23 00:04:19.483835 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.483818 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.484103 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484084 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 00:04:19.484258 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-sys-fs\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.484318 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:19.484318 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbgdp\" (UniqueName: \"kubernetes.io/projected/0e89dbcf-8594-467f-8966-38e817ccc785-kube-api-access-pbgdp\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:19.484318 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484495 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484328 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-cni-bin\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484495 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m5x6\" (UniqueName: \"kubernetes.io/projected/186f56a9-3be0-4a12-9715-83349a5f2bbf-kube-api-access-4m5x6\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484495 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-device-dir\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.484495 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxhcx\" (UniqueName: \"kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx\") pod \"network-check-target-zh42k\" (UID: \"c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf\") " pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:19.484626 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-kubelet\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484626 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-var-lib-openvswitch\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484626 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484576 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-run-openvswitch\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484626 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d720a2e2-82ed-4816-9a16-ce9331dc4c7f-konnectivity-ca\") pod \"konnectivity-agent-cbcfq\" (UID: \"d720a2e2-82ed-4816-9a16-ce9331dc4c7f\") " pod="kube-system/konnectivity-agent-cbcfq" Jul 23 00:04:19.484751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484638 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.484751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484658 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzxd7\" (UniqueName: \"kubernetes.io/projected/34abc870-3db4-4f2f-811b-7bd94f34ef7b-kube-api-access-jzxd7\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.484751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484680 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20402179-b992-42ea-91a0-0df7d5415521-kubelet-config\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:19.484751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-run-netns\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484711 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-run-ovn\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484726 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-log-socket\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484743 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484958 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/186f56a9-3be0-4a12-9715-83349a5f2bbf-env-overrides\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484958 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484782 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-etc-openvswitch\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484958 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484822 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d822b4c-c002-4237-bf6c-9b0d94d6970e-iptables-alerter-script\") pod \"iptables-alerter-dklz5\" (UID: \"6d822b4c-c002-4237-bf6c-9b0d94d6970e\") " pod="openshift-network-operator/iptables-alerter-dklz5" Jul 23 00:04:19.484958 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:19.484958 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-slash\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484958 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484886 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/186f56a9-3be0-4a12-9715-83349a5f2bbf-ovn-node-metrics-cert\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.484958 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-socket-dir\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.484958 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484916 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-registration-dir\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.484958 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484932 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-run-systemd\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.485382 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d822b4c-c002-4237-bf6c-9b0d94d6970e-host-slash\") pod \"iptables-alerter-dklz5\" (UID: \"6d822b4c-c002-4237-bf6c-9b0d94d6970e\") " pod="openshift-network-operator/iptables-alerter-dklz5" Jul 23 00:04:19.485382 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.484987 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh4x6\" (UniqueName: \"kubernetes.io/projected/6d822b4c-c002-4237-bf6c-9b0d94d6970e-kube-api-access-hh4x6\") pod \"iptables-alerter-dklz5\" (UID: \"6d822b4c-c002-4237-bf6c-9b0d94d6970e\") " pod="openshift-network-operator/iptables-alerter-dklz5" Jul 23 00:04:19.485382 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.485004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-node-log\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.485382 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.485018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-cni-netd\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.485382 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.485035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d720a2e2-82ed-4816-9a16-ce9331dc4c7f-agent-certs\") pod \"konnectivity-agent-cbcfq\" (UID: \"d720a2e2-82ed-4816-9a16-ce9331dc4c7f\") " pod="kube-system/konnectivity-agent-cbcfq" Jul 23 00:04:19.485382 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.485053 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20402179-b992-42ea-91a0-0df7d5415521-dbus\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:19.485382 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.485068 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-systemd-units\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.485382 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.485084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/186f56a9-3be0-4a12-9715-83349a5f2bbf-ovnkube-config\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.485382 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.485100 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/186f56a9-3be0-4a12-9715-83349a5f2bbf-ovnkube-script-lib\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.485382 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.485124 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.485382 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.485130 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.485813 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.485611 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.487290 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.487347 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.487409 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.487561 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.487657 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.487569 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.487811 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.487954 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.488036 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.488071 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.488108 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l6w6p\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.488129 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.488211 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.488216 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.487956 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t54gt\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.488400 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dqndl\"" Jul 23 00:04:19.488700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.488440 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 00:04:19.489453 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.488831 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 00:04:19.489453 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.488847 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-csmwd\"" Jul 23 00:04:19.489453 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.488948 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 00:04:19.489453 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.489020 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qtzlw\"" Jul 23 00:04:19.489453 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.489028 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 00:04:19.489453 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.489037 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 00:04:19.489453 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.489060 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 00:04:19.489453 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.489087 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 00:04:19.489453 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.489037 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zlzs7\"" Jul 23 00:04:19.489453 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.489163 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q7vb2\"" Jul 23 00:04:19.491934 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.491897 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 23:59:19 +0000 UTC" deadline="2028-04-04 06:28:42.197487118 +0000 UTC" Jul 23 00:04:19.491934 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.491933 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14910h24m22.705557632s" Jul 23 00:04:19.495355 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.495330 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"] Jul 23 00:04:19.495448 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.495402 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 00:04:19.495513 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.495473 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" Jul 23 00:04:19.505967 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.505945 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 00:04:19.507483 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.507461 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"] Jul 23 00:04:19.508567 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.508551 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 00:04:19.538609 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.538583 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vc4lm" Jul 23 00:04:19.555301 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.555270 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vc4lm" Jul 23 00:04:19.578193 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.578157 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 00:04:19.579477 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.579443 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 00:04:19.585394 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5a0332a-90f8-4956-9096-62890085afe6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.585482 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/484d238c-269c-4c42-9e51-d5d92cbfef41-cni-binary-copy\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.585482 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585441 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d720a2e2-82ed-4816-9a16-ce9331dc4c7f-agent-certs\") pod \"konnectivity-agent-cbcfq\" (UID: \"d720a2e2-82ed-4816-9a16-ce9331dc4c7f\") " pod="kube-system/konnectivity-agent-cbcfq" Jul 23 00:04:19.585482 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585461 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-system-cni-dir\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.585482 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-multus-socket-dir-parent\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.585690 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585500 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/186f56a9-3be0-4a12-9715-83349a5f2bbf-ovnkube-config\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.585690 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/186f56a9-3be0-4a12-9715-83349a5f2bbf-ovnkube-script-lib\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.585792 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-sys-fs\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.585792 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:19.585792 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-os-release\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.585792 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585775 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.585983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585800 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-cni-bin\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.585983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585818 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-sys-fs\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.585983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585829 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-device-dir\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.585983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585860 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhcx\" (UniqueName: \"kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx\") pod \"network-check-target-zh42k\" (UID: \"c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf\") " pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:19.585983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585873 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-cni-bin\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.585983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585887 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-sys\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.585983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-lib-modules\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.585983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-kubelet\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.585983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585950 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-device-dir\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.585983 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.585883 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:19.585983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585970 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.585878 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586009 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-run-openvswitch\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586040 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20402179-b992-42ea-91a0-0df7d5415521-kubelet-config\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586051 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-kubelet\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.586080 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs podName:0e89dbcf-8594-467f-8966-38e817ccc785 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:20.086033522 +0000 UTC m=+1.950202693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs") pod "network-metrics-daemon-dfb42" (UID: "0e89dbcf-8594-467f-8966-38e817ccc785") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586103 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-run-openvswitch\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586124 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20402179-b992-42ea-91a0-0df7d5415521-kubelet-config\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-run\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586164 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/186f56a9-3be0-4a12-9715-83349a5f2bbf-ovnkube-config\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586215 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/186f56a9-3be0-4a12-9715-83349a5f2bbf-ovnkube-script-lib\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586250 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfk9w\" (UniqueName: \"kubernetes.io/projected/a5a0332a-90f8-4956-9096-62890085afe6-kube-api-access-wfk9w\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-run-netns\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-var-lib-kubelet\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-etc-kubernetes\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-log-socket\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.586451 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586426 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-log-socket\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-modprobe-d\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586461 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586478 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-systemd\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5a0332a-90f8-4956-9096-62890085afe6-cnibin\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586535 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-etc-openvswitch\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586562 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d822b4c-c002-4237-bf6c-9b0d94d6970e-iptables-alerter-script\") pod \"iptables-alerter-dklz5\" (UID: \"6d822b4c-c002-4237-bf6c-9b0d94d6970e\") " pod="openshift-network-operator/iptables-alerter-dklz5" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586595 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-etc-openvswitch\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-var-lib-kubelet\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-host\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.586661 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jc67\" (UniqueName: \"kubernetes.io/projected/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-kube-api-access-9jc67\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5a0332a-90f8-4956-9096-62890085afe6-os-release\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.586705 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret podName:20402179-b992-42ea-91a0-0df7d5415521 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:20.086688705 +0000 UTC m=+1.950857875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret") pod "global-pull-secret-syncer-5t84s" (UID: "20402179-b992-42ea-91a0-0df7d5415521") : object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:19.587372 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586726 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-slash\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586743 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/186f56a9-3be0-4a12-9715-83349a5f2bbf-ovn-node-metrics-cert\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586761 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/807b0073-a7e3-4d00-9589-ae775a84e7ad-serviceca\") pod \"node-ca-c6qqx\" (UID: \"807b0073-a7e3-4d00-9589-ae775a84e7ad\") " pod="openshift-image-registry/node-ca-c6qqx" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvnbm\" (UniqueName: \"kubernetes.io/projected/807b0073-a7e3-4d00-9589-ae775a84e7ad-kube-api-access-cvnbm\") pod \"node-ca-c6qqx\" (UID: \"807b0073-a7e3-4d00-9589-ae775a84e7ad\") " pod="openshift-image-registry/node-ca-c6qqx" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586788 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-slash\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586803 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-sysctl-d\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586906 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5a0332a-90f8-4956-9096-62890085afe6-system-cni-dir\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586958 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-run-k8s-cni-cncf-io\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.586986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/484d238c-269c-4c42-9e51-d5d92cbfef41-multus-daemon-config\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587016 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-node-log\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587044 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-cni-netd\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587071 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d822b4c-c002-4237-bf6c-9b0d94d6970e-iptables-alerter-script\") pod \"iptables-alerter-dklz5\" (UID: \"6d822b4c-c002-4237-bf6c-9b0d94d6970e\") " pod="openshift-network-operator/iptables-alerter-dklz5" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20402179-b992-42ea-91a0-0df7d5415521-dbus\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587092 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-cni-netd\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587094 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-node-log\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587114 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-tmp\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587137 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce321df6-7f11-4d73-a5ee-ecf33cc54d77-hosts-file\") pod \"node-resolver-6d6zq\" (UID: \"ce321df6-7f11-4d73-a5ee-ecf33cc54d77\") " pod="openshift-dns/node-resolver-6d6zq" Jul 23 00:04:19.587940 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587159 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/807b0073-a7e3-4d00-9589-ae775a84e7ad-host\") pod \"node-ca-c6qqx\" (UID: \"807b0073-a7e3-4d00-9589-ae775a84e7ad\") " pod="openshift-image-registry/node-ca-c6qqx" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5a0332a-90f8-4956-9096-62890085afe6-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587191 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20402179-b992-42ea-91a0-0df7d5415521-dbus\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587210 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-hostroot\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587239 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-systemd-units\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587275 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-systemd-units\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbgdp\" (UniqueName: \"kubernetes.io/projected/0e89dbcf-8594-467f-8966-38e817ccc785-kube-api-access-pbgdp\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-sysconfig\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587350 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5a0332a-90f8-4956-9096-62890085afe6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587379 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5a0332a-90f8-4956-9096-62890085afe6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587383 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-multus-cni-dir\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587468 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m5x6\" (UniqueName: \"kubernetes.io/projected/186f56a9-3be0-4a12-9715-83349a5f2bbf-kube-api-access-4m5x6\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-kubernetes\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-sysctl-conf\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2z5k\" (UniqueName: \"kubernetes.io/projected/ce321df6-7f11-4d73-a5ee-ecf33cc54d77-kube-api-access-g2z5k\") pod \"node-resolver-6d6zq\" (UID: \"ce321df6-7f11-4d73-a5ee-ecf33cc54d77\") " pod="openshift-dns/node-resolver-6d6zq" Jul 23 00:04:19.588635 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587575 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-var-lib-cni-multus\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-multus-conf-dir\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587634 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tkd9\" (UniqueName: \"kubernetes.io/projected/484d238c-269c-4c42-9e51-d5d92cbfef41-kube-api-access-7tkd9\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587677 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-var-lib-openvswitch\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587722 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d720a2e2-82ed-4816-9a16-ce9331dc4c7f-konnectivity-ca\") pod \"konnectivity-agent-cbcfq\" (UID: \"d720a2e2-82ed-4816-9a16-ce9331dc4c7f\") " pod="kube-system/konnectivity-agent-cbcfq" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzxd7\" (UniqueName: \"kubernetes.io/projected/34abc870-3db4-4f2f-811b-7bd94f34ef7b-kube-api-access-jzxd7\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587774 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-var-lib-openvswitch\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-tuned\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587816 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce321df6-7f11-4d73-a5ee-ecf33cc54d77-tmp-dir\") pod \"node-resolver-6d6zq\" (UID: \"ce321df6-7f11-4d73-a5ee-ecf33cc54d77\") " pod="openshift-dns/node-resolver-6d6zq" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587862 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-run-netns\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587894 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-run-ovn\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/186f56a9-3be0-4a12-9715-83349a5f2bbf-env-overrides\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-var-lib-cni-bin\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587969 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-host-run-netns\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.587980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-socket-dir\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.589200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588013 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-registration-dir\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588033 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-run-ovn\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-cnibin\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588076 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-run-multus-certs\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588096 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-registration-dir\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588100 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-run-systemd\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588134 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/186f56a9-3be0-4a12-9715-83349a5f2bbf-run-systemd\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588142 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34abc870-3db4-4f2f-811b-7bd94f34ef7b-socket-dir\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d822b4c-c002-4237-bf6c-9b0d94d6970e-host-slash\") pod \"iptables-alerter-dklz5\" (UID: \"6d822b4c-c002-4237-bf6c-9b0d94d6970e\") " pod="openshift-network-operator/iptables-alerter-dklz5" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588181 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d822b4c-c002-4237-bf6c-9b0d94d6970e-host-slash\") pod \"iptables-alerter-dklz5\" (UID: \"6d822b4c-c002-4237-bf6c-9b0d94d6970e\") " pod="openshift-network-operator/iptables-alerter-dklz5" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588223 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh4x6\" (UniqueName: \"kubernetes.io/projected/6d822b4c-c002-4237-bf6c-9b0d94d6970e-kube-api-access-hh4x6\") pod \"iptables-alerter-dklz5\" (UID: \"6d822b4c-c002-4237-bf6c-9b0d94d6970e\") " pod="openshift-network-operator/iptables-alerter-dklz5" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588286 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d720a2e2-82ed-4816-9a16-ce9331dc4c7f-konnectivity-ca\") pod \"konnectivity-agent-cbcfq\" (UID: \"d720a2e2-82ed-4816-9a16-ce9331dc4c7f\") " pod="kube-system/konnectivity-agent-cbcfq" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.588372 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/186f56a9-3be0-4a12-9715-83349a5f2bbf-env-overrides\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.589518 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/186f56a9-3be0-4a12-9715-83349a5f2bbf-ovn-node-metrics-cert\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.589938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.589657 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d720a2e2-82ed-4816-9a16-ce9331dc4c7f-agent-certs\") pod \"konnectivity-agent-cbcfq\" (UID: \"d720a2e2-82ed-4816-9a16-ce9331dc4c7f\") " pod="kube-system/konnectivity-agent-cbcfq" Jul 23 00:04:19.594708 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.594674 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 00:04:19.594708 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.594700 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 00:04:19.594839 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.594715 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fxhcx for pod openshift-network-diagnostics/network-check-target-zh42k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:19.594839 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.594780 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx podName:c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf nodeName:}" failed. No retries permitted until 2026-07-23 00:04:20.094763539 +0000 UTC m=+1.958932703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhcx" (UniqueName: "kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx") pod "network-check-target-zh42k" (UID: "c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:19.600751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.600702 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzxd7\" (UniqueName: \"kubernetes.io/projected/34abc870-3db4-4f2f-811b-7bd94f34ef7b-kube-api-access-jzxd7\") pod \"aws-ebs-csi-driver-node-zs9tt\" (UID: \"34abc870-3db4-4f2f-811b-7bd94f34ef7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.601772 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.601744 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh4x6\" (UniqueName: \"kubernetes.io/projected/6d822b4c-c002-4237-bf6c-9b0d94d6970e-kube-api-access-hh4x6\") pod \"iptables-alerter-dklz5\" (UID: \"6d822b4c-c002-4237-bf6c-9b0d94d6970e\") " pod="openshift-network-operator/iptables-alerter-dklz5" Jul 23 00:04:19.601873 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.601833 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbgdp\" (UniqueName: \"kubernetes.io/projected/0e89dbcf-8594-467f-8966-38e817ccc785-kube-api-access-pbgdp\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:19.601873 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.601850 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m5x6\" (UniqueName: \"kubernetes.io/projected/186f56a9-3be0-4a12-9715-83349a5f2bbf-kube-api-access-4m5x6\") pod \"ovnkube-node-qgr7w\" (UID: \"186f56a9-3be0-4a12-9715-83349a5f2bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.689649 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-var-lib-cni-bin\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.689649 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-cnibin\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.689895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-run-multus-certs\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.689895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5a0332a-90f8-4956-9096-62890085afe6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.689895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/484d238c-269c-4c42-9e51-d5d92cbfef41-cni-binary-copy\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.689895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689755 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-var-lib-cni-bin\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.689895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689798 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-system-cni-dir\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.689895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689761 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-run-multus-certs\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.689895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689836 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-multus-socket-dir-parent\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.689895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689865 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-system-cni-dir\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.689895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689761 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-cnibin\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.689895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689888 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-os-release\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.689895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689885 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-multus-socket-dir-parent\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-sys\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689959 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-os-release\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689973 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-lib-modules\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.689997 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-sys\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690004 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-run\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfk9w\" (UniqueName: \"kubernetes.io/projected/a5a0332a-90f8-4956-9096-62890085afe6-kube-api-access-wfk9w\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690058 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-run-netns\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690071 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-lib-modules\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-var-lib-kubelet\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690121 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-run\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690130 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-var-lib-kubelet\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690133 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-run-netns\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690216 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-etc-kubernetes\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690243 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-modprobe-d\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690260 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-systemd\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690276 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5a0332a-90f8-4956-9096-62890085afe6-cnibin\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690324 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-etc-kubernetes\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.690493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690333 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-systemd\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690338 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/484d238c-269c-4c42-9e51-d5d92cbfef41-cni-binary-copy\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-var-lib-kubelet\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690365 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5a0332a-90f8-4956-9096-62890085afe6-cnibin\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690377 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-modprobe-d\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690382 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5a0332a-90f8-4956-9096-62890085afe6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690449 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-var-lib-kubelet\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-host\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690513 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jc67\" (UniqueName: \"kubernetes.io/projected/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-kube-api-access-9jc67\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5a0332a-90f8-4956-9096-62890085afe6-os-release\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690566 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-host\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690569 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/807b0073-a7e3-4d00-9589-ae775a84e7ad-serviceca\") pod \"node-ca-c6qqx\" (UID: \"807b0073-a7e3-4d00-9589-ae775a84e7ad\") " pod="openshift-image-registry/node-ca-c6qqx" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvnbm\" (UniqueName: \"kubernetes.io/projected/807b0073-a7e3-4d00-9589-ae775a84e7ad-kube-api-access-cvnbm\") pod \"node-ca-c6qqx\" (UID: \"807b0073-a7e3-4d00-9589-ae775a84e7ad\") " pod="openshift-image-registry/node-ca-c6qqx" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690618 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-sysctl-d\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5a0332a-90f8-4956-9096-62890085afe6-system-cni-dir\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-run-k8s-cni-cncf-io\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/484d238c-269c-4c42-9e51-d5d92cbfef41-multus-daemon-config\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.691317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690745 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5a0332a-90f8-4956-9096-62890085afe6-os-release\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690749 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-tmp\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690766 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5a0332a-90f8-4956-9096-62890085afe6-system-cni-dir\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690793 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce321df6-7f11-4d73-a5ee-ecf33cc54d77-hosts-file\") pod \"node-resolver-6d6zq\" (UID: \"ce321df6-7f11-4d73-a5ee-ecf33cc54d77\") " pod="openshift-dns/node-resolver-6d6zq" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690796 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-sysctl-d\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/807b0073-a7e3-4d00-9589-ae775a84e7ad-host\") pod \"node-ca-c6qqx\" (UID: \"807b0073-a7e3-4d00-9589-ae775a84e7ad\") " pod="openshift-image-registry/node-ca-c6qqx" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690833 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-run-k8s-cni-cncf-io\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690845 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5a0332a-90f8-4956-9096-62890085afe6-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690853 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce321df6-7f11-4d73-a5ee-ecf33cc54d77-hosts-file\") pod \"node-resolver-6d6zq\" (UID: \"ce321df6-7f11-4d73-a5ee-ecf33cc54d77\") " pod="openshift-dns/node-resolver-6d6zq" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-hostroot\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690885 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/807b0073-a7e3-4d00-9589-ae775a84e7ad-host\") pod \"node-ca-c6qqx\" (UID: \"807b0073-a7e3-4d00-9589-ae775a84e7ad\") " pod="openshift-image-registry/node-ca-c6qqx" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-sysconfig\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690930 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-hostroot\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690930 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5a0332a-90f8-4956-9096-62890085afe6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690979 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-sysconfig\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.690971 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5a0332a-90f8-4956-9096-62890085afe6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691043 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-multus-cni-dir\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691083 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/807b0073-a7e3-4d00-9589-ae775a84e7ad-serviceca\") pod \"node-ca-c6qqx\" (UID: \"807b0073-a7e3-4d00-9589-ae775a84e7ad\") " pod="openshift-image-registry/node-ca-c6qqx" Jul 23 00:04:19.692006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-kubernetes\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691114 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5a0332a-90f8-4956-9096-62890085afe6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691144 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-kubernetes\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-sysctl-conf\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691183 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-multus-cni-dir\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2z5k\" (UniqueName: \"kubernetes.io/projected/ce321df6-7f11-4d73-a5ee-ecf33cc54d77-kube-api-access-g2z5k\") pod \"node-resolver-6d6zq\" (UID: \"ce321df6-7f11-4d73-a5ee-ecf33cc54d77\") " pod="openshift-dns/node-resolver-6d6zq" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-var-lib-cni-multus\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691262 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-sysctl-conf\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-multus-conf-dir\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691280 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/484d238c-269c-4c42-9e51-d5d92cbfef41-multus-daemon-config\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691302 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tkd9\" (UniqueName: \"kubernetes.io/projected/484d238c-269c-4c42-9e51-d5d92cbfef41-kube-api-access-7tkd9\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691306 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-multus-conf-dir\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691347 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5a0332a-90f8-4956-9096-62890085afe6-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691350 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/484d238c-269c-4c42-9e51-d5d92cbfef41-host-var-lib-cni-multus\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691351 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-tuned\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce321df6-7f11-4d73-a5ee-ecf33cc54d77-tmp-dir\") pod \"node-resolver-6d6zq\" (UID: \"ce321df6-7f11-4d73-a5ee-ecf33cc54d77\") " pod="openshift-dns/node-resolver-6d6zq" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.691607 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5a0332a-90f8-4956-9096-62890085afe6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.692575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.692164 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce321df6-7f11-4d73-a5ee-ecf33cc54d77-tmp-dir\") pod \"node-resolver-6d6zq\" (UID: \"ce321df6-7f11-4d73-a5ee-ecf33cc54d77\") " pod="openshift-dns/node-resolver-6d6zq" Jul 23 00:04:19.693120 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.693003 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-tmp\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.693320 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.693305 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-etc-tuned\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.703645 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.703614 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfk9w\" (UniqueName: \"kubernetes.io/projected/a5a0332a-90f8-4956-9096-62890085afe6-kube-api-access-wfk9w\") pod \"multus-additional-cni-plugins-jmnw5\" (UID: \"a5a0332a-90f8-4956-9096-62890085afe6\") " pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.705631 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.705604 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jc67\" (UniqueName: \"kubernetes.io/projected/b84d2b2b-eaff-454a-ae4c-e35471e15a9d-kube-api-access-9jc67\") pod \"tuned-c8dz9\" (UID: \"b84d2b2b-eaff-454a-ae4c-e35471e15a9d\") " pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.705824 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.705805 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tkd9\" (UniqueName: \"kubernetes.io/projected/484d238c-269c-4c42-9e51-d5d92cbfef41-kube-api-access-7tkd9\") pod \"multus-xcffm\" (UID: \"484d238c-269c-4c42-9e51-d5d92cbfef41\") " pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.707355 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.707329 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2z5k\" (UniqueName: \"kubernetes.io/projected/ce321df6-7f11-4d73-a5ee-ecf33cc54d77-kube-api-access-g2z5k\") pod \"node-resolver-6d6zq\" (UID: \"ce321df6-7f11-4d73-a5ee-ecf33cc54d77\") " pod="openshift-dns/node-resolver-6d6zq" Jul 23 00:04:19.707544 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.707528 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvnbm\" (UniqueName: \"kubernetes.io/projected/807b0073-a7e3-4d00-9589-ae775a84e7ad-kube-api-access-cvnbm\") pod \"node-ca-c6qqx\" (UID: \"807b0073-a7e3-4d00-9589-ae775a84e7ad\") " pod="openshift-image-registry/node-ca-c6qqx" Jul 23 00:04:19.806337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.806292 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dklz5" Jul 23 00:04:19.811664 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.811634 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:19.825702 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.825675 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cbcfq" Jul 23 00:04:19.838692 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.838664 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" Jul 23 00:04:19.846671 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.846633 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" Jul 23 00:04:19.859827 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.859794 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6d6zq" Jul 23 00:04:19.862792 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:19.862742 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a3b8849e7de9826bbe69d4f142303f.slice/crio-7a4b70a2724e5313e36982bed2ac10dcac5d7f4bd5b9cc388dd0ac7d6b6b7146 WatchSource:0}: Error finding container 7a4b70a2724e5313e36982bed2ac10dcac5d7f4bd5b9cc388dd0ac7d6b6b7146: Status 404 returned error can't find the container with id 7a4b70a2724e5313e36982bed2ac10dcac5d7f4bd5b9cc388dd0ac7d6b6b7146 Jul 23 00:04:19.863332 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:19.863300 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186f56a9_3be0_4a12_9715_83349a5f2bbf.slice/crio-a4cfd304346ed2c5b3700e8ad3b3a667670bb95e118155823a3564cf829ecfb4 WatchSource:0}: Error finding container a4cfd304346ed2c5b3700e8ad3b3a667670bb95e118155823a3564cf829ecfb4: Status 404 returned error can't find the container with id a4cfd304346ed2c5b3700e8ad3b3a667670bb95e118155823a3564cf829ecfb4 Jul 23 00:04:19.864518 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:19.864273 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d822b4c_c002_4237_bf6c_9b0d94d6970e.slice/crio-ed342735807cda44876b49acecbbbe8dc973e10b6e74ce42872dc1ece79ae591 WatchSource:0}: Error finding container ed342735807cda44876b49acecbbbe8dc973e10b6e74ce42872dc1ece79ae591: Status 404 returned error can't find the container with id ed342735807cda44876b49acecbbbe8dc973e10b6e74ce42872dc1ece79ae591 Jul 23 00:04:19.865652 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:19.865623 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd720a2e2_82ed_4816_9a16_ce9331dc4c7f.slice/crio-e128324d2f8593189df09964f277770d58a4d15b107acfd73ab733c42d52037c WatchSource:0}: Error finding container e128324d2f8593189df09964f277770d58a4d15b107acfd73ab733c42d52037c: Status 404 returned error can't find the container with id e128324d2f8593189df09964f277770d58a4d15b107acfd73ab733c42d52037c Jul 23 00:04:19.868563 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:19.868482 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34abc870_3db4_4f2f_811b_7bd94f34ef7b.slice/crio-4c7a16fb8e3c3be46745879bee0feb4c797fa1d6bf48703179b25661f2cc79ea WatchSource:0}: Error finding container 4c7a16fb8e3c3be46745879bee0feb4c797fa1d6bf48703179b25661f2cc79ea: Status 404 returned error can't find the container with id 4c7a16fb8e3c3be46745879bee0feb4c797fa1d6bf48703179b25661f2cc79ea Jul 23 00:04:19.868661 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.868640 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 00:04:19.870092 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:19.870035 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb84d2b2b_eaff_454a_ae4c_e35471e15a9d.slice/crio-45c350266f012cb24aa3f70be8c85a834d0dff4dfe2ac359685b6b1266dfabda WatchSource:0}: Error finding container 45c350266f012cb24aa3f70be8c85a834d0dff4dfe2ac359685b6b1266dfabda: Status 404 returned error can't find the container with id 45c350266f012cb24aa3f70be8c85a834d0dff4dfe2ac359685b6b1266dfabda Jul 23 00:04:19.873757 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:19.873731 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9eae42e7d66416d6ea3b4d6c66b2c30.slice/crio-10f2ed85043d32652f70a80eac1f2cfbe518456c697693e86ed708494d48b695 WatchSource:0}: Error finding container 10f2ed85043d32652f70a80eac1f2cfbe518456c697693e86ed708494d48b695: Status 404 returned error can't find the container with id 10f2ed85043d32652f70a80eac1f2cfbe518456c697693e86ed708494d48b695 Jul 23 00:04:19.875848 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.875648 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c6qqx" Jul 23 00:04:19.877339 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:19.877312 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce321df6_7f11_4d73_a5ee_ecf33cc54d77.slice/crio-76aaf7c899fe9406d6a08ae581ce4159b0a49fe448c7709a0b899ad6f81a6b9c WatchSource:0}: Error finding container 76aaf7c899fe9406d6a08ae581ce4159b0a49fe448c7709a0b899ad6f81a6b9c: Status 404 returned error can't find the container with id 76aaf7c899fe9406d6a08ae581ce4159b0a49fe448c7709a0b899ad6f81a6b9c Jul 23 00:04:19.886866 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:19.886840 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807b0073_a7e3_4d00_9589_ae775a84e7ad.slice/crio-57ad04696ddc4fbb1745c3fa64598c383ebe928384245a6f419562cd5785ccea WatchSource:0}: Error finding container 57ad04696ddc4fbb1745c3fa64598c383ebe928384245a6f419562cd5785ccea: Status 404 returned error can't find the container with id 57ad04696ddc4fbb1745c3fa64598c383ebe928384245a6f419562cd5785ccea Jul 23 00:04:19.898682 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.898657 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jmnw5" Jul 23 00:04:19.908805 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:19.908777 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a0332a_90f8_4956_9096_62890085afe6.slice/crio-dfc2d1582093c9450f44bdc48020c06d62534eea190ea83e6cc49bfae886b7c5 WatchSource:0}: Error finding container dfc2d1582093c9450f44bdc48020c06d62534eea190ea83e6cc49bfae886b7c5: Status 404 returned error can't find the container with id dfc2d1582093c9450f44bdc48020c06d62534eea190ea83e6cc49bfae886b7c5 Jul 23 00:04:19.912508 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:19.912488 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xcffm" Jul 23 00:04:19.923580 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:19.923554 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484d238c_269c_4c42_9e51_d5d92cbfef41.slice/crio-56a7f3e1628ed03a48edabdcbec6809da6bd34051af630531e3613e0c74f00f6 WatchSource:0}: Error finding container 56a7f3e1628ed03a48edabdcbec6809da6bd34051af630531e3613e0c74f00f6: Status 404 returned error can't find the container with id 56a7f3e1628ed03a48edabdcbec6809da6bd34051af630531e3613e0c74f00f6 Jul 23 00:04:19.925647 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.925624 2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-multus start failed in pod multus-xcffm_openshift-multus(484d238c-269c-4c42-9e51-d5d92cbfef41): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 23 00:04:19.925707 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:19.925681 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-multus/multus-xcffm" podUID="484d238c-269c-4c42-9e51-d5d92cbfef41" Jul 23 00:04:20.094525 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.094424 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:20.094525 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.094520 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:20.094716 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:20.094618 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:20.094716 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:20.094679 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:20.094784 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:20.094690 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret podName:20402179-b992-42ea-91a0-0df7d5415521 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:21.094674834 +0000 UTC m=+2.958843989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret") pod "global-pull-secret-syncer-5t84s" (UID: "20402179-b992-42ea-91a0-0df7d5415521") : object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:20.094784 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:20.094746 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs podName:0e89dbcf-8594-467f-8966-38e817ccc785 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:21.094731487 +0000 UTC m=+2.958900642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs") pod "network-metrics-daemon-dfb42" (UID: "0e89dbcf-8594-467f-8966-38e817ccc785") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:20.195476 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.195438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhcx\" (UniqueName: \"kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx\") pod \"network-check-target-zh42k\" (UID: \"c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf\") " pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:20.195662 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:20.195641 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 00:04:20.195708 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:20.195667 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 00:04:20.195708 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:20.195680 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fxhcx for pod openshift-network-diagnostics/network-check-target-zh42k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:20.195792 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:20.195781 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx podName:c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf nodeName:}" failed. No retries permitted until 2026-07-23 00:04:21.195762163 +0000 UTC m=+3.059931335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhcx" (UniqueName: "kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx") pod "network-check-target-zh42k" (UID: "c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:20.557513 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.557306 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 23:59:20 +0000 UTC" deadline="2028-01-14 12:42:07.624096919 +0000 UTC" Jul 23 00:04:20.557513 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.557373 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12972h37m47.066728543s" Jul 23 00:04:20.652603 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.651901 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:20.652603 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:20.652035 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:20.683392 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.683244 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" event={"ID":"29a3b8849e7de9826bbe69d4f142303f","Type":"ContainerStarted","Data":"7a4b70a2724e5313e36982bed2ac10dcac5d7f4bd5b9cc388dd0ac7d6b6b7146"} Jul 23 00:04:20.694897 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.694752 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmnw5" event={"ID":"a5a0332a-90f8-4956-9096-62890085afe6","Type":"ContainerStarted","Data":"dfc2d1582093c9450f44bdc48020c06d62534eea190ea83e6cc49bfae886b7c5"} Jul 23 00:04:20.701859 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.701818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c6qqx" event={"ID":"807b0073-a7e3-4d00-9589-ae775a84e7ad","Type":"ContainerStarted","Data":"57ad04696ddc4fbb1745c3fa64598c383ebe928384245a6f419562cd5785ccea"} Jul 23 00:04:20.710853 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.710812 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6d6zq" event={"ID":"ce321df6-7f11-4d73-a5ee-ecf33cc54d77","Type":"ContainerStarted","Data":"76aaf7c899fe9406d6a08ae581ce4159b0a49fe448c7709a0b899ad6f81a6b9c"} Jul 23 00:04:20.715500 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.715463 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" event={"ID":"f9eae42e7d66416d6ea3b4d6c66b2c30","Type":"ContainerStarted","Data":"10f2ed85043d32652f70a80eac1f2cfbe518456c697693e86ed708494d48b695"} Jul 23 00:04:20.723452 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.723413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" event={"ID":"34abc870-3db4-4f2f-811b-7bd94f34ef7b","Type":"ContainerStarted","Data":"4c7a16fb8e3c3be46745879bee0feb4c797fa1d6bf48703179b25661f2cc79ea"} Jul 23 00:04:20.737996 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.737953 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" event={"ID":"186f56a9-3be0-4a12-9715-83349a5f2bbf","Type":"ContainerStarted","Data":"a4cfd304346ed2c5b3700e8ad3b3a667670bb95e118155823a3564cf829ecfb4"} Jul 23 00:04:20.754843 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.754800 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xcffm" event={"ID":"484d238c-269c-4c42-9e51-d5d92cbfef41","Type":"ContainerStarted","Data":"56a7f3e1628ed03a48edabdcbec6809da6bd34051af630531e3613e0c74f00f6"} Jul 23 00:04:20.763443 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:20.763403 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:33e7088dd590651a8add807e644a951c24dc2ea04589a5b08214c6a33ec14009\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-multus/multus-xcffm" podUID="484d238c-269c-4c42-9e51-d5d92cbfef41" Jul 23 00:04:20.777387 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.777347 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" event={"ID":"b84d2b2b-eaff-454a-ae4c-e35471e15a9d","Type":"ContainerStarted","Data":"45c350266f012cb24aa3f70be8c85a834d0dff4dfe2ac359685b6b1266dfabda"} Jul 23 00:04:20.788414 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.788345 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cbcfq" event={"ID":"d720a2e2-82ed-4816-9a16-ce9331dc4c7f","Type":"ContainerStarted","Data":"e128324d2f8593189df09964f277770d58a4d15b107acfd73ab733c42d52037c"} Jul 23 00:04:20.797992 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.797912 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dklz5" event={"ID":"6d822b4c-c002-4237-bf6c-9b0d94d6970e","Type":"ContainerStarted","Data":"ed342735807cda44876b49acecbbbe8dc973e10b6e74ce42872dc1ece79ae591"} Jul 23 00:04:20.856403 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:20.856320 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 00:04:21.103888 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:21.103123 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:21.103888 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:21.103196 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:21.103888 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:21.103341 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:21.103888 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:21.103407 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret podName:20402179-b992-42ea-91a0-0df7d5415521 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:23.103387629 +0000 UTC m=+4.967556779 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret") pod "global-pull-secret-syncer-5t84s" (UID: "20402179-b992-42ea-91a0-0df7d5415521") : object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:21.103888 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:21.103501 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:21.103888 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:21.103542 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs podName:0e89dbcf-8594-467f-8966-38e817ccc785 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:23.103528597 +0000 UTC m=+4.967697753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs") pod "network-metrics-daemon-dfb42" (UID: "0e89dbcf-8594-467f-8966-38e817ccc785") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:21.204712 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:21.203798 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhcx\" (UniqueName: \"kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx\") pod \"network-check-target-zh42k\" (UID: \"c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf\") " pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:21.204712 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:21.203964 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 00:04:21.204712 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:21.203986 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 00:04:21.204712 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:21.204001 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fxhcx for pod openshift-network-diagnostics/network-check-target-zh42k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:21.204712 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:21.204061 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx podName:c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf nodeName:}" failed. No retries permitted until 2026-07-23 00:04:23.204043251 +0000 UTC m=+5.068212406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhcx" (UniqueName: "kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx") pod "network-check-target-zh42k" (UID: "c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:21.235960 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:21.235918 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 00:04:21.558433 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:21.558359 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 23:59:20 +0000 UTC" deadline="2028-05-03 21:56:24.67357628 +0000 UTC" Jul 23 00:04:21.558433 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:21.558420 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15621h52m3.115162125s" Jul 23 00:04:21.649229 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:21.649167 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:21.649422 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:21.649178 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:21.649422 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:21.649319 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:21.649580 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:21.649442 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:22.652120 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:22.651572 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:22.652120 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:22.651715 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:23.120889 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:23.120840 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:23.121105 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:23.120932 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:23.121105 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:23.121097 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:23.121229 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:23.121170 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret podName:20402179-b992-42ea-91a0-0df7d5415521 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:27.12114818 +0000 UTC m=+8.985317337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret") pod "global-pull-secret-syncer-5t84s" (UID: "20402179-b992-42ea-91a0-0df7d5415521") : object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:23.121299 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:23.121250 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:23.121299 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:23.121286 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs podName:0e89dbcf-8594-467f-8966-38e817ccc785 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:27.121273797 +0000 UTC m=+8.985442953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs") pod "network-metrics-daemon-dfb42" (UID: "0e89dbcf-8594-467f-8966-38e817ccc785") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:23.222112 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:23.222067 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhcx\" (UniqueName: \"kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx\") pod \"network-check-target-zh42k\" (UID: \"c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf\") " pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:23.222382 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:23.222281 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 00:04:23.222382 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:23.222303 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 00:04:23.222382 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:23.222316 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fxhcx for pod openshift-network-diagnostics/network-check-target-zh42k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:23.222382 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:23.222378 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx podName:c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf nodeName:}" failed. No retries permitted until 2026-07-23 00:04:27.222359212 +0000 UTC m=+9.086528368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhcx" (UniqueName: "kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx") pod "network-check-target-zh42k" (UID: "c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:23.648665 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:23.648568 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:23.648665 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:23.648618 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:23.648916 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:23.648713 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:23.648916 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:23.648864 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:24.649541 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:24.649488 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:24.650054 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:24.649651 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:25.649502 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:25.649463 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:25.649722 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:25.649463 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:25.649722 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:25.649619 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:25.649722 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:25.649706 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:26.649253 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:26.649214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:26.649458 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:26.649372 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:27.157650 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:27.157594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:27.158141 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:27.157682 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:27.158141 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:27.157774 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:27.158141 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:27.157834 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:27.158141 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:27.157872 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs podName:0e89dbcf-8594-467f-8966-38e817ccc785 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:35.15784715 +0000 UTC m=+17.022016323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs") pod "network-metrics-daemon-dfb42" (UID: "0e89dbcf-8594-467f-8966-38e817ccc785") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:27.158141 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:27.157896 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret podName:20402179-b992-42ea-91a0-0df7d5415521 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:35.157885076 +0000 UTC m=+17.022054232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret") pod "global-pull-secret-syncer-5t84s" (UID: "20402179-b992-42ea-91a0-0df7d5415521") : object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:27.258605 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:27.258525 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhcx\" (UniqueName: \"kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx\") pod \"network-check-target-zh42k\" (UID: \"c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf\") " pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:27.258823 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:27.258736 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 00:04:27.258823 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:27.258765 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 00:04:27.258823 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:27.258778 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fxhcx for pod openshift-network-diagnostics/network-check-target-zh42k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:27.258988 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:27.258852 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx podName:c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf nodeName:}" failed. No retries permitted until 2026-07-23 00:04:35.258832385 +0000 UTC m=+17.123001538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhcx" (UniqueName: "kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx") pod "network-check-target-zh42k" (UID: "c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:27.649008 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:27.648965 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:27.649207 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:27.648978 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:27.649207 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:27.649114 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:27.649207 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:27.649199 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:28.652422 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:28.652369 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:28.652938 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:28.652520 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:29.648576 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:29.648539 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:29.648756 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:29.648586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:29.648756 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:29.648677 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:29.648867 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:29.648793 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:30.650952 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:30.650924 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:30.651342 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:30.651017 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:31.648891 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:31.648855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:31.648891 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:31.648855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:31.649143 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:31.649073 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:31.649210 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:31.649189 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:32.649300 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:32.649265 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:32.649760 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:32.649413 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:33.649027 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:33.648986 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:33.649027 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:33.649017 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:33.649255 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:33.649126 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:33.649255 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:33.649220 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:34.652606 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:34.652578 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:34.653052 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:34.652695 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:35.215325 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:35.215291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:35.215531 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:35.215359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:35.215531 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:35.215434 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:35.215531 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:35.215494 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs podName:0e89dbcf-8594-467f-8966-38e817ccc785 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:51.215479034 +0000 UTC m=+33.079648194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs") pod "network-metrics-daemon-dfb42" (UID: "0e89dbcf-8594-467f-8966-38e817ccc785") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:35.215531 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:35.215496 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:35.215699 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:35.215573 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret podName:20402179-b992-42ea-91a0-0df7d5415521 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:51.215554027 +0000 UTC m=+33.079723181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret") pod "global-pull-secret-syncer-5t84s" (UID: "20402179-b992-42ea-91a0-0df7d5415521") : object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:35.316698 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:35.316659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhcx\" (UniqueName: \"kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx\") pod \"network-check-target-zh42k\" (UID: \"c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf\") " pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:35.316883 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:35.316834 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 00:04:35.316883 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:35.316856 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 00:04:35.316883 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:35.316866 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fxhcx for pod openshift-network-diagnostics/network-check-target-zh42k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:35.316996 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:35.316924 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx podName:c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf nodeName:}" failed. No retries permitted until 2026-07-23 00:04:51.316903092 +0000 UTC m=+33.181072245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhcx" (UniqueName: "kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx") pod "network-check-target-zh42k" (UID: "c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:35.649139 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:35.648948 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:35.649236 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:35.648948 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:35.649296 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:35.649259 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:35.649338 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:35.649324 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:35.837452 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:35.837414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" event={"ID":"b84d2b2b-eaff-454a-ae4c-e35471e15a9d","Type":"ContainerStarted","Data":"a155a79fb2b8de2cc37ed8e96407cdc61d76ef2c225396218b2209a48a28ce60"} Jul 23 00:04:35.839093 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:35.839064 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" event={"ID":"f9eae42e7d66416d6ea3b4d6c66b2c30","Type":"ContainerStarted","Data":"c3f73d215ed017123688ef45aa63a33b8b92063cb31e3a61dac51dc23e84700d"} Jul 23 00:04:35.854353 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:35.854300 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" podStartSLOduration=15.854284378 podStartE2EDuration="15.854284378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:35.853592022 +0000 UTC m=+17.717761194" watchObservedRunningTime="2026-07-23 00:04:35.854284378 +0000 UTC m=+17.718453548" Jul 23 00:04:36.649010 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.648805 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:36.649192 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:36.649100 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:36.844038 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.843948 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cbcfq" event={"ID":"d720a2e2-82ed-4816-9a16-ce9331dc4c7f","Type":"ContainerStarted","Data":"bd1b9066abbfafa0f17b9b002f13ac30afaf9567372a870c1d4736452a2a983c"} Jul 23 00:04:36.846092 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.846051 2574 generic.go:356] "Generic (PLEG): container finished" podID="29a3b8849e7de9826bbe69d4f142303f" containerID="0d6be677943311f4ac01ba2e8b3ac34a181ec727d9a34f95e3be232e6370af70" exitCode=0 Jul 23 00:04:36.846399 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.846352 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" event={"ID":"29a3b8849e7de9826bbe69d4f142303f","Type":"ContainerDied","Data":"0d6be677943311f4ac01ba2e8b3ac34a181ec727d9a34f95e3be232e6370af70"} Jul 23 00:04:36.848537 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.848510 2574 generic.go:356] "Generic (PLEG): container finished" podID="a5a0332a-90f8-4956-9096-62890085afe6" containerID="36c49c91b701ef7add4fd4dea16afd9898704d02ab79302b1e8047fe0d4102e7" exitCode=0 Jul 23 00:04:36.848628 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.848589 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmnw5" event={"ID":"a5a0332a-90f8-4956-9096-62890085afe6","Type":"ContainerDied","Data":"36c49c91b701ef7add4fd4dea16afd9898704d02ab79302b1e8047fe0d4102e7"} Jul 23 00:04:36.851950 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.850823 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c6qqx" event={"ID":"807b0073-a7e3-4d00-9589-ae775a84e7ad","Type":"ContainerStarted","Data":"b484ade51f37a93d405aea65bcc908f305174044bcdc3595ceb2f498ce4a4cf3"} Jul 23 00:04:36.853828 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.853793 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6d6zq" event={"ID":"ce321df6-7f11-4d73-a5ee-ecf33cc54d77","Type":"ContainerStarted","Data":"fc5e942c84f966b35a7a8ebf42764509b6875c26d0c8bac835acf0bbe33da4e8"} Jul 23 00:04:36.857607 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.857577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" event={"ID":"34abc870-3db4-4f2f-811b-7bd94f34ef7b","Type":"ContainerStarted","Data":"bd9a4d0c64d2a4a4e7325d355f6fb3d34bdbf87f58b2ac11d87d233346ba448b"} Jul 23 00:04:36.861544 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.861483 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cbcfq" podStartSLOduration=2.148031694 podStartE2EDuration="17.86146575s" totalImagesPullingTime="15.713434056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:36.86115713 +0000 UTC m=+18.725326302" watchObservedRunningTime="2026-07-23 00:04:36.86146575 +0000 UTC m=+18.725634922" Jul 23 00:04:36.863075 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.863038 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" event={"ID":"186f56a9-3be0-4a12-9715-83349a5f2bbf","Type":"ContainerStarted","Data":"b70d3e8624b584e0e943635a0ff66c0237324ebddd16508450c700591fb19295"} Jul 23 00:04:36.863180 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.863135 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" event={"ID":"186f56a9-3be0-4a12-9715-83349a5f2bbf","Type":"ContainerStarted","Data":"fdd107295c7a24749a6017d4665590c967fe2692356d3b02afebc327dfe4dbf6"} Jul 23 00:04:36.863243 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.863185 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" event={"ID":"186f56a9-3be0-4a12-9715-83349a5f2bbf","Type":"ContainerStarted","Data":"fc02f8e3f6d84bccb72bd709db2b94084abfbdc71024778547b889d5dc3bbdb0"} Jul 23 00:04:36.863296 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.863247 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" event={"ID":"186f56a9-3be0-4a12-9715-83349a5f2bbf","Type":"ContainerStarted","Data":"5d689173ef4e81dc8a4571d02aca0e60ba1ecf99804e1933cc584110862d5a18"} Jul 23 00:04:36.863296 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.863292 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" event={"ID":"186f56a9-3be0-4a12-9715-83349a5f2bbf","Type":"ContainerStarted","Data":"3aa7426f94d49aed6b714113dad0d74540812981cff2833fb027c4852aa3c42d"} Jul 23 00:04:36.863414 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.863365 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" event={"ID":"186f56a9-3be0-4a12-9715-83349a5f2bbf","Type":"ContainerStarted","Data":"70f59cdd6e302a3bc1178d7d26c5cef9c48aad09f56bb3e1eb71df42341ff549"} Jul 23 00:04:36.875724 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.875677 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6d6zq" podStartSLOduration=2.147256183 podStartE2EDuration="17.875662929s" totalImagesPullingTime="15.728406746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:36.875187659 +0000 UTC m=+18.739356831" watchObservedRunningTime="2026-07-23 00:04:36.875662929 +0000 UTC m=+18.739832101" Jul 23 00:04:36.890190 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:36.889426 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c6qqx" podStartSLOduration=6.6423908019999995 podStartE2EDuration="17.88940637s" totalImagesPullingTime="11.247015568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:36.889107671 +0000 UTC m=+18.753276845" watchObservedRunningTime="2026-07-23 00:04:36.88940637 +0000 UTC m=+18.753575542" Jul 23 00:04:37.230560 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:37.230394 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 00:04:37.545309 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:37.545151 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T00:04:37.23055598Z","UUID":"9d8a848f-3816-4917-b17c-144f28be7a8b","Handler":null,"Name":"","Endpoint":""} Jul 23 00:04:37.547174 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:37.547147 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 00:04:37.547326 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:37.547191 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 00:04:37.649430 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:37.649395 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:37.649575 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:37.649395 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:37.649653 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:37.649607 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:37.649653 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:37.649527 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:37.870055 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:37.869957 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" event={"ID":"34abc870-3db4-4f2f-811b-7bd94f34ef7b","Type":"ContainerStarted","Data":"7929a2e3a2bf74fc2d5af4d210a96200d11c6ada405774b0877b6322590a8158"} Jul 23 00:04:37.872195 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:37.872163 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dklz5" event={"ID":"6d822b4c-c002-4237-bf6c-9b0d94d6970e","Type":"ContainerStarted","Data":"c997362dfc92440ddce511c9b6533be26dbf94888de14ec6bfd8a06a403feffa"} Jul 23 00:04:37.875453 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:37.875426 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" event={"ID":"29a3b8849e7de9826bbe69d4f142303f","Type":"ContainerStarted","Data":"6ab8b8b99560c9cc35a7aafd5a509ce1ea2785ebd26af2189afab745af6541cd"} Jul 23 00:04:37.887101 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:37.887040 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dklz5" podStartSLOduration=3.174062386 podStartE2EDuration="18.887019887s" totalImagesPullingTime="15.712957501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:37.886962481 +0000 UTC m=+19.751131667" watchObservedRunningTime="2026-07-23 00:04:37.887019887 +0000 UTC m=+19.751189061" Jul 23 00:04:37.887677 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:37.887613 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c8dz9" podStartSLOduration=3.153842236 podStartE2EDuration="18.887583s" totalImagesPullingTime="15.733740764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:36.944264002 +0000 UTC m=+18.808433172" watchObservedRunningTime="2026-07-23 00:04:37.887583 +0000 UTC m=+19.751752173" Jul 23 00:04:37.907787 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:37.907732 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" podStartSLOduration=17.907709557 podStartE2EDuration="17.907709557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:37.907638771 +0000 UTC m=+19.771807943" watchObservedRunningTime="2026-07-23 00:04:37.907709557 +0000 UTC m=+19.771878730" Jul 23 00:04:38.650863 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:38.650513 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:38.650863 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:38.650628 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:38.880025 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:38.879980 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" event={"ID":"34abc870-3db4-4f2f-811b-7bd94f34ef7b","Type":"ContainerStarted","Data":"e05e768ac711f98b1356390fd4571e8efd3f0266c8b03d7b9da61978f39ba464"} Jul 23 00:04:38.884838 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:38.884803 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" event={"ID":"186f56a9-3be0-4a12-9715-83349a5f2bbf","Type":"ContainerStarted","Data":"2517c67299532fe7a2793d755747f7933f7bad46add2ca0f3e2a4d4779994e69"} Jul 23 00:04:38.899495 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:38.899437 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zs9tt" podStartSLOduration=2.229430029 podStartE2EDuration="19.899417409s" totalImagesPullingTime="17.66998738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:38.899272512 +0000 UTC m=+20.763441686" watchObservedRunningTime="2026-07-23 00:04:38.899417409 +0000 UTC m=+20.763586581" Jul 23 00:04:39.649155 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:39.649117 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:39.649359 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:39.649118 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:39.649359 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:39.649274 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:39.649359 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:39.649330 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:40.649004 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:40.648972 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:40.649515 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:40.649096 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:40.784207 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:40.784175 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cbcfq" Jul 23 00:04:40.785104 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:40.785082 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cbcfq" Jul 23 00:04:40.893022 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:40.892990 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cbcfq" Jul 23 00:04:40.893664 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:40.893635 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cbcfq" Jul 23 00:04:41.648577 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:41.648539 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:41.648855 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:41.648546 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:41.648855 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:41.648657 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:41.648855 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:41.648750 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:42.648532 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:42.648502 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:42.648981 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:42.648632 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:43.649034 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:43.648993 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:43.649482 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:43.648992 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:43.649482 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:43.649144 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:43.649482 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:43.649221 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:44.649204 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:44.649166 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:44.649652 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:44.649310 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:45.649088 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:45.649065 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:45.649235 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:45.649212 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:45.649542 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:45.649259 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:45.649542 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:45.649374 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:45.907283 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:45.907031 2574 generic.go:356] "Generic (PLEG): container finished" podID="a5a0332a-90f8-4956-9096-62890085afe6" containerID="1977508387ad7ab251f059dc56b811a90cbd829f430f3c82ef201a63411ae9e8" exitCode=0 Jul 23 00:04:45.907283 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:45.907121 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmnw5" event={"ID":"a5a0332a-90f8-4956-9096-62890085afe6","Type":"ContainerDied","Data":"1977508387ad7ab251f059dc56b811a90cbd829f430f3c82ef201a63411ae9e8"} Jul 23 00:04:45.911868 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:45.911841 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" event={"ID":"186f56a9-3be0-4a12-9715-83349a5f2bbf","Type":"ContainerStarted","Data":"c17a1fa013456c94774eef481deaea30445fcae482e9ed047e57f613e5a896fb"} Jul 23 00:04:45.912186 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:45.912170 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:45.912287 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:45.912248 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:45.912345 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:45.912298 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:45.913897 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:45.913867 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xcffm" event={"ID":"484d238c-269c-4c42-9e51-d5d92cbfef41","Type":"ContainerStarted","Data":"997449dc5470d0cda37e55a5cf6690d10d55da49025b294c7991f09911248dc0"} Jul 23 00:04:45.928450 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:45.928418 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:45.928597 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:45.928584 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:04:45.984518 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:45.984454 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xcffm" podStartSLOduration=1.21341178 podStartE2EDuration="26.984435595s" totalImagesPullingTime="25.771023815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-23 00:04:45.984276732 +0000 UTC m=+27.848445905" watchObservedRunningTime="2026-07-23 00:04:45.984435595 +0000 UTC m=+27.848604766" Jul 23 00:04:46.012645 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:46.012591 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" podStartSLOduration=10.878503518 podStartE2EDuration="27.012574282s" totalImagesPullingTime="16.134070764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:46.012176028 +0000 UTC m=+27.876345200" watchObservedRunningTime="2026-07-23 00:04:46.012574282 +0000 UTC m=+27.876743838" Jul 23 00:04:46.139161 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:46.139128 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:46.227270 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:46.227170 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:46.651853 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:46.651831 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:46.652784 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:46.651921 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:47.649348 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:47.649174 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:47.649520 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:47.649220 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:47.649520 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:47.649453 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:47.649636 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:47.649563 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:47.816732 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:47.816696 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5t84s"] Jul 23 00:04:47.821014 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:47.820744 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zh42k"] Jul 23 00:04:47.821014 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:47.820872 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:47.821014 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:47.820969 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:47.821484 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:47.821461 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dfb42"] Jul 23 00:04:47.920907 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:47.920821 2574 generic.go:356] "Generic (PLEG): container finished" podID="a5a0332a-90f8-4956-9096-62890085afe6" containerID="fb6d1e1786955f945002e80c62caa90616a845e036307ba69c7ffeece958441c" exitCode=0 Jul 23 00:04:47.921072 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:47.920928 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmnw5" event={"ID":"a5a0332a-90f8-4956-9096-62890085afe6","Type":"ContainerDied","Data":"fb6d1e1786955f945002e80c62caa90616a845e036307ba69c7ffeece958441c"} Jul 23 00:04:47.921072 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:47.920943 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:47.921072 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:47.921050 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:47.921209 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:47.921072 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:47.921209 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:47.921156 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:49.648978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:49.648937 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:49.649475 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:49.648936 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:49.649475 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:49.649093 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:04:49.649475 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:49.648936 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:49.649475 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:49.649122 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t84s" podUID="20402179-b992-42ea-91a0-0df7d5415521" Jul 23 00:04:49.649475 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:49.649201 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zh42k" podUID="c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf" Jul 23 00:04:49.927625 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:49.927545 2574 generic.go:356] "Generic (PLEG): container finished" podID="a5a0332a-90f8-4956-9096-62890085afe6" containerID="a5709818ae4d2bde81a8158102269c21a9d6612130e511dcb02f23431a57e162" exitCode=0 Jul 23 00:04:49.927625 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:49.927612 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmnw5" event={"ID":"a5a0332a-90f8-4956-9096-62890085afe6","Type":"ContainerDied","Data":"a5709818ae4d2bde81a8158102269c21a9d6612130e511dcb02f23431a57e162"} Jul 23 00:04:50.150423 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:50.150374 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:50.250487 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:50.250454 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:50.351105 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:50.351052 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:51.235686 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.235646 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:51.236137 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.235706 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:51.236137 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:51.235830 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:51.236137 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:51.235901 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs podName:0e89dbcf-8594-467f-8966-38e817ccc785 nodeName:}" failed. No retries permitted until 2026-07-23 00:05:23.235880564 +0000 UTC m=+65.100049714 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs") pod "network-metrics-daemon-dfb42" (UID: "0e89dbcf-8594-467f-8966-38e817ccc785") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 00:04:51.236137 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:51.235836 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:51.236137 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:51.235942 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret podName:20402179-b992-42ea-91a0-0df7d5415521 nodeName:}" failed. No retries permitted until 2026-07-23 00:05:23.235934276 +0000 UTC m=+65.100103425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret") pod "global-pull-secret-syncer-5t84s" (UID: "20402179-b992-42ea-91a0-0df7d5415521") : object "kube-system"/"original-pull-secret" not registered Jul 23 00:04:51.336054 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.336024 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhcx\" (UniqueName: \"kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx\") pod \"network-check-target-zh42k\" (UID: \"c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf\") " pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:51.336251 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:51.336229 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 00:04:51.336303 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:51.336258 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 00:04:51.336303 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:51.336271 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fxhcx for pod openshift-network-diagnostics/network-check-target-zh42k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:51.336363 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:51.336335 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx podName:c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf nodeName:}" failed. No retries permitted until 2026-07-23 00:05:23.33631591 +0000 UTC m=+65.200485077 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhcx" (UniqueName: "kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx") pod "network-check-target-zh42k" (UID: "c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 00:04:51.423412 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.423322 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeReady" Jul 23 00:04:51.423572 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.423491 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 00:04:51.463551 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.463521 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-25447"] Jul 23 00:04:51.483917 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.483887 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rjr7d"] Jul 23 00:04:51.484086 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.484040 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-25447" Jul 23 00:04:51.486611 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.486581 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 00:04:51.486611 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.486592 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6vlrt\"" Jul 23 00:04:51.487071 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.487053 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 00:04:51.506927 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.506898 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-25447"] Jul 23 00:04:51.507062 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.506947 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rjr7d"] Jul 23 00:04:51.507062 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.507042 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rjr7d" Jul 23 00:04:51.509397 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.509361 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 00:04:51.509397 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.509372 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 00:04:51.509588 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.509372 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-r4q8j\"" Jul 23 00:04:51.509588 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.509513 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 00:04:51.537912 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.537877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6lbv\" (UniqueName: \"kubernetes.io/projected/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-kube-api-access-w6lbv\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:51.538071 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.537970 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-tmp-dir\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:51.538071 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.538041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-config-volume\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:51.538173 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.538070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:51.638551 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.638515 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:51.638551 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.638553 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kc9n\" (UniqueName: \"kubernetes.io/projected/1e53529c-5039-4a5e-8bcd-43569dfe7a18-kube-api-access-4kc9n\") pod \"ingress-canary-rjr7d\" (UID: \"1e53529c-5039-4a5e-8bcd-43569dfe7a18\") " pod="openshift-ingress-canary/ingress-canary-rjr7d" Jul 23 00:04:51.638756 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.638575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6lbv\" (UniqueName: \"kubernetes.io/projected/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-kube-api-access-w6lbv\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:51.638756 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:51.638683 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 00:04:51.638756 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.638742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-tmp-dir\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:51.638858 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:51.638759 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls podName:bad05bc4-e611-4e6f-84bc-d41cbe4b09fa nodeName:}" failed. No retries permitted until 2026-07-23 00:04:52.138736904 +0000 UTC m=+34.002906054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls") pod "dns-default-25447" (UID: "bad05bc4-e611-4e6f-84bc-d41cbe4b09fa") : secret "dns-default-metrics-tls" not found Jul 23 00:04:51.638858 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.638830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e53529c-5039-4a5e-8bcd-43569dfe7a18-cert\") pod \"ingress-canary-rjr7d\" (UID: \"1e53529c-5039-4a5e-8bcd-43569dfe7a18\") " pod="openshift-ingress-canary/ingress-canary-rjr7d" Jul 23 00:04:51.638987 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.638861 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-config-volume\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:51.639053 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.639037 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-tmp-dir\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:51.639346 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.639329 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-config-volume\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:51.648615 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.648486 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:04:51.648747 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.648538 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:04:51.649039 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.648546 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:04:51.649126 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.649056 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6lbv\" (UniqueName: \"kubernetes.io/projected/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-kube-api-access-w6lbv\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:51.652702 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.651551 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pdllw\"" Jul 23 00:04:51.652702 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.651957 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-djfbd\"" Jul 23 00:04:51.652702 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.652004 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 00:04:51.652702 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.651996 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 00:04:51.653617 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.652980 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 00:04:51.653617 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.653047 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 00:04:51.739302 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.739264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e53529c-5039-4a5e-8bcd-43569dfe7a18-cert\") pod \"ingress-canary-rjr7d\" (UID: \"1e53529c-5039-4a5e-8bcd-43569dfe7a18\") " pod="openshift-ingress-canary/ingress-canary-rjr7d" Jul 23 00:04:51.739522 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.739331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kc9n\" (UniqueName: \"kubernetes.io/projected/1e53529c-5039-4a5e-8bcd-43569dfe7a18-kube-api-access-4kc9n\") pod \"ingress-canary-rjr7d\" (UID: \"1e53529c-5039-4a5e-8bcd-43569dfe7a18\") " pod="openshift-ingress-canary/ingress-canary-rjr7d" Jul 23 00:04:51.742398 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.742359 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e53529c-5039-4a5e-8bcd-43569dfe7a18-cert\") pod \"ingress-canary-rjr7d\" (UID: \"1e53529c-5039-4a5e-8bcd-43569dfe7a18\") " pod="openshift-ingress-canary/ingress-canary-rjr7d" Jul 23 00:04:51.751028 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.751000 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kc9n\" (UniqueName: \"kubernetes.io/projected/1e53529c-5039-4a5e-8bcd-43569dfe7a18-kube-api-access-4kc9n\") pod \"ingress-canary-rjr7d\" (UID: \"1e53529c-5039-4a5e-8bcd-43569dfe7a18\") " pod="openshift-ingress-canary/ingress-canary-rjr7d" Jul 23 00:04:51.818105 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:51.818069 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rjr7d" Jul 23 00:04:52.010520 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:52.010476 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rjr7d"] Jul 23 00:04:52.015637 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:04:52.015600 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e53529c_5039_4a5e_8bcd_43569dfe7a18.slice/crio-b8a8c37803234a06a3a3868cd6b553647873f42235c1cffa1c1a375bfa52b688 WatchSource:0}: Error finding container b8a8c37803234a06a3a3868cd6b553647873f42235c1cffa1c1a375bfa52b688: Status 404 returned error can't find the container with id b8a8c37803234a06a3a3868cd6b553647873f42235c1cffa1c1a375bfa52b688 Jul 23 00:04:52.142696 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:52.142656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:52.142881 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:52.142830 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 00:04:52.142936 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:52.142902 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls podName:bad05bc4-e611-4e6f-84bc-d41cbe4b09fa nodeName:}" failed. No retries permitted until 2026-07-23 00:04:53.142880673 +0000 UTC m=+35.007049826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls") pod "dns-default-25447" (UID: "bad05bc4-e611-4e6f-84bc-d41cbe4b09fa") : secret "dns-default-metrics-tls" not found Jul 23 00:04:52.937651 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:52.937609 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rjr7d" event={"ID":"1e53529c-5039-4a5e-8bcd-43569dfe7a18","Type":"ContainerStarted","Data":"b8a8c37803234a06a3a3868cd6b553647873f42235c1cffa1c1a375bfa52b688"} Jul 23 00:04:53.151476 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:53.151433 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:53.151668 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:53.151604 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 00:04:53.151739 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:53.151691 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls podName:bad05bc4-e611-4e6f-84bc-d41cbe4b09fa nodeName:}" failed. No retries permitted until 2026-07-23 00:04:55.15166871 +0000 UTC m=+37.015837874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls") pod "dns-default-25447" (UID: "bad05bc4-e611-4e6f-84bc-d41cbe4b09fa") : secret "dns-default-metrics-tls" not found Jul 23 00:04:54.375459 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:54.375420 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:54.477065 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:54.477037 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:55.167064 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:55.167028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:55.167209 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:55.167182 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 00:04:55.167256 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:55.167245 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls podName:bad05bc4-e611-4e6f-84bc-d41cbe4b09fa nodeName:}" failed. No retries permitted until 2026-07-23 00:04:59.16722829 +0000 UTC m=+41.031397439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls") pod "dns-default-25447" (UID: "bad05bc4-e611-4e6f-84bc-d41cbe4b09fa") : secret "dns-default-metrics-tls" not found Jul 23 00:04:55.946930 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:55.946898 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rjr7d" event={"ID":"1e53529c-5039-4a5e-8bcd-43569dfe7a18","Type":"ContainerStarted","Data":"50277d4ebac0df0e7a3cfec2077e28c16666b742c3ebbc01dcd997dc2de8820e"} Jul 23 00:04:55.949496 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:55.949471 2574 generic.go:356] "Generic (PLEG): container finished" podID="a5a0332a-90f8-4956-9096-62890085afe6" containerID="f6227500fcca5123d6ceac91d1ec2c39a3bc7fb06197fe279e4c05bd3a577306" exitCode=0 Jul 23 00:04:55.949640 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:55.949531 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmnw5" event={"ID":"a5a0332a-90f8-4956-9096-62890085afe6","Type":"ContainerDied","Data":"f6227500fcca5123d6ceac91d1ec2c39a3bc7fb06197fe279e4c05bd3a577306"} Jul 23 00:04:55.961543 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:55.961494 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rjr7d" podStartSLOduration=1.373730182 podStartE2EDuration="4.961478528s" totalImagesPullingTime="3.587748346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:04:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:55.961163866 +0000 UTC m=+37.825333036" watchObservedRunningTime="2026-07-23 00:04:55.961478528 +0000 UTC m=+37.825647698" Jul 23 00:04:56.954859 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:56.954826 2574 generic.go:356] "Generic (PLEG): container finished" podID="a5a0332a-90f8-4956-9096-62890085afe6" containerID="a8e61fa6af4ac4bbcb9d409a74353f412799195363acfee913444a6c0caec39a" exitCode=0 Jul 23 00:04:56.955238 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:56.954918 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmnw5" event={"ID":"a5a0332a-90f8-4956-9096-62890085afe6","Type":"ContainerDied","Data":"a8e61fa6af4ac4bbcb9d409a74353f412799195363acfee913444a6c0caec39a"} Jul 23 00:04:57.150600 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:57.150564 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:57.300071 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:57.300043 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:57.573787 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:57.573706 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:57.647334 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:57.647302 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:57.960582 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:57.960504 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmnw5" event={"ID":"a5a0332a-90f8-4956-9096-62890085afe6","Type":"ContainerStarted","Data":"cb10dea505eafd2734759bed7e26b7466f062faa8944129bbbdb6b2c6892bc0d"} Jul 23 00:04:57.983643 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:57.983596 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jmnw5" podStartSLOduration=6.950724069 podStartE2EDuration="38.983581316s" totalImagesPullingTime="32.032857247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:57.982717277 +0000 UTC m=+39.846886461" watchObservedRunningTime="2026-07-23 00:04:57.983581316 +0000 UTC m=+39.847750486" Jul 23 00:04:58.109290 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:58.109260 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:58.172362 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:58.172329 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:04:59.196224 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:04:59.196170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:04:59.196683 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:59.196315 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 00:04:59.196683 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:04:59.196407 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls podName:bad05bc4-e611-4e6f-84bc-d41cbe4b09fa nodeName:}" failed. No retries permitted until 2026-07-23 00:05:07.19637096 +0000 UTC m=+49.060540109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls") pod "dns-default-25447" (UID: "bad05bc4-e611-4e6f-84bc-d41cbe4b09fa") : secret "dns-default-metrics-tls" not found Jul 23 00:05:00.441752 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:00.441699 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:05:00.505872 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:00.505829 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:05:07.253339 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:07.253295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:05:07.253819 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:05:07.253508 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 00:05:07.253819 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:05:07.253594 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls podName:bad05bc4-e611-4e6f-84bc-d41cbe4b09fa nodeName:}" failed. No retries permitted until 2026-07-23 00:05:23.253575807 +0000 UTC m=+65.117744955 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls") pod "dns-default-25447" (UID: "bad05bc4-e611-4e6f-84bc-d41cbe4b09fa") : secret "dns-default-metrics-tls" not found Jul 23 00:05:11.034461 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:11.034427 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:05:11.106365 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:11.106322 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:05:13.745110 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:13.745072 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx"] Jul 23 00:05:13.746906 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:13.746891 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" Jul 23 00:05:13.750063 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:13.750037 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 23 00:05:13.750198 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:13.750076 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 23 00:05:13.750198 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:13.750093 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 23 00:05:13.750399 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:13.750336 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 23 00:05:13.750461 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:13.750422 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mz8vl\"" Jul 23 00:05:13.754737 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:13.754718 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx"] Jul 23 00:05:13.900642 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:13.900603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63653b18-5d37-4197-a58a-a94062c422cf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx\" (UID: \"63653b18-5d37-4197-a58a-a94062c422cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" Jul 23 00:05:13.900642 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:13.900649 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnfhv\" (UniqueName: \"kubernetes.io/projected/63653b18-5d37-4197-a58a-a94062c422cf-kube-api-access-fnfhv\") pod \"managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx\" (UID: \"63653b18-5d37-4197-a58a-a94062c422cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" Jul 23 00:05:14.001516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:14.001431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63653b18-5d37-4197-a58a-a94062c422cf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx\" (UID: \"63653b18-5d37-4197-a58a-a94062c422cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" Jul 23 00:05:14.001516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:14.001463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnfhv\" (UniqueName: \"kubernetes.io/projected/63653b18-5d37-4197-a58a-a94062c422cf-kube-api-access-fnfhv\") pod \"managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx\" (UID: \"63653b18-5d37-4197-a58a-a94062c422cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" Jul 23 00:05:14.004298 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:14.004269 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63653b18-5d37-4197-a58a-a94062c422cf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx\" (UID: \"63653b18-5d37-4197-a58a-a94062c422cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" Jul 23 00:05:14.010688 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:14.010662 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnfhv\" (UniqueName: \"kubernetes.io/projected/63653b18-5d37-4197-a58a-a94062c422cf-kube-api-access-fnfhv\") pod \"managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx\" (UID: \"63653b18-5d37-4197-a58a-a94062c422cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" Jul 23 00:05:14.064684 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:14.064642 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" Jul 23 00:05:14.188788 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:14.188754 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx"] Jul 23 00:05:14.192279 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:05:14.192250 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63653b18_5d37_4197_a58a_a94062c422cf.slice/crio-7802176ae53466b1cf389fccf66735223117a219850e0e2f9d7425179650a59a WatchSource:0}: Error finding container 7802176ae53466b1cf389fccf66735223117a219850e0e2f9d7425179650a59a: Status 404 returned error can't find the container with id 7802176ae53466b1cf389fccf66735223117a219850e0e2f9d7425179650a59a Jul 23 00:05:15.002351 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:15.002299 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" event={"ID":"63653b18-5d37-4197-a58a-a94062c422cf","Type":"ContainerStarted","Data":"7802176ae53466b1cf389fccf66735223117a219850e0e2f9d7425179650a59a"} Jul 23 00:05:17.937743 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:17.937714 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qgr7w" Jul 23 00:05:18.011361 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:18.011325 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" event={"ID":"63653b18-5d37-4197-a58a-a94062c422cf","Type":"ContainerStarted","Data":"7d77361f21aabbb53f47c1e3a3ef3e7907ddaa50655b28997456248dda9c3f01"} Jul 23 00:05:18.028355 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:18.028304 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" podStartSLOduration=1.9935938119999999 podStartE2EDuration="5.02828641s" totalImagesPullingTime="3.034692598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:05:18.027824674 +0000 UTC m=+59.891993845" watchObservedRunningTime="2026-07-23 00:05:18.02828641 +0000 UTC m=+59.892455599" Jul 23 00:05:18.092870 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:18.092836 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:05:18.154079 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:18.154046 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:05:19.102842 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:19.102807 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:05:19.195521 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:19.195480 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:05:19.259443 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:19.259329 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:05:23.267168 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.267125 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:05:23.267168 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.267182 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:05:23.267745 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.267217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:05:23.267745 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:05:23.267297 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 00:05:23.267745 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:05:23.267368 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls podName:bad05bc4-e611-4e6f-84bc-d41cbe4b09fa nodeName:}" failed. No retries permitted until 2026-07-23 00:05:55.267352425 +0000 UTC m=+97.131521577 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls") pod "dns-default-25447" (UID: "bad05bc4-e611-4e6f-84bc-d41cbe4b09fa") : secret "dns-default-metrics-tls" not found Jul 23 00:05:23.269658 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.269630 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 00:05:23.269786 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.269685 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 00:05:23.277703 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:05:23.277676 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 00:05:23.277813 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:05:23.277753 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs podName:0e89dbcf-8594-467f-8966-38e817ccc785 nodeName:}" failed. No retries permitted until 2026-07-23 00:06:27.277733365 +0000 UTC m=+129.141902517 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs") pod "network-metrics-daemon-dfb42" (UID: "0e89dbcf-8594-467f-8966-38e817ccc785") : secret "metrics-daemon-secret" not found Jul 23 00:05:23.279937 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.279910 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20402179-b992-42ea-91a0-0df7d5415521-original-pull-secret\") pod \"global-pull-secret-syncer-5t84s\" (UID: \"20402179-b992-42ea-91a0-0df7d5415521\") " pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:05:23.368306 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.368270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhcx\" (UniqueName: \"kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx\") pod \"network-check-target-zh42k\" (UID: \"c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf\") " pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:05:23.373423 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.373400 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 00:05:23.381283 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.381264 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 00:05:23.391222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.391182 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxhcx\" (UniqueName: \"kubernetes.io/projected/c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf-kube-api-access-fxhcx\") pod \"network-check-target-zh42k\" (UID: \"c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf\") " pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:05:23.470532 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.470502 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pdllw\"" Jul 23 00:05:23.472605 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.472588 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t84s" Jul 23 00:05:23.476139 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.476115 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:05:23.611937 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.611908 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5t84s"] Jul 23 00:05:23.614784 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:05:23.614752 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20402179_b992_42ea_91a0_0df7d5415521.slice/crio-33a628ecb4fc018a9f2d8aa3479c2e312542fd04ef43fa305acdd4ff03f6c0b3 WatchSource:0}: Error finding container 33a628ecb4fc018a9f2d8aa3479c2e312542fd04ef43fa305acdd4ff03f6c0b3: Status 404 returned error can't find the container with id 33a628ecb4fc018a9f2d8aa3479c2e312542fd04ef43fa305acdd4ff03f6c0b3 Jul 23 00:05:23.623546 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:23.623519 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zh42k"] Jul 23 00:05:23.626357 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:05:23.626334 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ee61b3_1a7b_414f_b194_dc9d58d6e4bf.slice/crio-8b75f629734d173674aa9fc0f6f4ec2ab983099ed4ef06e960a4b0008e063ac9 WatchSource:0}: Error finding container 8b75f629734d173674aa9fc0f6f4ec2ab983099ed4ef06e960a4b0008e063ac9: Status 404 returned error can't find the container with id 8b75f629734d173674aa9fc0f6f4ec2ab983099ed4ef06e960a4b0008e063ac9 Jul 23 00:05:24.025330 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:24.025291 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5t84s" event={"ID":"20402179-b992-42ea-91a0-0df7d5415521","Type":"ContainerStarted","Data":"33a628ecb4fc018a9f2d8aa3479c2e312542fd04ef43fa305acdd4ff03f6c0b3"} Jul 23 00:05:24.026434 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:24.026409 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zh42k" event={"ID":"c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf","Type":"ContainerStarted","Data":"8b75f629734d173674aa9fc0f6f4ec2ab983099ed4ef06e960a4b0008e063ac9"} Jul 23 00:05:25.333404 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:25.333323 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:05:25.391186 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:25.391145 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:05:29.040882 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:29.040848 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5t84s" event={"ID":"20402179-b992-42ea-91a0-0df7d5415521","Type":"ContainerStarted","Data":"cb0f2ea2e3b2e247dabdd226becee19fc916bddf222d4fedfb8213635bb8fa68"} Jul 23 00:05:29.042172 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:29.042148 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zh42k" event={"ID":"c0ee61b3-1a7b-414f-b194-dc9d58d6e4bf","Type":"ContainerStarted","Data":"0b59ab00f6724294bf996025c2f94b6f921e4f3d7df74081b995fa43a38a64e1"} Jul 23 00:05:29.042283 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:29.042264 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:05:29.056993 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:29.056949 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5t84s" podStartSLOduration=65.177565125 podStartE2EDuration="1m10.056935877s" totalImagesPullingTime="4.879370752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:05:29.055719363 +0000 UTC m=+70.919888534" watchObservedRunningTime="2026-07-23 00:05:29.056935877 +0000 UTC m=+70.921105065" Jul 23 00:05:29.070453 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:29.070409 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zh42k" podStartSLOduration=65.214160589 podStartE2EDuration="1m10.07037362s" totalImagesPullingTime="4.856213031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:05:29.06990946 +0000 UTC m=+70.934078634" watchObservedRunningTime="2026-07-23 00:05:29.07037362 +0000 UTC m=+70.934542790" Jul 23 00:05:55.286061 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:05:55.285914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:05:55.286576 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:05:55.286082 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 00:05:55.286576 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:05:55.286157 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls podName:bad05bc4-e611-4e6f-84bc-d41cbe4b09fa nodeName:}" failed. No retries permitted until 2026-07-23 00:06:59.28614104 +0000 UTC m=+161.150310188 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls") pod "dns-default-25447" (UID: "bad05bc4-e611-4e6f-84bc-d41cbe4b09fa") : secret "dns-default-metrics-tls" not found Jul 23 00:06:00.047375 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:06:00.047343 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zh42k" Jul 23 00:06:27.303339 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:06:27.303294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:06:27.303837 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:06:27.303458 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 00:06:27.303837 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:06:27.303531 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs podName:0e89dbcf-8594-467f-8966-38e817ccc785 nodeName:}" failed. No retries permitted until 2026-07-23 00:08:29.303513459 +0000 UTC m=+251.167682608 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs") pod "network-metrics-daemon-dfb42" (UID: "0e89dbcf-8594-467f-8966-38e817ccc785") : secret "metrics-daemon-secret" not found Jul 23 00:06:54.496023 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:06:54.495964 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-25447" podUID="bad05bc4-e611-4e6f-84bc-d41cbe4b09fa" Jul 23 00:06:54.678775 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:06:54.678729 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dfb42" podUID="0e89dbcf-8594-467f-8966-38e817ccc785" Jul 23 00:06:55.247201 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:06:55.247173 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-25447" Jul 23 00:06:59.323782 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:06:59.323741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:06:59.324174 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:06:59.323917 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 00:06:59.324174 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:06:59.323993 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls podName:bad05bc4-e611-4e6f-84bc-d41cbe4b09fa nodeName:}" failed. No retries permitted until 2026-07-23 00:09:01.323976488 +0000 UTC m=+283.188145638 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls") pod "dns-default-25447" (UID: "bad05bc4-e611-4e6f-84bc-d41cbe4b09fa") : secret "dns-default-metrics-tls" not found Jul 23 00:07:07.648860 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:07:07.648806 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:07:18.304170 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:07:18.304137 2574 generic.go:356] "Generic (PLEG): container finished" podID="63653b18-5d37-4197-a58a-a94062c422cf" containerID="7d77361f21aabbb53f47c1e3a3ef3e7907ddaa50655b28997456248dda9c3f01" exitCode=255 Jul 23 00:07:18.304601 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:07:18.304191 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" event={"ID":"63653b18-5d37-4197-a58a-a94062c422cf","Type":"ContainerDied","Data":"7d77361f21aabbb53f47c1e3a3ef3e7907ddaa50655b28997456248dda9c3f01"} Jul 23 00:07:18.309788 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:07:18.309771 2574 scope.go:117] "RemoveContainer" containerID="7d77361f21aabbb53f47c1e3a3ef3e7907ddaa50655b28997456248dda9c3f01" Jul 23 00:07:19.308623 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:07:19.308590 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" event={"ID":"63653b18-5d37-4197-a58a-a94062c422cf","Type":"ContainerStarted","Data":"dd5bfdcf3a8be8373cb15d0223b9b3cbfc06d80d0e5fc619941a6cc259244919"} Jul 23 00:07:37.430397 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:07:37.430352 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:04.154986 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.154944 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn"] Jul 23 00:08:04.158055 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.158031 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" Jul 23 00:08:04.160729 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.160709 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 23 00:08:04.161818 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.161794 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 23 00:08:04.161936 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.161830 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k5p79\"" Jul 23 00:08:04.161936 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.161894 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 23 00:08:04.161936 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.161915 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 23 00:08:04.164054 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.164025 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-k8lw8"] Jul 23 00:08:04.166774 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.166756 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv"] Jul 23 00:08:04.166883 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.166873 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.169594 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.169574 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" Jul 23 00:08:04.169738 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.169719 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 23 00:08:04.169948 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.169629 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 23 00:08:04.170052 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.169649 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-htrmx\"" Jul 23 00:08:04.170151 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.169594 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 23 00:08:04.170355 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.170230 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 23 00:08:04.170829 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.170811 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn"] Jul 23 00:08:04.172475 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.172453 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dj8kg\"" Jul 23 00:08:04.172573 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.172509 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 23 00:08:04.172632 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.172590 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 23 00:08:04.172775 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.172754 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 23 00:08:04.172878 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.172809 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 23 00:08:04.175680 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.175662 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 23 00:08:04.178679 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.178656 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-k8lw8"] Jul 23 00:08:04.182119 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.182099 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv"] Jul 23 00:08:04.252285 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.252253 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z"] Jul 23 00:08:04.255128 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.255101 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:04.255245 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.255143 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm"] Jul 23 00:08:04.257243 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.257207 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 23 00:08:04.257422 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.257293 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 23 00:08:04.257581 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.257567 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rjvfl\"" Jul 23 00:08:04.257937 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.257920 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:04.259986 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.259969 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f8bf6cb74-5z8ms"] Jul 23 00:08:04.260423 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.260402 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 23 00:08:04.260647 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.260517 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 23 00:08:04.260727 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.260656 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 23 00:08:04.260984 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.260969 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-v2ckf\"" Jul 23 00:08:04.262891 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.262873 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.264889 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.264873 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 00:08:04.265118 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.265102 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 00:08:04.265282 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.265265 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 00:08:04.265670 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.265648 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8tjsp\"" Jul 23 00:08:04.266889 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.266866 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z"] Jul 23 00:08:04.269691 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.269668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62zj2\" (UniqueName: \"kubernetes.io/projected/07ef6baf-4493-4807-9ae5-bd20280a7d9c-kube-api-access-62zj2\") pod \"console-operator-565b7b569d-k8lw8\" (UID: \"07ef6baf-4493-4807-9ae5-bd20280a7d9c\") " pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.269791 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.269703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb8hx\" (UniqueName: \"kubernetes.io/projected/75d3d07d-c6cf-4c52-a390-952c62dbb689-kube-api-access-vb8hx\") pod \"service-ca-operator-5bcbc94c78-56tkn\" (UID: \"75d3d07d-c6cf-4c52-a390-952c62dbb689\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" Jul 23 00:08:04.269791 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.269736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2217124c-eb39-46d0-b860-e13acd5d4d7c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-l29fv\" (UID: \"2217124c-eb39-46d0-b860-e13acd5d4d7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" Jul 23 00:08:04.269905 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.269787 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddjqc\" (UniqueName: \"kubernetes.io/projected/2217124c-eb39-46d0-b860-e13acd5d4d7c-kube-api-access-ddjqc\") pod \"kube-storage-version-migrator-operator-7658d9b749-l29fv\" (UID: \"2217124c-eb39-46d0-b860-e13acd5d4d7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" Jul 23 00:08:04.269905 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.269850 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07ef6baf-4493-4807-9ae5-bd20280a7d9c-serving-cert\") pod \"console-operator-565b7b569d-k8lw8\" (UID: \"07ef6baf-4493-4807-9ae5-bd20280a7d9c\") " pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.269905 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.269895 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2217124c-eb39-46d0-b860-e13acd5d4d7c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-l29fv\" (UID: \"2217124c-eb39-46d0-b860-e13acd5d4d7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" Jul 23 00:08:04.270052 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.269937 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75d3d07d-c6cf-4c52-a390-952c62dbb689-config\") pod \"service-ca-operator-5bcbc94c78-56tkn\" (UID: \"75d3d07d-c6cf-4c52-a390-952c62dbb689\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" Jul 23 00:08:04.270052 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.269988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07ef6baf-4493-4807-9ae5-bd20280a7d9c-config\") pod \"console-operator-565b7b569d-k8lw8\" (UID: \"07ef6baf-4493-4807-9ae5-bd20280a7d9c\") " pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.270052 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.270011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75d3d07d-c6cf-4c52-a390-952c62dbb689-serving-cert\") pod \"service-ca-operator-5bcbc94c78-56tkn\" (UID: \"75d3d07d-c6cf-4c52-a390-952c62dbb689\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" Jul 23 00:08:04.270052 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.270042 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07ef6baf-4493-4807-9ae5-bd20280a7d9c-trusted-ca\") pod \"console-operator-565b7b569d-k8lw8\" (UID: \"07ef6baf-4493-4807-9ae5-bd20280a7d9c\") " pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.271427 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.271407 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 00:08:04.283641 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.283605 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f8bf6cb74-5z8ms"] Jul 23 00:08:04.284522 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.284487 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm"] Jul 23 00:08:04.371130 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07ef6baf-4493-4807-9ae5-bd20280a7d9c-config\") pod \"console-operator-565b7b569d-k8lw8\" (UID: \"07ef6baf-4493-4807-9ae5-bd20280a7d9c\") " pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.371130 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75d3d07d-c6cf-4c52-a390-952c62dbb689-serving-cert\") pod \"service-ca-operator-5bcbc94c78-56tkn\" (UID: \"75d3d07d-c6cf-4c52-a390-952c62dbb689\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" Jul 23 00:08:04.371415 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljdv7\" (UniqueName: \"kubernetes.io/projected/8b89753c-5025-4f4b-9d24-440ccd30dedf-kube-api-access-ljdv7\") pod \"cluster-samples-operator-79b7c55f87-c6nvm\" (UID: \"8b89753c-5025-4f4b-9d24-440ccd30dedf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:04.371415 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62zj2\" (UniqueName: \"kubernetes.io/projected/07ef6baf-4493-4807-9ae5-bd20280a7d9c-kube-api-access-62zj2\") pod \"console-operator-565b7b569d-k8lw8\" (UID: \"07ef6baf-4493-4807-9ae5-bd20280a7d9c\") " pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.371415 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371216 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddjqc\" (UniqueName: \"kubernetes.io/projected/2217124c-eb39-46d0-b860-e13acd5d4d7c-kube-api-access-ddjqc\") pod \"kube-storage-version-migrator-operator-7658d9b749-l29fv\" (UID: \"2217124c-eb39-46d0-b860-e13acd5d4d7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" Jul 23 00:08:04.371415 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a40c97da-e8c6-4670-b1db-248a8aefd49b-trusted-ca\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.371415 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75d3d07d-c6cf-4c52-a390-952c62dbb689-config\") pod \"service-ca-operator-5bcbc94c78-56tkn\" (UID: \"75d3d07d-c6cf-4c52-a390-952c62dbb689\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" Jul 23 00:08:04.371415 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371307 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07ef6baf-4493-4807-9ae5-bd20280a7d9c-trusted-ca\") pod \"console-operator-565b7b569d-k8lw8\" (UID: \"07ef6baf-4493-4807-9ae5-bd20280a7d9c\") " pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.371415 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371353 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb8hx\" (UniqueName: \"kubernetes.io/projected/75d3d07d-c6cf-4c52-a390-952c62dbb689-kube-api-access-vb8hx\") pod \"service-ca-operator-5bcbc94c78-56tkn\" (UID: \"75d3d07d-c6cf-4c52-a390-952c62dbb689\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" Jul 23 00:08:04.371415 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-c6nvm\" (UID: \"8b89753c-5025-4f4b-9d24-440ccd30dedf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:04.371823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.371823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371454 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flk9d\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-kube-api-access-flk9d\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.371823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a40c97da-e8c6-4670-b1db-248a8aefd49b-installation-pull-secrets\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.371823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371682 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2217124c-eb39-46d0-b860-e13acd5d4d7c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-l29fv\" (UID: \"2217124c-eb39-46d0-b860-e13acd5d4d7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" Jul 23 00:08:04.371823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371718 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a40c97da-e8c6-4670-b1db-248a8aefd49b-ca-trust-extracted\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.371823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371756 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-certificates\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.371823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371782 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-bound-sa-token\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.371823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371809 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a40c97da-e8c6-4670-b1db-248a8aefd49b-image-registry-private-configuration\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.372222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c06cb800-fb64-4940-aaee-4b406eebdb5f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-xdd6z\" (UID: \"c06cb800-fb64-4940-aaee-4b406eebdb5f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:04.372222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07ef6baf-4493-4807-9ae5-bd20280a7d9c-serving-cert\") pod \"console-operator-565b7b569d-k8lw8\" (UID: \"07ef6baf-4493-4807-9ae5-bd20280a7d9c\") " pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.372222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xdd6z\" (UID: \"c06cb800-fb64-4940-aaee-4b406eebdb5f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:04.372222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371955 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75d3d07d-c6cf-4c52-a390-952c62dbb689-config\") pod \"service-ca-operator-5bcbc94c78-56tkn\" (UID: \"75d3d07d-c6cf-4c52-a390-952c62dbb689\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" Jul 23 00:08:04.372222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371985 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07ef6baf-4493-4807-9ae5-bd20280a7d9c-config\") pod \"console-operator-565b7b569d-k8lw8\" (UID: \"07ef6baf-4493-4807-9ae5-bd20280a7d9c\") " pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.372222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.371956 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2217124c-eb39-46d0-b860-e13acd5d4d7c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-l29fv\" (UID: \"2217124c-eb39-46d0-b860-e13acd5d4d7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" Jul 23 00:08:04.372222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.372125 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2217124c-eb39-46d0-b860-e13acd5d4d7c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-l29fv\" (UID: \"2217124c-eb39-46d0-b860-e13acd5d4d7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" Jul 23 00:08:04.372543 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.372259 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07ef6baf-4493-4807-9ae5-bd20280a7d9c-trusted-ca\") pod \"console-operator-565b7b569d-k8lw8\" (UID: \"07ef6baf-4493-4807-9ae5-bd20280a7d9c\") " pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.373674 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.373651 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75d3d07d-c6cf-4c52-a390-952c62dbb689-serving-cert\") pod \"service-ca-operator-5bcbc94c78-56tkn\" (UID: \"75d3d07d-c6cf-4c52-a390-952c62dbb689\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" Jul 23 00:08:04.374032 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.374011 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2217124c-eb39-46d0-b860-e13acd5d4d7c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-l29fv\" (UID: \"2217124c-eb39-46d0-b860-e13acd5d4d7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" Jul 23 00:08:04.374121 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.374109 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07ef6baf-4493-4807-9ae5-bd20280a7d9c-serving-cert\") pod \"console-operator-565b7b569d-k8lw8\" (UID: \"07ef6baf-4493-4807-9ae5-bd20280a7d9c\") " pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.386684 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.386658 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb8hx\" (UniqueName: \"kubernetes.io/projected/75d3d07d-c6cf-4c52-a390-952c62dbb689-kube-api-access-vb8hx\") pod \"service-ca-operator-5bcbc94c78-56tkn\" (UID: \"75d3d07d-c6cf-4c52-a390-952c62dbb689\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" Jul 23 00:08:04.387041 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.387019 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddjqc\" (UniqueName: \"kubernetes.io/projected/2217124c-eb39-46d0-b860-e13acd5d4d7c-kube-api-access-ddjqc\") pod \"kube-storage-version-migrator-operator-7658d9b749-l29fv\" (UID: \"2217124c-eb39-46d0-b860-e13acd5d4d7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" Jul 23 00:08:04.395109 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.395089 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62zj2\" (UniqueName: \"kubernetes.io/projected/07ef6baf-4493-4807-9ae5-bd20280a7d9c-kube-api-access-62zj2\") pod \"console-operator-565b7b569d-k8lw8\" (UID: \"07ef6baf-4493-4807-9ae5-bd20280a7d9c\") " pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.407409 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.407325 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:04.467329 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.467287 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" Jul 23 00:08:04.472607 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.472585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-c6nvm\" (UID: \"8b89753c-5025-4f4b-9d24-440ccd30dedf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:04.472679 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.472616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.472679 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.472637 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flk9d\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-kube-api-access-flk9d\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.472679 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.472655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a40c97da-e8c6-4670-b1db-248a8aefd49b-installation-pull-secrets\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.472679 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.472673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a40c97da-e8c6-4670-b1db-248a8aefd49b-ca-trust-extracted\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.472862 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.472688 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-certificates\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.472862 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.472706 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-bound-sa-token\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.472862 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.472730 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a40c97da-e8c6-4670-b1db-248a8aefd49b-image-registry-private-configuration\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.472862 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.472754 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 00:08:04.472862 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.472804 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 00:08:04.472862 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.472823 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8bf6cb74-5z8ms: secret "image-registry-tls" not found Jul 23 00:08:04.472862 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.472827 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls podName:8b89753c-5025-4f4b-9d24-440ccd30dedf nodeName:}" failed. No retries permitted until 2026-07-23 00:08:04.972805248 +0000 UTC m=+226.836974401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-c6nvm" (UID: "8b89753c-5025-4f4b-9d24-440ccd30dedf") : secret "samples-operator-tls" not found Jul 23 00:08:04.473190 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.472881 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls podName:a40c97da-e8c6-4670-b1db-248a8aefd49b nodeName:}" failed. No retries permitted until 2026-07-23 00:08:04.972864582 +0000 UTC m=+226.837033756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls") pod "image-registry-7f8bf6cb74-5z8ms" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b") : secret "image-registry-tls" not found Jul 23 00:08:04.473190 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.472760 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c06cb800-fb64-4940-aaee-4b406eebdb5f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-xdd6z\" (UID: \"c06cb800-fb64-4940-aaee-4b406eebdb5f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:04.473190 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.472991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xdd6z\" (UID: \"c06cb800-fb64-4940-aaee-4b406eebdb5f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:04.473190 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.473048 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a40c97da-e8c6-4670-b1db-248a8aefd49b-ca-trust-extracted\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.473190 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.473067 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljdv7\" (UniqueName: \"kubernetes.io/projected/8b89753c-5025-4f4b-9d24-440ccd30dedf-kube-api-access-ljdv7\") pod \"cluster-samples-operator-79b7c55f87-c6nvm\" (UID: \"8b89753c-5025-4f4b-9d24-440ccd30dedf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:04.473190 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.473169 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 00:08:04.473478 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.473190 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a40c97da-e8c6-4670-b1db-248a8aefd49b-trusted-ca\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.473478 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.473209 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert podName:c06cb800-fb64-4940-aaee-4b406eebdb5f nodeName:}" failed. No retries permitted until 2026-07-23 00:08:04.973196677 +0000 UTC m=+226.837365829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-xdd6z" (UID: "c06cb800-fb64-4940-aaee-4b406eebdb5f") : secret "networking-console-plugin-cert" not found Jul 23 00:08:04.473478 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.473299 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-certificates\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.473478 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.473423 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c06cb800-fb64-4940-aaee-4b406eebdb5f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-xdd6z\" (UID: \"c06cb800-fb64-4940-aaee-4b406eebdb5f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:04.474169 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.474150 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a40c97da-e8c6-4670-b1db-248a8aefd49b-trusted-ca\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.475309 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.475287 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a40c97da-e8c6-4670-b1db-248a8aefd49b-image-registry-private-configuration\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.475423 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.475358 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a40c97da-e8c6-4670-b1db-248a8aefd49b-installation-pull-secrets\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.477297 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.477277 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:04.483357 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.483332 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" Jul 23 00:08:04.483915 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.483893 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljdv7\" (UniqueName: \"kubernetes.io/projected/8b89753c-5025-4f4b-9d24-440ccd30dedf-kube-api-access-ljdv7\") pod \"cluster-samples-operator-79b7c55f87-c6nvm\" (UID: \"8b89753c-5025-4f4b-9d24-440ccd30dedf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:04.483984 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.483899 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flk9d\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-kube-api-access-flk9d\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.484795 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.484773 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-bound-sa-token\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.503747 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.503712 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:04.603488 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.603450 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:04.620621 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.620506 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn"] Jul 23 00:08:04.625440 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:08:04.625412 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d3d07d_c6cf_4c52_a390_952c62dbb689.slice/crio-9bfd15165202ce312325311159e851f1bbddb7e8d268484aa02268e785483132 WatchSource:0}: Error finding container 9bfd15165202ce312325311159e851f1bbddb7e8d268484aa02268e785483132: Status 404 returned error can't find the container with id 9bfd15165202ce312325311159e851f1bbddb7e8d268484aa02268e785483132 Jul 23 00:08:04.844514 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.844482 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv"] Jul 23 00:08:04.847577 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:08:04.847545 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2217124c_eb39_46d0_b860_e13acd5d4d7c.slice/crio-5305f015fe12e4362fe0b7fcc0ed50acd0264f44004bb943d3f8e6d858f7d624 WatchSource:0}: Error finding container 5305f015fe12e4362fe0b7fcc0ed50acd0264f44004bb943d3f8e6d858f7d624: Status 404 returned error can't find the container with id 5305f015fe12e4362fe0b7fcc0ed50acd0264f44004bb943d3f8e6d858f7d624 Jul 23 00:08:04.847956 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.847935 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-k8lw8"] Jul 23 00:08:04.850839 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:08:04.850820 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ef6baf_4493_4807_9ae5_bd20280a7d9c.slice/crio-bb32c0d4f9a14855047cddaeaacd20b2a8d033f8183de5946b2dd157406b133e WatchSource:0}: Error finding container bb32c0d4f9a14855047cddaeaacd20b2a8d033f8183de5946b2dd157406b133e: Status 404 returned error can't find the container with id bb32c0d4f9a14855047cddaeaacd20b2a8d033f8183de5946b2dd157406b133e Jul 23 00:08:04.979966 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.979926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-c6nvm\" (UID: \"8b89753c-5025-4f4b-9d24-440ccd30dedf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:04.979966 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.979963 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:04.980232 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:04.980090 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xdd6z\" (UID: \"c06cb800-fb64-4940-aaee-4b406eebdb5f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:04.980232 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.980147 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 00:08:04.980232 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.980156 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 00:08:04.980232 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.980175 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8bf6cb74-5z8ms: secret "image-registry-tls" not found Jul 23 00:08:04.980232 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.980217 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls podName:8b89753c-5025-4f4b-9d24-440ccd30dedf nodeName:}" failed. No retries permitted until 2026-07-23 00:08:05.980196528 +0000 UTC m=+227.844365698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-c6nvm" (UID: "8b89753c-5025-4f4b-9d24-440ccd30dedf") : secret "samples-operator-tls" not found Jul 23 00:08:04.980503 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.980239 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls podName:a40c97da-e8c6-4670-b1db-248a8aefd49b nodeName:}" failed. No retries permitted until 2026-07-23 00:08:05.980226628 +0000 UTC m=+227.844395784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls") pod "image-registry-7f8bf6cb74-5z8ms" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b") : secret "image-registry-tls" not found Jul 23 00:08:04.980503 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.980242 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 00:08:04.980503 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:04.980281 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert podName:c06cb800-fb64-4940-aaee-4b406eebdb5f nodeName:}" failed. No retries permitted until 2026-07-23 00:08:05.980270398 +0000 UTC m=+227.844439562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-xdd6z" (UID: "c06cb800-fb64-4940-aaee-4b406eebdb5f") : secret "networking-console-plugin-cert" not found Jul 23 00:08:05.430412 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:05.430356 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" event={"ID":"07ef6baf-4493-4807-9ae5-bd20280a7d9c","Type":"ContainerStarted","Data":"bb32c0d4f9a14855047cddaeaacd20b2a8d033f8183de5946b2dd157406b133e"} Jul 23 00:08:05.431855 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:05.431828 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" event={"ID":"75d3d07d-c6cf-4c52-a390-952c62dbb689","Type":"ContainerStarted","Data":"9bfd15165202ce312325311159e851f1bbddb7e8d268484aa02268e785483132"} Jul 23 00:08:05.433779 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:05.433723 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" event={"ID":"2217124c-eb39-46d0-b860-e13acd5d4d7c","Type":"ContainerStarted","Data":"5305f015fe12e4362fe0b7fcc0ed50acd0264f44004bb943d3f8e6d858f7d624"} Jul 23 00:08:05.989664 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:05.989616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xdd6z\" (UID: \"c06cb800-fb64-4940-aaee-4b406eebdb5f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:05.989903 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:05.989798 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 00:08:05.989903 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:05.989832 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-c6nvm\" (UID: \"8b89753c-5025-4f4b-9d24-440ccd30dedf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:05.989903 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:05.989875 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert podName:c06cb800-fb64-4940-aaee-4b406eebdb5f nodeName:}" failed. No retries permitted until 2026-07-23 00:08:07.98985363 +0000 UTC m=+229.854022782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-xdd6z" (UID: "c06cb800-fb64-4940-aaee-4b406eebdb5f") : secret "networking-console-plugin-cert" not found Jul 23 00:08:05.990070 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:05.989904 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:05.990070 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:05.989935 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 00:08:05.990070 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:05.989984 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls podName:8b89753c-5025-4f4b-9d24-440ccd30dedf nodeName:}" failed. No retries permitted until 2026-07-23 00:08:07.989968556 +0000 UTC m=+229.854137714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-c6nvm" (UID: "8b89753c-5025-4f4b-9d24-440ccd30dedf") : secret "samples-operator-tls" not found Jul 23 00:08:05.990070 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:05.990025 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 00:08:05.990070 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:05.990037 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8bf6cb74-5z8ms: secret "image-registry-tls" not found Jul 23 00:08:05.990296 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:05.990077 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls podName:a40c97da-e8c6-4670-b1db-248a8aefd49b nodeName:}" failed. No retries permitted until 2026-07-23 00:08:07.990062256 +0000 UTC m=+229.854231404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls") pod "image-registry-7f8bf6cb74-5z8ms" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b") : secret "image-registry-tls" not found Jul 23 00:08:06.505775 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:06.505730 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:06.559326 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:06.559288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:08.008150 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.008038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xdd6z\" (UID: \"c06cb800-fb64-4940-aaee-4b406eebdb5f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:08.008638 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.008168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-c6nvm\" (UID: \"8b89753c-5025-4f4b-9d24-440ccd30dedf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:08.008638 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.008202 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 00:08:08.008638 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.008286 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert podName:c06cb800-fb64-4940-aaee-4b406eebdb5f nodeName:}" failed. No retries permitted until 2026-07-23 00:08:12.008262691 +0000 UTC m=+233.872431841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-xdd6z" (UID: "c06cb800-fb64-4940-aaee-4b406eebdb5f") : secret "networking-console-plugin-cert" not found Jul 23 00:08:08.008638 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.008294 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 00:08:08.008638 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.008300 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 00:08:08.008638 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.008207 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:08.008638 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.008358 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls podName:8b89753c-5025-4f4b-9d24-440ccd30dedf nodeName:}" failed. No retries permitted until 2026-07-23 00:08:12.008341667 +0000 UTC m=+233.872510816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-c6nvm" (UID: "8b89753c-5025-4f4b-9d24-440ccd30dedf") : secret "samples-operator-tls" not found Jul 23 00:08:08.008638 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.008308 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8bf6cb74-5z8ms: secret "image-registry-tls" not found Jul 23 00:08:08.008638 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.008441 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls podName:a40c97da-e8c6-4670-b1db-248a8aefd49b nodeName:}" failed. No retries permitted until 2026-07-23 00:08:12.008422233 +0000 UTC m=+233.872591386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls") pod "image-registry-7f8bf6cb74-5z8ms" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b") : secret "image-registry-tls" not found Jul 23 00:08:08.189613 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.189574 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mqz4g"] Jul 23 00:08:08.192899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.192874 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.196614 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.196589 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 00:08:08.196758 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.196657 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 00:08:08.196856 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.196838 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 00:08:08.197500 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.197459 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7jhfv\"" Jul 23 00:08:08.197500 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.197472 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 00:08:08.206299 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.206276 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mqz4g"] Jul 23 00:08:08.221589 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.221557 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:08.279328 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.279237 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:08.310994 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.310956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/147d2b45-869c-49c8-b5ac-9fe05a1430bc-data-volume\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.311149 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.311007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.311149 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.311084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6mff\" (UniqueName: \"kubernetes.io/projected/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-api-access-r6mff\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.311149 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.311140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.311333 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.311213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/147d2b45-869c-49c8-b5ac-9fe05a1430bc-crio-socket\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.412533 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.412491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/147d2b45-869c-49c8-b5ac-9fe05a1430bc-data-volume\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.412533 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.412533 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.412779 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.412555 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6mff\" (UniqueName: \"kubernetes.io/projected/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-api-access-r6mff\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.412779 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.412597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.412779 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.412630 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 00:08:08.412779 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.412692 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/147d2b45-869c-49c8-b5ac-9fe05a1430bc-crio-socket\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.412779 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.412634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/147d2b45-869c-49c8-b5ac-9fe05a1430bc-crio-socket\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.412779 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.412706 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm podName:147d2b45-869c-49c8-b5ac-9fe05a1430bc nodeName:}" failed. No retries permitted until 2026-07-23 00:08:08.912686727 +0000 UTC m=+230.776855897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqz4g" (UID: "147d2b45-869c-49c8-b5ac-9fe05a1430bc") : configmap "kube-rbac-proxy" not found Jul 23 00:08:08.412779 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.412772 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 00:08:08.413131 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.412833 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls podName:147d2b45-869c-49c8-b5ac-9fe05a1430bc nodeName:}" failed. No retries permitted until 2026-07-23 00:08:08.912814107 +0000 UTC m=+230.776983262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqz4g" (UID: "147d2b45-869c-49c8-b5ac-9fe05a1430bc") : secret "insights-runtime-extractor-tls" not found Jul 23 00:08:08.413131 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.412878 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/147d2b45-869c-49c8-b5ac-9fe05a1430bc-data-volume\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.420779 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.420752 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6mff\" (UniqueName: \"kubernetes.io/projected/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-api-access-r6mff\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.444321 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.444291 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/0.log" Jul 23 00:08:08.444515 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.444333 2574 generic.go:356] "Generic (PLEG): container finished" podID="07ef6baf-4493-4807-9ae5-bd20280a7d9c" containerID="625cadefa41fa2310ed4d10ddd6ace3ecf81bb7918c0d76f23875a10e3812b1a" exitCode=255 Jul 23 00:08:08.444515 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.444424 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" event={"ID":"07ef6baf-4493-4807-9ae5-bd20280a7d9c","Type":"ContainerDied","Data":"625cadefa41fa2310ed4d10ddd6ace3ecf81bb7918c0d76f23875a10e3812b1a"} Jul 23 00:08:08.444694 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.444674 2574 scope.go:117] "RemoveContainer" containerID="625cadefa41fa2310ed4d10ddd6ace3ecf81bb7918c0d76f23875a10e3812b1a" Jul 23 00:08:08.446340 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.446095 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" event={"ID":"75d3d07d-c6cf-4c52-a390-952c62dbb689","Type":"ContainerStarted","Data":"4968b971d58a245cfd800bb1887ee24b9608445f25e3b8b724b813e30e4f099e"} Jul 23 00:08:08.447775 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.447755 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" event={"ID":"2217124c-eb39-46d0-b860-e13acd5d4d7c","Type":"ContainerStarted","Data":"c066a61aadc6507fe03ffa1f5f74e44ba3d8c9b6acab7c0620d7b97ec52c1ed8"} Jul 23 00:08:08.473200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.473137 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" podStartSLOduration=1.564677973 podStartE2EDuration="4.473118413s" totalImagesPullingTime="2.90844044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:08.472760602 +0000 UTC m=+230.336929774" watchObservedRunningTime="2026-07-23 00:08:08.473118413 +0000 UTC m=+230.337287585" Jul 23 00:08:08.487033 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.486987 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" podStartSLOduration=1.352593043 podStartE2EDuration="4.486971263s" totalImagesPullingTime="3.13437822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:08.485859279 +0000 UTC m=+230.350028464" watchObservedRunningTime="2026-07-23 00:08:08.486971263 +0000 UTC m=+230.351140434" Jul 23 00:08:08.808215 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.808163 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:08.909719 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.909634 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:08.918570 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.918539 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.918694 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:08.918636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:08.918737 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.918701 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 00:08:08.918737 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.918713 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 00:08:08.918827 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.918768 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm podName:147d2b45-869c-49c8-b5ac-9fe05a1430bc nodeName:}" failed. No retries permitted until 2026-07-23 00:08:09.91875314 +0000 UTC m=+231.782922289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqz4g" (UID: "147d2b45-869c-49c8-b5ac-9fe05a1430bc") : configmap "kube-rbac-proxy" not found Jul 23 00:08:08.918827 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:08.918793 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls podName:147d2b45-869c-49c8-b5ac-9fe05a1430bc nodeName:}" failed. No retries permitted until 2026-07-23 00:08:09.918775273 +0000 UTC m=+231.782944430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqz4g" (UID: "147d2b45-869c-49c8-b5ac-9fe05a1430bc") : secret "insights-runtime-extractor-tls" not found Jul 23 00:08:09.248748 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.248714 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:09.343223 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.343191 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:09.394546 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.394507 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:09.455743 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.455716 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/1.log" Jul 23 00:08:09.456229 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.456206 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/0.log" Jul 23 00:08:09.456376 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.456251 2574 generic.go:356] "Generic (PLEG): container finished" podID="07ef6baf-4493-4807-9ae5-bd20280a7d9c" containerID="c04ecfb862a2283100fd5ce272338d49b7266389d7e157ff61ad392135edf2ba" exitCode=255 Jul 23 00:08:09.456376 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.456284 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" event={"ID":"07ef6baf-4493-4807-9ae5-bd20280a7d9c","Type":"ContainerDied","Data":"c04ecfb862a2283100fd5ce272338d49b7266389d7e157ff61ad392135edf2ba"} Jul 23 00:08:09.456376 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.456348 2574 scope.go:117] "RemoveContainer" containerID="625cadefa41fa2310ed4d10ddd6ace3ecf81bb7918c0d76f23875a10e3812b1a" Jul 23 00:08:09.456609 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.456594 2574 scope.go:117] "RemoveContainer" containerID="c04ecfb862a2283100fd5ce272338d49b7266389d7e157ff61ad392135edf2ba" Jul 23 00:08:09.456813 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:09.456790 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-k8lw8_openshift-console-operator(07ef6baf-4493-4807-9ae5-bd20280a7d9c)\"" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" podUID="07ef6baf-4493-4807-9ae5-bd20280a7d9c" Jul 23 00:08:09.514268 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.514186 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:09.616928 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.616897 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:09.925798 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.925693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:09.925798 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.925761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:09.925995 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:09.925817 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 00:08:09.925995 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:09.925886 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm podName:147d2b45-869c-49c8-b5ac-9fe05a1430bc nodeName:}" failed. No retries permitted until 2026-07-23 00:08:11.925870139 +0000 UTC m=+233.790039288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqz4g" (UID: "147d2b45-869c-49c8-b5ac-9fe05a1430bc") : configmap "kube-rbac-proxy" not found Jul 23 00:08:09.925995 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:09.925898 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 00:08:09.925995 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:09.925953 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls podName:147d2b45-869c-49c8-b5ac-9fe05a1430bc nodeName:}" failed. No retries permitted until 2026-07-23 00:08:11.925936823 +0000 UTC m=+233.790105994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqz4g" (UID: "147d2b45-869c-49c8-b5ac-9fe05a1430bc") : secret "insights-runtime-extractor-tls" not found Jul 23 00:08:09.965657 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:09.965625 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6d6zq_ce321df6-7f11-4d73-a5ee-ecf33cc54d77/dns-node-resolver/0.log" Jul 23 00:08:10.271012 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.270979 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vgz"] Jul 23 00:08:10.275333 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.275311 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vgz" Jul 23 00:08:10.277578 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.277554 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 23 00:08:10.278254 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.278234 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 23 00:08:10.278342 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.278248 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mqd6s\"" Jul 23 00:08:10.282694 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.282568 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vgz"] Jul 23 00:08:10.317333 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.317299 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:10.376725 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.376686 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:10.429582 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.429543 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsrxl\" (UniqueName: \"kubernetes.io/projected/6c68d84c-79c3-47d6-9cb4-cb2681970d00-kube-api-access-rsrxl\") pod \"migrator-7cc9c7ffd7-94vgz\" (UID: \"6c68d84c-79c3-47d6-9cb4-cb2681970d00\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vgz" Jul 23 00:08:10.460749 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.460724 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/1.log" Jul 23 00:08:10.461058 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.461043 2574 scope.go:117] "RemoveContainer" containerID="c04ecfb862a2283100fd5ce272338d49b7266389d7e157ff61ad392135edf2ba" Jul 23 00:08:10.461244 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:10.461224 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-k8lw8_openshift-console-operator(07ef6baf-4493-4807-9ae5-bd20280a7d9c)\"" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" podUID="07ef6baf-4493-4807-9ae5-bd20280a7d9c" Jul 23 00:08:10.530564 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.530475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsrxl\" (UniqueName: \"kubernetes.io/projected/6c68d84c-79c3-47d6-9cb4-cb2681970d00-kube-api-access-rsrxl\") pod \"migrator-7cc9c7ffd7-94vgz\" (UID: \"6c68d84c-79c3-47d6-9cb4-cb2681970d00\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vgz" Jul 23 00:08:10.542222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.542189 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsrxl\" (UniqueName: \"kubernetes.io/projected/6c68d84c-79c3-47d6-9cb4-cb2681970d00-kube-api-access-rsrxl\") pod \"migrator-7cc9c7ffd7-94vgz\" (UID: \"6c68d84c-79c3-47d6-9cb4-cb2681970d00\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vgz" Jul 23 00:08:10.585579 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.585538 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vgz" Jul 23 00:08:10.710488 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:10.710462 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vgz"] Jul 23 00:08:10.712521 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:08:10.712480 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c68d84c_79c3_47d6_9cb4_cb2681970d00.slice/crio-9f8fc90871d6b63b25c30a65c3137065681b4c58160ec2de48bfb0ad2b161523 WatchSource:0}: Error finding container 9f8fc90871d6b63b25c30a65c3137065681b4c58160ec2de48bfb0ad2b161523: Status 404 returned error can't find the container with id 9f8fc90871d6b63b25c30a65c3137065681b4c58160ec2de48bfb0ad2b161523 Jul 23 00:08:11.150764 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:11.150724 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:11.202634 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:11.202596 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:11.365375 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:11.365347 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c6qqx_807b0073-a7e3-4d00-9589-ae775a84e7ad/node-ca/0.log" Jul 23 00:08:11.465559 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:11.465471 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vgz" event={"ID":"6c68d84c-79c3-47d6-9cb4-cb2681970d00","Type":"ContainerStarted","Data":"9f8fc90871d6b63b25c30a65c3137065681b4c58160ec2de48bfb0ad2b161523"} Jul 23 00:08:11.941204 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:11.941178 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:11.941345 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:11.941267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:11.941345 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:11.941328 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 00:08:11.941451 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:11.941335 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 00:08:11.941451 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:11.941404 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls podName:147d2b45-869c-49c8-b5ac-9fe05a1430bc nodeName:}" failed. No retries permitted until 2026-07-23 00:08:15.941366659 +0000 UTC m=+237.805535809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqz4g" (UID: "147d2b45-869c-49c8-b5ac-9fe05a1430bc") : secret "insights-runtime-extractor-tls" not found Jul 23 00:08:11.941451 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:11.941438 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm podName:147d2b45-869c-49c8-b5ac-9fe05a1430bc nodeName:}" failed. No retries permitted until 2026-07-23 00:08:15.941425373 +0000 UTC m=+237.805594521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqz4g" (UID: "147d2b45-869c-49c8-b5ac-9fe05a1430bc") : configmap "kube-rbac-proxy" not found Jul 23 00:08:12.042288 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:12.042252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xdd6z\" (UID: \"c06cb800-fb64-4940-aaee-4b406eebdb5f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:12.042478 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:12.042348 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-c6nvm\" (UID: \"8b89753c-5025-4f4b-9d24-440ccd30dedf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:12.042478 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:12.042379 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:12.042478 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:12.042421 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 00:08:12.042592 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:12.042494 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 00:08:12.042592 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:12.042496 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 00:08:12.042592 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:12.042534 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8bf6cb74-5z8ms: secret "image-registry-tls" not found Jul 23 00:08:12.042592 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:12.042500 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert podName:c06cb800-fb64-4940-aaee-4b406eebdb5f nodeName:}" failed. No retries permitted until 2026-07-23 00:08:20.04247997 +0000 UTC m=+241.906649124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-xdd6z" (UID: "c06cb800-fb64-4940-aaee-4b406eebdb5f") : secret "networking-console-plugin-cert" not found Jul 23 00:08:12.042592 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:12.042586 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls podName:8b89753c-5025-4f4b-9d24-440ccd30dedf nodeName:}" failed. No retries permitted until 2026-07-23 00:08:20.042565071 +0000 UTC m=+241.906734224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-c6nvm" (UID: "8b89753c-5025-4f4b-9d24-440ccd30dedf") : secret "samples-operator-tls" not found Jul 23 00:08:12.042745 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:12.042604 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls podName:a40c97da-e8c6-4670-b1db-248a8aefd49b nodeName:}" failed. No retries permitted until 2026-07-23 00:08:20.042597073 +0000 UTC m=+241.906766222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls") pod "image-registry-7f8bf6cb74-5z8ms" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b") : secret "image-registry-tls" not found Jul 23 00:08:12.109477 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:12.109365 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:12.366087 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:12.366005 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rjr7d_1e53529c-5039-4a5e-8bcd-43569dfe7a18/serve-healthcheck-canary/0.log" Jul 23 00:08:12.471020 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:12.470984 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vgz" event={"ID":"6c68d84c-79c3-47d6-9cb4-cb2681970d00","Type":"ContainerStarted","Data":"d5921af19e8175465f8d9b60d9357ee05d735dc115c20216a411b4b0205ebd79"} Jul 23 00:08:12.471221 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:12.471048 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vgz" event={"ID":"6c68d84c-79c3-47d6-9cb4-cb2681970d00","Type":"ContainerStarted","Data":"a8cb8ffd040b797aa383c57ffbeaf182b89235bb613ff4b6be252cf75314e6df"} Jul 23 00:08:12.487883 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:12.487828 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vgz" podStartSLOduration=1.391200008 podStartE2EDuration="2.487810884s" totalImagesPullingTime="1.096610876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:12.486339104 +0000 UTC m=+234.350508278" watchObservedRunningTime="2026-07-23 00:08:12.487810884 +0000 UTC m=+234.351980092" Jul 23 00:08:14.477673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:14.477592 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:14.477673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:14.477646 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:14.478057 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:14.477956 2574 scope.go:117] "RemoveContainer" containerID="c04ecfb862a2283100fd5ce272338d49b7266389d7e157ff61ad392135edf2ba" Jul 23 00:08:14.478125 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:14.478104 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-k8lw8_openshift-console-operator(07ef6baf-4493-4807-9ae5-bd20280a7d9c)\"" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" podUID="07ef6baf-4493-4807-9ae5-bd20280a7d9c" Jul 23 00:08:14.617831 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:14.617792 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:14.965518 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:14.965485 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:15.102624 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:15.102593 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:15.203661 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:15.203626 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:15.310068 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:15.310026 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:15.404664 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:15.404629 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:15.658221 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:15.658141 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:15.975881 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:15.975795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:15.976036 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:15.975924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:15.976036 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:15.975951 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 00:08:15.976036 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:15.976004 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 00:08:15.976036 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:15.976021 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls podName:147d2b45-869c-49c8-b5ac-9fe05a1430bc nodeName:}" failed. No retries permitted until 2026-07-23 00:08:23.976004565 +0000 UTC m=+245.840173713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqz4g" (UID: "147d2b45-869c-49c8-b5ac-9fe05a1430bc") : secret "insights-runtime-extractor-tls" not found Jul 23 00:08:15.976225 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:15.976056 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm podName:147d2b45-869c-49c8-b5ac-9fe05a1430bc nodeName:}" failed. No retries permitted until 2026-07-23 00:08:23.976035949 +0000 UTC m=+245.840205097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqz4g" (UID: "147d2b45-869c-49c8-b5ac-9fe05a1430bc") : configmap "kube-rbac-proxy" not found Jul 23 00:08:16.859263 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:16.859230 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:17.062149 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:17.062097 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:17.256170 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:17.256143 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:17.466619 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:17.466590 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:17.657775 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:17.657681 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:18.461124 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:18.461087 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:18.867392 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:18.867335 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:18.924734 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:18.924702 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:19.005444 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:19.005406 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:19.072098 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:19.072067 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:19.258141 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:19.258107 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:19.663519 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:19.663433 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:19.854975 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:19.854940 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:20.060544 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.060507 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:20.112671 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.112636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xdd6z\" (UID: \"c06cb800-fb64-4940-aaee-4b406eebdb5f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:20.112805 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.112738 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-c6nvm\" (UID: \"8b89753c-5025-4f4b-9d24-440ccd30dedf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:20.112805 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.112761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:20.112805 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:20.112782 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 00:08:20.112961 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:20.112845 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert podName:c06cb800-fb64-4940-aaee-4b406eebdb5f nodeName:}" failed. No retries permitted until 2026-07-23 00:08:36.112824511 +0000 UTC m=+257.976993660 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-xdd6z" (UID: "c06cb800-fb64-4940-aaee-4b406eebdb5f") : secret "networking-console-plugin-cert" not found Jul 23 00:08:20.115035 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.115014 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls\") pod \"image-registry-7f8bf6cb74-5z8ms\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:20.115154 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.115111 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b89753c-5025-4f4b-9d24-440ccd30dedf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-c6nvm\" (UID: \"8b89753c-5025-4f4b-9d24-440ccd30dedf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:20.176228 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.176192 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-v2ckf\"" Jul 23 00:08:20.180563 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.180545 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8tjsp\"" Jul 23 00:08:20.183776 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.183761 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" Jul 23 00:08:20.187454 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.187435 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:20.320777 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.320549 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm"] Jul 23 00:08:20.339062 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.339017 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f8bf6cb74-5z8ms"] Jul 23 00:08:20.341883 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:08:20.341856 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40c97da_e8c6_4670_b1db_248a8aefd49b.slice/crio-7db229e703898b9cc529e031a9af368d1973eef3f952c93a2b1f035b7976ccc9 WatchSource:0}: Error finding container 7db229e703898b9cc529e031a9af368d1973eef3f952c93a2b1f035b7976ccc9: Status 404 returned error can't find the container with id 7db229e703898b9cc529e031a9af368d1973eef3f952c93a2b1f035b7976ccc9 Jul 23 00:08:20.500022 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.499982 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" event={"ID":"8b89753c-5025-4f4b-9d24-440ccd30dedf","Type":"ContainerStarted","Data":"95486042e50f9ed2436ce1fdfba4ef7b290f1ffaae122ff2bb1efb195d718658"} Jul 23 00:08:20.501491 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.501463 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" event={"ID":"a40c97da-e8c6-4670-b1db-248a8aefd49b","Type":"ContainerStarted","Data":"6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537"} Jul 23 00:08:20.501624 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.501507 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" event={"ID":"a40c97da-e8c6-4670-b1db-248a8aefd49b","Type":"ContainerStarted","Data":"7db229e703898b9cc529e031a9af368d1973eef3f952c93a2b1f035b7976ccc9"} Jul 23 00:08:20.501624 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.501604 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:20.519571 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:20.519494 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" podStartSLOduration=16.519475168 podStartE2EDuration="16.519475168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:20.518412665 +0000 UTC m=+242.382581838" watchObservedRunningTime="2026-07-23 00:08:20.519475168 +0000 UTC m=+242.383644339" Jul 23 00:08:21.056322 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:21.056284 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:21.457859 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:21.457766 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:21.509128 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:21.509092 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:22.850101 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:22.850016 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:23.256589 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:23.256554 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:23.453399 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:23.453359 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:23.513757 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:23.513662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" event={"ID":"8b89753c-5025-4f4b-9d24-440ccd30dedf","Type":"ContainerStarted","Data":"aa10b663b05a53bdfb304679dc6ff865b32afae9c0f1af15cbd8bb0dd6d6522a"} Jul 23 00:08:23.513757 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:23.513723 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" event={"ID":"8b89753c-5025-4f4b-9d24-440ccd30dedf","Type":"ContainerStarted","Data":"c0479c575bce03894c81651fa57ef73de86af57f9cd78f96d111e4c4323b403a"} Jul 23 00:08:23.529194 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:23.529148 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-c6nvm" podStartSLOduration=17.2996034 podStartE2EDuration="19.529128957s" totalImagesPullingTime="2.229525557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:23.52892539 +0000 UTC m=+245.393094561" watchObservedRunningTime="2026-07-23 00:08:23.529128957 +0000 UTC m=+245.393298128" Jul 23 00:08:23.655052 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:23.655013 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:23.855251 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:23.855160 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:24.047320 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:24.047280 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:24.047506 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:24.047329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:24.047506 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:24.047465 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 00:08:24.047605 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:24.047523 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls podName:147d2b45-869c-49c8-b5ac-9fe05a1430bc nodeName:}" failed. No retries permitted until 2026-07-23 00:08:40.047507252 +0000 UTC m=+261.911676401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqz4g" (UID: "147d2b45-869c-49c8-b5ac-9fe05a1430bc") : secret "insights-runtime-extractor-tls" not found Jul 23 00:08:24.047873 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:24.047853 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/147d2b45-869c-49c8-b5ac-9fe05a1430bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:24.058935 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:24.058900 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:25.067437 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:25.067369 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:25.257330 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:25.257292 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:25.462182 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:25.462093 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:25.649725 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:25.649679 2574 scope.go:117] "RemoveContainer" containerID="c04ecfb862a2283100fd5ce272338d49b7266389d7e157ff61ad392135edf2ba" Jul 23 00:08:25.659606 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:25.659574 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:26.523938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:26.523904 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:08:26.524318 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:26.524283 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/1.log" Jul 23 00:08:26.524364 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:26.524318 2574 generic.go:356] "Generic (PLEG): container finished" podID="07ef6baf-4493-4807-9ae5-bd20280a7d9c" containerID="c402b89beaa4b509c90e3fa1ce8f170424bed43b08f444ba37fb2e999c147fd9" exitCode=255 Jul 23 00:08:26.524450 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:26.524419 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" event={"ID":"07ef6baf-4493-4807-9ae5-bd20280a7d9c","Type":"ContainerDied","Data":"c402b89beaa4b509c90e3fa1ce8f170424bed43b08f444ba37fb2e999c147fd9"} Jul 23 00:08:26.524525 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:26.524513 2574 scope.go:117] "RemoveContainer" containerID="c04ecfb862a2283100fd5ce272338d49b7266389d7e157ff61ad392135edf2ba" Jul 23 00:08:26.524869 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:26.524852 2574 scope.go:117] "RemoveContainer" containerID="c402b89beaa4b509c90e3fa1ce8f170424bed43b08f444ba37fb2e999c147fd9" Jul 23 00:08:26.525066 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:26.525042 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-k8lw8_openshift-console-operator(07ef6baf-4493-4807-9ae5-bd20280a7d9c)\"" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" podUID="07ef6baf-4493-4807-9ae5-bd20280a7d9c" Jul 23 00:08:27.528823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:27.528795 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:08:29.387858 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:29.387797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:08:29.390116 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:29.390089 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e89dbcf-8594-467f-8966-38e817ccc785-metrics-certs\") pod \"network-metrics-daemon-dfb42\" (UID: \"0e89dbcf-8594-467f-8966-38e817ccc785\") " pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:08:29.552543 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:29.552495 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-djfbd\"" Jul 23 00:08:29.560481 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:29.560454 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfb42" Jul 23 00:08:29.686746 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:29.686713 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dfb42"] Jul 23 00:08:29.689680 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:08:29.689656 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e89dbcf_8594_467f_8966_38e817ccc785.slice/crio-e84b02b68eae9c98696380b881f2a549884f8dab899bdbd4fe06af3ab12ac47c WatchSource:0}: Error finding container e84b02b68eae9c98696380b881f2a549884f8dab899bdbd4fe06af3ab12ac47c: Status 404 returned error can't find the container with id e84b02b68eae9c98696380b881f2a549884f8dab899bdbd4fe06af3ab12ac47c Jul 23 00:08:30.431189 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:30.431149 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:30.531697 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:30.531657 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:30.539493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:30.539453 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dfb42" event={"ID":"0e89dbcf-8594-467f-8966-38e817ccc785","Type":"ContainerStarted","Data":"e84b02b68eae9c98696380b881f2a549884f8dab899bdbd4fe06af3ab12ac47c"} Jul 23 00:08:31.544737 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:31.544699 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dfb42" event={"ID":"0e89dbcf-8594-467f-8966-38e817ccc785","Type":"ContainerStarted","Data":"1a5d2055be1237ba365c3eaaceb7a23c7ab50baf2875e86b4c9c89cb362eda53"} Jul 23 00:08:31.545114 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:31.544751 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dfb42" event={"ID":"0e89dbcf-8594-467f-8966-38e817ccc785","Type":"ContainerStarted","Data":"42f29dd4c08301cd4c821564ba93cc4e0e785eeab45c10c2736eeb1e1b7c9e01"} Jul 23 00:08:31.563091 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:31.563038 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dfb42" podStartSLOduration=251.590972691 podStartE2EDuration="4m12.563023075s" totalImagesPullingTime="972.050384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:31.562574812 +0000 UTC m=+253.426743995" watchObservedRunningTime="2026-07-23 00:08:31.563023075 +0000 UTC m=+253.427192245" Jul 23 00:08:33.167044 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:33.167006 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f8bf6cb74-5z8ms"] Jul 23 00:08:33.221202 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:33.221163 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:33.314004 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:33.313963 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:34.477444 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:34.477401 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:34.477825 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:34.477487 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:34.477825 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:34.477797 2574 scope.go:117] "RemoveContainer" containerID="c402b89beaa4b509c90e3fa1ce8f170424bed43b08f444ba37fb2e999c147fd9" Jul 23 00:08:34.477957 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:34.477935 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-k8lw8_openshift-console-operator(07ef6baf-4493-4807-9ae5-bd20280a7d9c)\"" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" podUID="07ef6baf-4493-4807-9ae5-bd20280a7d9c" Jul 23 00:08:36.147867 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:36.147820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xdd6z\" (UID: \"c06cb800-fb64-4940-aaee-4b406eebdb5f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:36.150236 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:36.150203 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c06cb800-fb64-4940-aaee-4b406eebdb5f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xdd6z\" (UID: \"c06cb800-fb64-4940-aaee-4b406eebdb5f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:36.367712 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:36.367679 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rjvfl\"" Jul 23 00:08:36.375628 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:36.375601 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" Jul 23 00:08:36.504783 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:36.504739 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z"] Jul 23 00:08:36.507401 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:08:36.507354 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06cb800_fb64_4940_aaee_4b406eebdb5f.slice/crio-776f7e567f9321bb92a9e0186b86c3a9890475a33dcba1ab4c455632f47da733 WatchSource:0}: Error finding container 776f7e567f9321bb92a9e0186b86c3a9890475a33dcba1ab4c455632f47da733: Status 404 returned error can't find the container with id 776f7e567f9321bb92a9e0186b86c3a9890475a33dcba1ab4c455632f47da733 Jul 23 00:08:36.560935 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:36.560895 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" event={"ID":"c06cb800-fb64-4940-aaee-4b406eebdb5f","Type":"ContainerStarted","Data":"776f7e567f9321bb92a9e0186b86c3a9890475a33dcba1ab4c455632f47da733"} Jul 23 00:08:38.569041 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:38.569010 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" event={"ID":"c06cb800-fb64-4940-aaee-4b406eebdb5f","Type":"ContainerStarted","Data":"b7f72c4223828b82d80877f9c0b6e3ac76764f00cce6169e7d796b39b09bbb67"} Jul 23 00:08:38.586401 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:38.586321 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xdd6z" podStartSLOduration=33.496538755 podStartE2EDuration="34.586302301s" totalImagesPullingTime="1.089763546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:38.585121682 +0000 UTC m=+260.449290854" watchObservedRunningTime="2026-07-23 00:08:38.586302301 +0000 UTC m=+260.450471473" Jul 23 00:08:38.673571 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:38.673535 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:38.774534 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:38.774499 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:38.879690 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:38.879589 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:38.980842 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:38.980809 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:39.046697 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:39.046662 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:39.240836 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:39.240794 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:40.075857 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:40.075757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:40.078024 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:40.078000 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/147d2b45-869c-49c8-b5ac-9fe05a1430bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqz4g\" (UID: \"147d2b45-869c-49c8-b5ac-9fe05a1430bc\") " pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:40.305139 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:40.305107 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7jhfv\"" Jul 23 00:08:40.313189 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:40.313161 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mqz4g" Jul 23 00:08:40.459107 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:40.459065 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mqz4g"] Jul 23 00:08:40.462834 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:08:40.462807 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147d2b45_869c_49c8_b5ac_9fe05a1430bc.slice/crio-37db20d8b9f788bf8f65c9ff293636c354fdb30ee76b29d1c799fa733c0a4c2b WatchSource:0}: Error finding container 37db20d8b9f788bf8f65c9ff293636c354fdb30ee76b29d1c799fa733c0a4c2b: Status 404 returned error can't find the container with id 37db20d8b9f788bf8f65c9ff293636c354fdb30ee76b29d1c799fa733c0a4c2b Jul 23 00:08:40.576311 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:40.576274 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqz4g" event={"ID":"147d2b45-869c-49c8-b5ac-9fe05a1430bc","Type":"ContainerStarted","Data":"37db20d8b9f788bf8f65c9ff293636c354fdb30ee76b29d1c799fa733c0a4c2b"} Jul 23 00:08:42.062151 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:42.062103 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:42.121070 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:42.121019 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:42.411522 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:42.411444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:43.173220 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:43.173171 2574 patch_prober.go:28] interesting pod/image-registry-7f8bf6cb74-5z8ms container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 00:08:43.173646 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:43.173233 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" podUID="a40c97da-e8c6-4670-b1db-248a8aefd49b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 00:08:45.596225 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:45.596195 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqz4g" event={"ID":"147d2b45-869c-49c8-b5ac-9fe05a1430bc","Type":"ContainerStarted","Data":"b186d9cf148615ec25ef1ba2e3682045256fb95cc4837be4207ebb8d1c6bbc8c"} Jul 23 00:08:48.650917 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:48.650880 2574 scope.go:117] "RemoveContainer" containerID="c402b89beaa4b509c90e3fa1ce8f170424bed43b08f444ba37fb2e999c147fd9" Jul 23 00:08:49.060655 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.060623 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:49.614212 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.614175 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqz4g" event={"ID":"147d2b45-869c-49c8-b5ac-9fe05a1430bc","Type":"ContainerStarted","Data":"f202c8ffea63b36c3879cc399f2117043e30d8e1052a83ab95487780e1722434"} Jul 23 00:08:49.616119 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.616092 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:08:49.616261 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.616196 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" event={"ID":"07ef6baf-4493-4807-9ae5-bd20280a7d9c","Type":"ContainerStarted","Data":"f0676a809b869194975a201b36fe1f8a1b7d6425c8679e387f056aae45400877"} Jul 23 00:08:49.616557 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.616535 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:49.632601 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.632541 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" podStartSLOduration=42.722438006 podStartE2EDuration="45.632519574s" totalImagesPullingTime="2.910081568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:49.630983007 +0000 UTC m=+271.495152179" watchObservedRunningTime="2026-07-23 00:08:49.632519574 +0000 UTC m=+271.496688748" Jul 23 00:08:49.759228 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.759192 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-k8lw8" Jul 23 00:08:49.931726 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.931607 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-wnx4v"] Jul 23 00:08:49.934877 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.934849 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-wnx4v" Jul 23 00:08:49.937618 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.937591 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gp6nx\"" Jul 23 00:08:49.937773 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.937592 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 00:08:49.937773 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.937626 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 00:08:49.944862 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.944795 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-wnx4v"] Jul 23 00:08:49.948917 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:49.948875 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:50.047906 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:50.047868 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:50.062878 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:50.062843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mknb8\" (UniqueName: \"kubernetes.io/projected/257b995d-6486-42d5-bbda-21f9be1bf292-kube-api-access-mknb8\") pod \"downloads-5bc67dcd46-wnx4v\" (UID: \"257b995d-6486-42d5-bbda-21f9be1bf292\") " pod="openshift-console/downloads-5bc67dcd46-wnx4v" Jul 23 00:08:50.105874 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:50.105814 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:50.164010 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:50.163964 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mknb8\" (UniqueName: \"kubernetes.io/projected/257b995d-6486-42d5-bbda-21f9be1bf292-kube-api-access-mknb8\") pod \"downloads-5bc67dcd46-wnx4v\" (UID: \"257b995d-6486-42d5-bbda-21f9be1bf292\") " pod="openshift-console/downloads-5bc67dcd46-wnx4v" Jul 23 00:08:50.172294 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:50.172261 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mknb8\" (UniqueName: \"kubernetes.io/projected/257b995d-6486-42d5-bbda-21f9be1bf292-kube-api-access-mknb8\") pod \"downloads-5bc67dcd46-wnx4v\" (UID: \"257b995d-6486-42d5-bbda-21f9be1bf292\") " pod="openshift-console/downloads-5bc67dcd46-wnx4v" Jul 23 00:08:50.236315 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:50.236277 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:50.246853 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:50.246825 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-wnx4v" Jul 23 00:08:50.392744 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:50.392654 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-wnx4v"] Jul 23 00:08:50.395722 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:08:50.395682 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257b995d_6486_42d5_bbda_21f9be1bf292.slice/crio-af28e18b2095ad178e7cc6742af39444dd0b0d77606f6b099209b0a443bfd700 WatchSource:0}: Error finding container af28e18b2095ad178e7cc6742af39444dd0b0d77606f6b099209b0a443bfd700: Status 404 returned error can't find the container with id af28e18b2095ad178e7cc6742af39444dd0b0d77606f6b099209b0a443bfd700 Jul 23 00:08:50.613035 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:50.612926 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:50.621396 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:50.621352 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-wnx4v" event={"ID":"257b995d-6486-42d5-bbda-21f9be1bf292","Type":"ContainerStarted","Data":"af28e18b2095ad178e7cc6742af39444dd0b0d77606f6b099209b0a443bfd700"} Jul 23 00:08:50.713610 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:50.713551 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:51.049986 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.049952 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:51.101751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.101698 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:51.213026 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.212987 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:51.414581 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.414493 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:51.456000 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.455961 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-8xfv5"] Jul 23 00:08:51.470798 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.470768 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l5tbp"] Jul 23 00:08:51.470967 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.470892 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.478358 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.477556 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 00:08:51.478358 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.477611 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 23 00:08:51.478603 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.478446 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 23 00:08:51.479530 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.479500 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4swbh\"" Jul 23 00:08:51.480797 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.480771 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 00:08:51.480896 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.480778 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 00:08:51.481202 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.481180 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 23 00:08:51.483034 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.483012 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-8xfv5"] Jul 23 00:08:51.483168 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.483146 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.486076 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.485836 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 00:08:51.486076 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.485883 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fmrvj\"" Jul 23 00:08:51.486313 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.486277 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 00:08:51.486461 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.486443 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 00:08:51.523498 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.523463 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:51.579051 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579019 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/669bec30-17d5-407d-9fed-0a7fb74b78bd-sys\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.579241 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579059 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-wtmp\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.579241 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x89fg\" (UniqueName: \"kubernetes.io/projected/669bec30-17d5-407d-9fed-0a7fb74b78bd-kube-api-access-x89fg\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.579241 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579199 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/669bec30-17d5-407d-9fed-0a7fb74b78bd-root\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.579241 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579225 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-textfile\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.579439 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkhfj\" (UniqueName: \"kubernetes.io/projected/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-api-access-nkhfj\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.579439 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.579439 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.579439 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579357 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.579439 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579424 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.579684 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579477 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-tls\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.579684 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579511 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1dda765f-eee6-4cb8-bac5-21fc9897f185-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.579684 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579552 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.579684 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/669bec30-17d5-407d-9fed-0a7fb74b78bd-metrics-client-ca\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.579684 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.579609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dda765f-eee6-4cb8-bac5-21fc9897f185-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.624045 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.624003 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:51.680632 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.680543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.680632 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.680597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.680860 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.680633 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.680860 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.680753 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-tls\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.680860 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.680801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1dda765f-eee6-4cb8-bac5-21fc9897f185-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.680860 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.680841 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.681063 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.680870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/669bec30-17d5-407d-9fed-0a7fb74b78bd-metrics-client-ca\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.681063 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.680899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dda765f-eee6-4cb8-bac5-21fc9897f185-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.681063 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:51.680933 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 23 00:08:51.681063 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.680944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/669bec30-17d5-407d-9fed-0a7fb74b78bd-sys\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.681063 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.680969 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-wtmp\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.681063 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:51.681012 2574 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 23 00:08:51.681063 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:51.681014 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-tls podName:669bec30-17d5-407d-9fed-0a7fb74b78bd nodeName:}" failed. No retries permitted until 2026-07-23 00:08:52.180991984 +0000 UTC m=+274.045161155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-tls") pod "node-exporter-l5tbp" (UID: "669bec30-17d5-407d-9fed-0a7fb74b78bd") : secret "node-exporter-tls" not found Jul 23 00:08:51.681432 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:51.681103 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-state-metrics-tls podName:1dda765f-eee6-4cb8-bac5-21fc9897f185 nodeName:}" failed. No retries permitted until 2026-07-23 00:08:52.181081696 +0000 UTC m=+274.045250861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-8xfv5" (UID: "1dda765f-eee6-4cb8-bac5-21fc9897f185") : secret "kube-state-metrics-tls" not found Jul 23 00:08:51.681432 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681110 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-wtmp\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.681432 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x89fg\" (UniqueName: \"kubernetes.io/projected/669bec30-17d5-407d-9fed-0a7fb74b78bd-kube-api-access-x89fg\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.681432 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681165 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/669bec30-17d5-407d-9fed-0a7fb74b78bd-sys\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.681432 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681185 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/669bec30-17d5-407d-9fed-0a7fb74b78bd-root\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.681432 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-textfile\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.681432 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681214 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1dda765f-eee6-4cb8-bac5-21fc9897f185-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.681432 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681238 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkhfj\" (UniqueName: \"kubernetes.io/projected/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-api-access-nkhfj\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.681432 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681269 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.681864 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681526 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.681864 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681588 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/669bec30-17d5-407d-9fed-0a7fb74b78bd-root\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.681864 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681785 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dda765f-eee6-4cb8-bac5-21fc9897f185-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.681864 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681835 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-textfile\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.682044 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.681872 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/669bec30-17d5-407d-9fed-0a7fb74b78bd-metrics-client-ca\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.682095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.682039 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.683785 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.683762 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.684255 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.684235 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.689245 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.689216 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkhfj\" (UniqueName: \"kubernetes.io/projected/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-api-access-nkhfj\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:51.689415 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.689368 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x89fg\" (UniqueName: \"kubernetes.io/projected/669bec30-17d5-407d-9fed-0a7fb74b78bd-kube-api-access-x89fg\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:51.724965 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.724919 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:51.824327 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.824292 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:51.925314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:51.925272 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:52.025346 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.025305 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:52.126423 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.126369 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:52.185367 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.185328 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-tls\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:52.185542 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.185377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:52.185542 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:52.185493 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 23 00:08:52.185660 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:52.185578 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-tls podName:669bec30-17d5-407d-9fed-0a7fb74b78bd nodeName:}" failed. No retries permitted until 2026-07-23 00:08:53.185558223 +0000 UTC m=+275.049727398 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-tls") pod "node-exporter-l5tbp" (UID: "669bec30-17d5-407d-9fed-0a7fb74b78bd") : secret "node-exporter-tls" not found Jul 23 00:08:52.188101 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.188028 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dda765f-eee6-4cb8-bac5-21fc9897f185-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8xfv5\" (UID: \"1dda765f-eee6-4cb8-bac5-21fc9897f185\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:52.257048 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.257012 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:52.389997 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.389926 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" Jul 23 00:08:52.408552 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.408507 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:52.499038 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.499005 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:52.551479 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.551453 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-8xfv5"] Jul 23 00:08:52.554346 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:08:52.554314 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dda765f_eee6_4cb8_bac5_21fc9897f185.slice/crio-d9fb6b0864183ea78033651ce6d266c785743b8d59fff727d501788e35c0f0c5 WatchSource:0}: Error finding container d9fb6b0864183ea78033651ce6d266c785743b8d59fff727d501788e35c0f0c5: Status 404 returned error can't find the container with id d9fb6b0864183ea78033651ce6d266c785743b8d59fff727d501788e35c0f0c5 Jul 23 00:08:52.632740 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.632702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqz4g" event={"ID":"147d2b45-869c-49c8-b5ac-9fe05a1430bc","Type":"ContainerStarted","Data":"4549fe35b7fb5a0c7d83ef3332f842b218e2315e6f387c176b5b01fe5b776f55"} Jul 23 00:08:52.634129 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.634100 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" event={"ID":"1dda765f-eee6-4cb8-bac5-21fc9897f185","Type":"ContainerStarted","Data":"d9fb6b0864183ea78033651ce6d266c785743b8d59fff727d501788e35c0f0c5"} Jul 23 00:08:52.649705 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.649610 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mqz4g" podStartSLOduration=32.797696179 podStartE2EDuration="44.649594628s" totalImagesPullingTime="11.851898449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:08:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:52.648487894 +0000 UTC m=+274.512657069" watchObservedRunningTime="2026-07-23 00:08:52.649594628 +0000 UTC m=+274.513763798" Jul 23 00:08:52.760992 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:52.760954 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:53.171995 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:53.171960 2574 patch_prober.go:28] interesting pod/image-registry-7f8bf6cb74-5z8ms container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 00:08:53.172399 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:53.172011 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" podUID="a40c97da-e8c6-4670-b1db-248a8aefd49b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 00:08:53.194066 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:53.194028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-tls\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:53.196396 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:53.196357 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/669bec30-17d5-407d-9fed-0a7fb74b78bd-node-exporter-tls\") pod \"node-exporter-l5tbp\" (UID: \"669bec30-17d5-407d-9fed-0a7fb74b78bd\") " pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:53.243232 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:53.243197 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:53.297799 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:53.297761 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l5tbp" Jul 23 00:08:53.311852 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:08:53.311817 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669bec30_17d5_407d_9fed_0a7fb74b78bd.slice/crio-c321972c14b1bcafb3d221ff4b4f80cd592c9b6c5caf62c27d44b832ef2853e5 WatchSource:0}: Error finding container c321972c14b1bcafb3d221ff4b4f80cd592c9b6c5caf62c27d44b832ef2853e5: Status 404 returned error can't find the container with id c321972c14b1bcafb3d221ff4b4f80cd592c9b6c5caf62c27d44b832ef2853e5 Jul 23 00:08:53.342812 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:53.342771 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:53.640690 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:53.640654 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5tbp" event={"ID":"669bec30-17d5-407d-9fed-0a7fb74b78bd","Type":"ContainerStarted","Data":"c321972c14b1bcafb3d221ff4b4f80cd592c9b6c5caf62c27d44b832ef2853e5"} Jul 23 00:08:54.381829 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:54.381794 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:54.475479 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:54.475444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:54.586731 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:54.586633 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:54.653843 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:54.653729 2574 generic.go:356] "Generic (PLEG): container finished" podID="669bec30-17d5-407d-9fed-0a7fb74b78bd" containerID="2eab900477e07b81535cf3b0a9fc63683ea82e787e998dde98c913543751a859" exitCode=0 Jul 23 00:08:54.655143 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:54.654759 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" event={"ID":"1dda765f-eee6-4cb8-bac5-21fc9897f185","Type":"ContainerStarted","Data":"6073815d27727d7b0d708858e52a5c397457ce50f07852f4cf72b40e1d8378bb"} Jul 23 00:08:54.655143 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:54.654818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" event={"ID":"1dda765f-eee6-4cb8-bac5-21fc9897f185","Type":"ContainerStarted","Data":"ba00a81445f1f8e7cd854721653869e2e6f76f1559151956528bd49a0806d373"} Jul 23 00:08:54.655143 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:54.654845 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" event={"ID":"1dda765f-eee6-4cb8-bac5-21fc9897f185","Type":"ContainerStarted","Data":"ae1bf7c32fa82c679be3bd1f7d8c6a70ac4a4921eb3927309eedf364deed09a2"} Jul 23 00:08:54.655143 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:54.654869 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5tbp" event={"ID":"669bec30-17d5-407d-9fed-0a7fb74b78bd","Type":"ContainerDied","Data":"2eab900477e07b81535cf3b0a9fc63683ea82e787e998dde98c913543751a859"} Jul 23 00:08:54.670286 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:54.670238 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-8xfv5" podStartSLOduration=1.813586634 podStartE2EDuration="3.6702228s" totalImagesPullingTime="1.856636166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:54.669260348 +0000 UTC m=+276.533429554" watchObservedRunningTime="2026-07-23 00:08:54.6702228 +0000 UTC m=+276.534391949" Jul 23 00:08:54.735302 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:54.735239 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:55.660194 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:55.660118 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5tbp" event={"ID":"669bec30-17d5-407d-9fed-0a7fb74b78bd","Type":"ContainerStarted","Data":"6400874b954169df62973881f7302d934cccdb5ada9bb6610e0cde14625fef75"} Jul 23 00:08:55.660883 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:55.660204 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5tbp" event={"ID":"669bec30-17d5-407d-9fed-0a7fb74b78bd","Type":"ContainerStarted","Data":"d87ca55684c2e2183397057de018773218f07d888cc02e46f650075a79a7a17f"} Jul 23 00:08:55.680438 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:55.680364 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l5tbp" podStartSLOduration=3.470836646 podStartE2EDuration="4.680339749s" totalImagesPullingTime="1.100090344s" totalInitContainerRuntime="109.412759ms" isStatefulPod=true podCreationTimestamp="2026-07-23 00:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:55.678824444 +0000 UTC m=+277.542993617" watchObservedRunningTime="2026-07-23 00:08:55.680339749 +0000 UTC m=+277.544508922" Jul 23 00:08:56.218210 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:56.218171 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:56.272364 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:56.272327 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:56.525520 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:56.525466 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:57.626676 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.626615 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:08:57.633673 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.633636 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 00:08:57.637103 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.637078 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.640245 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.639924 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 00:08:57.640245 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.639998 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 00:08:57.640245 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.640132 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 00:08:57.640245 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.640192 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 00:08:57.641281 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.640614 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 00:08:57.641281 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.640652 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ctpljlbnsodv\"" Jul 23 00:08:57.641281 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.640740 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hq2dr\"" Jul 23 00:08:57.641281 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.640887 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 00:08:57.641281 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.640909 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 00:08:57.641281 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.640965 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 00:08:57.641281 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.641143 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 00:08:57.641281 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.641203 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 00:08:57.641740 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.641434 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 00:08:57.641740 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.641464 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 00:08:57.641740 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.641719 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 00:08:57.642616 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.641942 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 00:08:57.643061 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.643041 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 00:08:57.658326 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.658288 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 00:08:57.736962 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.736923 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.736962 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.736963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.736985 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737012 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737034 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737057 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737088 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf5z8\" (UniqueName: \"kubernetes.io/projected/7d088b26-86b6-44e4-9647-3c3cadb14f1a-kube-api-access-kf5z8\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737160 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d088b26-86b6-44e4-9647-3c3cadb14f1a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737611 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737271 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737611 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737321 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737611 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-web-config\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737611 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d088b26-86b6-44e4-9647-3c3cadb14f1a-config-out\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737611 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737611 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737611 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737544 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737611 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737612 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737933 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737643 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-config\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.737933 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.737668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839179 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839126 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839434 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839194 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-config\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839434 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839221 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839434 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839272 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839434 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839434 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839326 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839434 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839434 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839434 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839424 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839708 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839470 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf5z8\" (UniqueName: \"kubernetes.io/projected/7d088b26-86b6-44e4-9647-3c3cadb14f1a-kube-api-access-kf5z8\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839708 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839708 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d088b26-86b6-44e4-9647-3c3cadb14f1a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839708 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839561 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839708 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839708 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839708 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-web-config\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.839708 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839685 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d088b26-86b6-44e4-9647-3c3cadb14f1a-config-out\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.840039 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839723 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.840039 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.840039 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839794 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.840039 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.839967 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.840833 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.840505 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.840963 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.840946 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.843043 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.841271 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.843043 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.841603 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.843043 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.842089 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.843043 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.842470 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.843329 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.843216 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-config\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.843643 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.843491 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.843869 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.843844 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d088b26-86b6-44e4-9647-3c3cadb14f1a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.844802 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.844477 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.845071 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.845014 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d088b26-86b6-44e4-9647-3c3cadb14f1a-config-out\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.845362 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.845321 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.845661 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.845638 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.847278 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.847231 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-web-config\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.848078 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.847869 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.848078 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.847903 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.848078 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.848003 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.848078 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.848046 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.851704 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.851680 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf5z8\" (UniqueName: \"kubernetes.io/projected/7d088b26-86b6-44e4-9647-3c3cadb14f1a-kube-api-access-kf5z8\") pod \"prometheus-k8s-0\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:57.950190 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:57.950105 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:08:58.116641 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.116614 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 00:08:58.118962 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:08:58.118934 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d088b26_86b6_44e4_9647_3c3cadb14f1a.slice/crio-09ce2e841d7bb6b2aab5c47146cf2d7c444c463e5c019a6c7d40976fb2a8cbb4 WatchSource:0}: Error finding container 09ce2e841d7bb6b2aab5c47146cf2d7c444c463e5c019a6c7d40976fb2a8cbb4: Status 404 returned error can't find the container with id 09ce2e841d7bb6b2aab5c47146cf2d7c444c463e5c019a6c7d40976fb2a8cbb4 Jul 23 00:08:58.188435 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.188342 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" podUID="a40c97da-e8c6-4670-b1db-248a8aefd49b" containerName="registry" containerID="cri-o://6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537" gracePeriod=30 Jul 23 00:08:58.248436 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:58.248366 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-25447" podUID="bad05bc4-e611-4e6f-84bc-d41cbe4b09fa" Jul 23 00:08:58.427313 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.427287 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:58.545876 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.545844 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls\") pod \"a40c97da-e8c6-4670-b1db-248a8aefd49b\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " Jul 23 00:08:58.546056 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.545892 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a40c97da-e8c6-4670-b1db-248a8aefd49b-installation-pull-secrets\") pod \"a40c97da-e8c6-4670-b1db-248a8aefd49b\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " Jul 23 00:08:58.546056 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.545932 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a40c97da-e8c6-4670-b1db-248a8aefd49b-trusted-ca\") pod \"a40c97da-e8c6-4670-b1db-248a8aefd49b\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " Jul 23 00:08:58.546056 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.545957 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flk9d\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-kube-api-access-flk9d\") pod \"a40c97da-e8c6-4670-b1db-248a8aefd49b\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " Jul 23 00:08:58.546056 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.545981 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a40c97da-e8c6-4670-b1db-248a8aefd49b-image-registry-private-configuration\") pod \"a40c97da-e8c6-4670-b1db-248a8aefd49b\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " Jul 23 00:08:58.546056 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.546009 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-bound-sa-token\") pod \"a40c97da-e8c6-4670-b1db-248a8aefd49b\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " Jul 23 00:08:58.546315 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.546058 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-certificates\") pod \"a40c97da-e8c6-4670-b1db-248a8aefd49b\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " Jul 23 00:08:58.546315 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.546142 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a40c97da-e8c6-4670-b1db-248a8aefd49b-ca-trust-extracted\") pod \"a40c97da-e8c6-4670-b1db-248a8aefd49b\" (UID: \"a40c97da-e8c6-4670-b1db-248a8aefd49b\") " Jul 23 00:08:58.546640 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.546473 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40c97da-e8c6-4670-b1db-248a8aefd49b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a40c97da-e8c6-4670-b1db-248a8aefd49b" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 00:08:58.546872 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.546805 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a40c97da-e8c6-4670-b1db-248a8aefd49b" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 00:08:58.548912 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.548885 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a40c97da-e8c6-4670-b1db-248a8aefd49b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a40c97da-e8c6-4670-b1db-248a8aefd49b" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:08:58.548912 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.548905 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a40c97da-e8c6-4670-b1db-248a8aefd49b" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 00:08:58.549090 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.549074 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-kube-api-access-flk9d" (OuterVolumeSpecName: "kube-api-access-flk9d") pod "a40c97da-e8c6-4670-b1db-248a8aefd49b" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b"). InnerVolumeSpecName "kube-api-access-flk9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 00:08:58.549249 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.549210 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a40c97da-e8c6-4670-b1db-248a8aefd49b" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 00:08:58.549341 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.549248 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a40c97da-e8c6-4670-b1db-248a8aefd49b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a40c97da-e8c6-4670-b1db-248a8aefd49b" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:08:58.556347 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.556315 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a40c97da-e8c6-4670-b1db-248a8aefd49b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a40c97da-e8c6-4670-b1db-248a8aefd49b" (UID: "a40c97da-e8c6-4670-b1db-248a8aefd49b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:08:58.647539 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.647503 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a40c97da-e8c6-4670-b1db-248a8aefd49b-ca-trust-extracted\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:08:58.647539 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.647535 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:08:58.648077 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.647550 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a40c97da-e8c6-4670-b1db-248a8aefd49b-installation-pull-secrets\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:08:58.648077 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.647563 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a40c97da-e8c6-4670-b1db-248a8aefd49b-trusted-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:08:58.648077 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.647577 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flk9d\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-kube-api-access-flk9d\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:08:58.648077 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.647591 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a40c97da-e8c6-4670-b1db-248a8aefd49b-image-registry-private-configuration\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:08:58.648077 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.647605 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a40c97da-e8c6-4670-b1db-248a8aefd49b-bound-sa-token\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:08:58.648077 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.647617 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a40c97da-e8c6-4670-b1db-248a8aefd49b-registry-certificates\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:08:58.674778 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.674741 2574 generic.go:356] "Generic (PLEG): container finished" podID="a40c97da-e8c6-4670-b1db-248a8aefd49b" containerID="6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537" exitCode=0 Jul 23 00:08:58.674927 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.674820 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" Jul 23 00:08:58.674927 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.674845 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" event={"ID":"a40c97da-e8c6-4670-b1db-248a8aefd49b","Type":"ContainerDied","Data":"6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537"} Jul 23 00:08:58.674927 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.674892 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f8bf6cb74-5z8ms" event={"ID":"a40c97da-e8c6-4670-b1db-248a8aefd49b","Type":"ContainerDied","Data":"7db229e703898b9cc529e031a9af368d1973eef3f952c93a2b1f035b7976ccc9"} Jul 23 00:08:58.674927 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.674919 2574 scope.go:117] "RemoveContainer" containerID="6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537" Jul 23 00:08:58.677552 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.677301 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-25447" Jul 23 00:08:58.677552 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.677322 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerStarted","Data":"09ce2e841d7bb6b2aab5c47146cf2d7c444c463e5c019a6c7d40976fb2a8cbb4"} Jul 23 00:08:58.686416 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.686374 2574 scope.go:117] "RemoveContainer" containerID="6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537" Jul 23 00:08:58.686901 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:08:58.686843 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537\": container with ID starting with 6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537 not found: ID does not exist" containerID="6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537" Jul 23 00:08:58.686993 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.686893 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537"} err="failed to get container status \"6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537\": rpc error: code = NotFound desc = could not find container \"6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537\": container with ID starting with 6d5e8732e7ff046f2b246ce64c4e74e685d2e165d94b3ab26b790aba576d2537 not found: ID does not exist" Jul 23 00:08:58.691983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.691953 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f8bf6cb74-5z8ms"] Jul 23 00:08:58.695404 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:58.695366 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f8bf6cb74-5z8ms"] Jul 23 00:08:59.686608 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:59.686575 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerID="4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e" exitCode=0 Jul 23 00:08:59.687081 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:08:59.686623 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerDied","Data":"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e"} Jul 23 00:09:00.436224 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:00.436075 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:00.486325 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:00.486290 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:00.656278 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:00.656238 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a40c97da-e8c6-4670-b1db-248a8aefd49b" path="/var/lib/kubelet/pods/a40c97da-e8c6-4670-b1db-248a8aefd49b/volumes" Jul 23 00:09:01.376047 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:01.375968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:09:01.379695 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:01.379668 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad05bc4-e611-4e6f-84bc-d41cbe4b09fa-metrics-tls\") pod \"dns-default-25447\" (UID: \"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa\") " pod="openshift-dns/dns-default-25447" Jul 23 00:09:01.680737 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:01.680651 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6vlrt\"" Jul 23 00:09:01.688899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:01.688845 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-25447" Jul 23 00:09:01.861064 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:01.860976 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-25447"] Jul 23 00:09:01.864878 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:09:01.864842 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad05bc4_e611_4e6f_84bc_d41cbe4b09fa.slice/crio-a5aaa4bec3f67f3ed4c5d05f7edd723f87cbbb2a923c2e191bae7a2e929e4f0c WatchSource:0}: Error finding container a5aaa4bec3f67f3ed4c5d05f7edd723f87cbbb2a923c2e191bae7a2e929e4f0c: Status 404 returned error can't find the container with id a5aaa4bec3f67f3ed4c5d05f7edd723f87cbbb2a923c2e191bae7a2e929e4f0c Jul 23 00:09:02.702826 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:02.702782 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-25447" event={"ID":"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa","Type":"ContainerStarted","Data":"a5aaa4bec3f67f3ed4c5d05f7edd723f87cbbb2a923c2e191bae7a2e929e4f0c"} Jul 23 00:09:05.165114 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:05.165030 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:08.086010 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:08.085922 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:08.185778 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:08.185737 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:10.746759 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:10.746546 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerStarted","Data":"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069"} Jul 23 00:09:10.746759 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:10.746670 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerStarted","Data":"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b"} Jul 23 00:09:10.757138 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:10.754795 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-wnx4v" event={"ID":"257b995d-6486-42d5-bbda-21f9be1bf292","Type":"ContainerStarted","Data":"aaeacdb45ae2dab5fa30927172eb65b01cf23c795eddc91277172d2296bd0c58"} Jul 23 00:09:10.757900 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:10.757394 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-wnx4v" Jul 23 00:09:10.763050 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:10.762700 2574 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-wnx4v container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.17:8080/\": dial tcp 10.134.0.17:8080: connect: connection refused" start-of-body= Jul 23 00:09:10.763050 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:10.762753 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-wnx4v" podUID="257b995d-6486-42d5-bbda-21f9be1bf292" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.17:8080/\": dial tcp 10.134.0.17:8080: connect: connection refused" Jul 23 00:09:10.782834 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:10.781653 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-wnx4v" podStartSLOduration=1.6761543140000001 podStartE2EDuration="21.781631875s" totalImagesPullingTime="20.105477561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:09:10.780825911 +0000 UTC m=+292.644995084" watchObservedRunningTime="2026-07-23 00:09:10.781631875 +0000 UTC m=+292.645801049" Jul 23 00:09:11.774180 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:11.774110 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-wnx4v" Jul 23 00:09:13.778421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:13.778346 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerStarted","Data":"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756"} Jul 23 00:09:13.781105 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:13.781013 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-25447" event={"ID":"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa","Type":"ContainerStarted","Data":"c920a0d34adcabc0e7b4b467c63707f86198bbd611277d69cfdc79ec2771ce52"} Jul 23 00:09:13.781105 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:13.781068 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-25447" event={"ID":"bad05bc4-e611-4e6f-84bc-d41cbe4b09fa","Type":"ContainerStarted","Data":"a2bda414e06656777fb30458d69261a4d7c69dfc18bff03c2e51bdf73e4257d0"} Jul 23 00:09:13.781431 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:13.781349 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-25447" Jul 23 00:09:13.799065 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:13.798873 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-25447" podStartSLOduration=251.324760718 podStartE2EDuration="4m22.798851019s" totalImagesPullingTime="11.474090301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:04:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:09:13.796274455 +0000 UTC m=+295.660443649" watchObservedRunningTime="2026-07-23 00:09:13.798851019 +0000 UTC m=+295.663020192" Jul 23 00:09:14.790948 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:14.790903 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerStarted","Data":"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab"} Jul 23 00:09:14.791535 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:14.790994 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerStarted","Data":"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843"} Jul 23 00:09:14.791535 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:14.791040 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerStarted","Data":"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104"} Jul 23 00:09:14.819929 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:14.819866 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.995823175 podStartE2EDuration="17.819840571s" totalImagesPullingTime="14.797859664s" totalInitContainerRuntime="26.157732ms" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:09:14.81710401 +0000 UTC m=+296.681273181" watchObservedRunningTime="2026-07-23 00:09:14.819840571 +0000 UTC m=+296.684009742" Jul 23 00:09:15.046826 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:15.046736 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:15.097590 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:15.097552 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:16.835172 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:16.835125 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:16.903983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:16.903939 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:17.004730 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:17.004684 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:17.106180 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:17.106095 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:17.494427 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:17.494374 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:17.564954 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:17.564921 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:17.950289 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:17.950200 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:09:18.518613 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:18.518585 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:09:18.518760 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:18.518586 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:09:18.531930 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:18.531903 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 00:09:18.787265 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:18.787199 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:18.980586 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:18.815212 2574 generic.go:356] "Generic (PLEG): container finished" podID="63653b18-5d37-4197-a58a-a94062c422cf" containerID="dd5bfdcf3a8be8373cb15d0223b9b3cbfc06d80d0e5fc619941a6cc259244919" exitCode=255 Jul 23 00:09:18.980586 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:18.815262 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" event={"ID":"63653b18-5d37-4197-a58a-a94062c422cf","Type":"ContainerDied","Data":"dd5bfdcf3a8be8373cb15d0223b9b3cbfc06d80d0e5fc619941a6cc259244919"} Jul 23 00:09:18.980586 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:18.815303 2574 scope.go:117] "RemoveContainer" containerID="7d77361f21aabbb53f47c1e3a3ef3e7907ddaa50655b28997456248dda9c3f01" Jul 23 00:09:18.980586 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:18.822970 2574 scope.go:117] "RemoveContainer" containerID="dd5bfdcf3a8be8373cb15d0223b9b3cbfc06d80d0e5fc619941a6cc259244919" Jul 23 00:09:18.980586 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:09:18.823182 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx_open-cluster-management-agent-addon(63653b18-5d37-4197-a58a-a94062c422cf)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" podUID="63653b18-5d37-4197-a58a-a94062c422cf" Jul 23 00:09:18.980586 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:18.889042 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:23.728463 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:23.728422 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:23.793290 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:23.793253 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-25447" Jul 23 00:09:23.812333 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:23.812209 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:23.870222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:23.870182 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:24.064899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:24.064812 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" Jul 23 00:09:24.065243 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:24.065226 2574 scope.go:117] "RemoveContainer" containerID="dd5bfdcf3a8be8373cb15d0223b9b3cbfc06d80d0e5fc619941a6cc259244919" Jul 23 00:09:24.065462 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:09:24.065442 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx_open-cluster-management-agent-addon(63653b18-5d37-4197-a58a-a94062c422cf)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" podUID="63653b18-5d37-4197-a58a-a94062c422cf" Jul 23 00:09:25.979759 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:25.979723 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:26.034404 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:26.034331 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:27.797573 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:27.797525 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:27.897968 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:27.897927 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:30.436188 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:30.436147 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:30.605267 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:30.605223 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:35.081952 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:35.081913 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:35.137615 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:35.137575 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:35.649253 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:35.649221 2574 scope.go:117] "RemoveContainer" containerID="dd5bfdcf3a8be8373cb15d0223b9b3cbfc06d80d0e5fc619941a6cc259244919" Jul 23 00:09:35.883133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:35.883100 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5ffd4b78db-4jtnx" event={"ID":"63653b18-5d37-4197-a58a-a94062c422cf","Type":"ContainerStarted","Data":"325fab750c5d8591ac84607e696f8ca93a7d7e8a4ae1a844a76f88472fa6f70e"} Jul 23 00:09:36.818457 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:36.818417 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:38.897285 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:38.897255 2574 generic.go:356] "Generic (PLEG): container finished" podID="75d3d07d-c6cf-4c52-a390-952c62dbb689" containerID="4968b971d58a245cfd800bb1887ee24b9608445f25e3b8b724b813e30e4f099e" exitCode=0 Jul 23 00:09:38.897746 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:38.897340 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" event={"ID":"75d3d07d-c6cf-4c52-a390-952c62dbb689","Type":"ContainerDied","Data":"4968b971d58a245cfd800bb1887ee24b9608445f25e3b8b724b813e30e4f099e"} Jul 23 00:09:38.897746 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:38.897713 2574 scope.go:117] "RemoveContainer" containerID="4968b971d58a245cfd800bb1887ee24b9608445f25e3b8b724b813e30e4f099e" Jul 23 00:09:38.898717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:38.898699 2574 generic.go:356] "Generic (PLEG): container finished" podID="2217124c-eb39-46d0-b860-e13acd5d4d7c" containerID="c066a61aadc6507fe03ffa1f5f74e44ba3d8c9b6acab7c0620d7b97ec52c1ed8" exitCode=0 Jul 23 00:09:38.898808 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:38.898781 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" event={"ID":"2217124c-eb39-46d0-b860-e13acd5d4d7c","Type":"ContainerDied","Data":"c066a61aadc6507fe03ffa1f5f74e44ba3d8c9b6acab7c0620d7b97ec52c1ed8"} Jul 23 00:09:38.899066 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:38.899053 2574 scope.go:117] "RemoveContainer" containerID="c066a61aadc6507fe03ffa1f5f74e44ba3d8c9b6acab7c0620d7b97ec52c1ed8" Jul 23 00:09:39.905142 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:39.905098 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-l29fv" event={"ID":"2217124c-eb39-46d0-b860-e13acd5d4d7c","Type":"ContainerStarted","Data":"ce7754c764313d3a3565ec94ab822cb63117c9282b1611b235bf35b4fcd7f4dc"} Jul 23 00:09:39.907164 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:39.907137 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-56tkn" event={"ID":"75d3d07d-c6cf-4c52-a390-952c62dbb689","Type":"ContainerStarted","Data":"b538e82175b08f79a4dd9313bb286319919463164c1660cfdabf47c0efd2d266"} Jul 23 00:09:40.170145 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:40.170058 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:40.271503 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:40.271464 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:45.432140 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:45.432103 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:45.480186 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:45.480148 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:51.559563 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:51.559530 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:51.656958 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:51.656916 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:51.705613 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:51.705575 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:09:57.950617 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:57.950581 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:09:58.016736 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:58.016704 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:09:58.032634 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:09:58.032605 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:00.431778 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:00.431746 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:00.489644 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:00.489608 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:01.203839 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:01.203802 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:01.279132 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:01.279095 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:03.583270 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:03.583230 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:10.745323 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:10.745236 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:10.874158 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:10.874117 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:15.431306 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:15.431267 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:15.481618 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:15.481587 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:16.061924 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.061887 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 00:10:16.062204 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.062176 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="kube-rbac-proxy" containerID="cri-o://5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843" gracePeriod=600 Jul 23 00:10:16.062279 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.062251 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="thanos-sidecar" containerID="cri-o://73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756" gracePeriod=600 Jul 23 00:10:16.062338 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.062248 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab" gracePeriod=600 Jul 23 00:10:16.062338 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.062264 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="config-reloader" containerID="cri-o://43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069" gracePeriod=600 Jul 23 00:10:16.062338 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.062176 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="prometheus" containerID="cri-o://218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b" gracePeriod=600 Jul 23 00:10:16.062507 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.062243 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="kube-rbac-proxy-web" containerID="cri-o://cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104" gracePeriod=600 Jul 23 00:10:16.319350 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.319287 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:16.403447 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403407 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403633 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403455 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d088b26-86b6-44e4-9647-3c3cadb14f1a-config-out\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403633 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403483 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf5z8\" (UniqueName: \"kubernetes.io/projected/7d088b26-86b6-44e4-9647-3c3cadb14f1a-kube-api-access-kf5z8\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403633 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403515 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-metrics-client-ca\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403633 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403539 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-0\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403633 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403561 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d088b26-86b6-44e4-9647-3c3cadb14f1a-tls-assets\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403633 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403585 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-kubelet-serving-ca-bundle\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403633 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403615 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-thanos-prometheus-http-client-file\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403708 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-trusted-ca-bundle\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403743 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-web-config\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403769 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-config\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403809 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-serving-certs-ca-bundle\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403838 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-metrics-client-certs\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403872 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-2\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403915 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-kube-rbac-proxy\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.403978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403940 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-1\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.404359 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.403979 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.404359 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.404005 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-db\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.404359 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.404038 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-tls\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.404359 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.404065 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-grpc-tls\") pod \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\" (UID: \"7d088b26-86b6-44e4-9647-3c3cadb14f1a\") " Jul 23 00:10:16.404359 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.404187 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 00:10:16.404359 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.404349 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.406059 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.404932 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 00:10:16.406059 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.405069 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 00:10:16.406059 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.405292 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 00:10:16.406059 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.405461 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 00:10:16.407258 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.407081 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:10:16.407258 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.407152 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 00:10:16.407258 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.407169 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:10:16.407258 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.407218 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:10:16.407258 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.407232 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d088b26-86b6-44e4-9647-3c3cadb14f1a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 00:10:16.407258 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.407220 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 00:10:16.407684 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.407314 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d088b26-86b6-44e4-9647-3c3cadb14f1a-config-out" (OuterVolumeSpecName: "config-out") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:10:16.407684 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.407591 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d088b26-86b6-44e4-9647-3c3cadb14f1a-kube-api-access-kf5z8" (OuterVolumeSpecName: "kube-api-access-kf5z8") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "kube-api-access-kf5z8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 00:10:16.407796 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.407743 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:10:16.408223 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.408201 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:10:16.408741 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.408720 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:10:16.409124 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.409109 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:10:16.409243 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.409223 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:10:16.409308 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.409294 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-config" (OuterVolumeSpecName: "config") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:10:16.418260 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.418234 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-web-config" (OuterVolumeSpecName: "web-config") pod "7d088b26-86b6-44e4-9647-3c3cadb14f1a" (UID: "7d088b26-86b6-44e4-9647-3c3cadb14f1a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:10:16.504952 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.504905 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.504952 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.504949 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.504981 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-web-config\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.504992 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-config\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505000 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505009 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-metrics-client-certs\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505017 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505026 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-kube-rbac-proxy\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505036 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505044 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505053 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-db\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505061 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505069 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-grpc-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505077 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d088b26-86b6-44e4-9647-3c3cadb14f1a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505086 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d088b26-86b6-44e4-9647-3c3cadb14f1a-config-out\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505094 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf5z8\" (UniqueName: \"kubernetes.io/projected/7d088b26-86b6-44e4-9647-3c3cadb14f1a-kube-api-access-kf5z8\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505103 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-configmap-metrics-client-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505110 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7d088b26-86b6-44e4-9647-3c3cadb14f1a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:16.505337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:16.505118 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d088b26-86b6-44e4-9647-3c3cadb14f1a-tls-assets\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:10:17.051934 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.051900 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerID="84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab" exitCode=0 Jul 23 00:10:17.051934 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.051930 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerID="5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843" exitCode=0 Jul 23 00:10:17.051934 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.051940 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerID="cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104" exitCode=0 Jul 23 00:10:17.052165 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.051950 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerID="73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756" exitCode=0 Jul 23 00:10:17.052165 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.051960 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerID="43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069" exitCode=0 Jul 23 00:10:17.052165 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.051970 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerID="218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b" exitCode=0 Jul 23 00:10:17.052165 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.051991 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerDied","Data":"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab"} Jul 23 00:10:17.052165 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.052060 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerDied","Data":"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843"} Jul 23 00:10:17.052165 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.052006 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.052165 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.052088 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerDied","Data":"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104"} Jul 23 00:10:17.052165 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.052114 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerDied","Data":"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756"} Jul 23 00:10:17.052165 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.052139 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerDied","Data":"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069"} Jul 23 00:10:17.052165 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.052157 2574 scope.go:117] "RemoveContainer" containerID="84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab" Jul 23 00:10:17.052521 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.052163 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerDied","Data":"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b"} Jul 23 00:10:17.052521 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.052266 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d088b26-86b6-44e4-9647-3c3cadb14f1a","Type":"ContainerDied","Data":"09ce2e841d7bb6b2aab5c47146cf2d7c444c463e5c019a6c7d40976fb2a8cbb4"} Jul 23 00:10:17.061424 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.061376 2574 scope.go:117] "RemoveContainer" containerID="5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843" Jul 23 00:10:17.069117 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.069097 2574 scope.go:117] "RemoveContainer" containerID="cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104" Jul 23 00:10:17.073733 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.073701 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 00:10:17.077169 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.077142 2574 scope.go:117] "RemoveContainer" containerID="73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756" Jul 23 00:10:17.078743 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.078718 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 00:10:17.093925 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.093903 2574 scope.go:117] "RemoveContainer" containerID="43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069" Jul 23 00:10:17.101300 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.101282 2574 scope.go:117] "RemoveContainer" containerID="218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b" Jul 23 00:10:17.106939 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.106914 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 00:10:17.107186 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107174 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="init-config-reloader" Jul 23 00:10:17.107228 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107188 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="init-config-reloader" Jul 23 00:10:17.107228 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107197 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="kube-rbac-proxy" Jul 23 00:10:17.107228 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107203 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="kube-rbac-proxy" Jul 23 00:10:17.107228 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107211 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="kube-rbac-proxy-web" Jul 23 00:10:17.107228 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107217 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="kube-rbac-proxy-web" Jul 23 00:10:17.107228 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107228 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a40c97da-e8c6-4670-b1db-248a8aefd49b" containerName="registry" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107233 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a40c97da-e8c6-4670-b1db-248a8aefd49b" containerName="registry" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107239 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="config-reloader" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107244 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="config-reloader" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107251 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="kube-rbac-proxy-thanos" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107257 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="kube-rbac-proxy-thanos" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107265 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="thanos-sidecar" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107271 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="thanos-sidecar" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107277 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="prometheus" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107282 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="prometheus" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107324 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="kube-rbac-proxy-thanos" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107333 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="prometheus" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107340 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="thanos-sidecar" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107346 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a40c97da-e8c6-4670-b1db-248a8aefd49b" containerName="registry" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107352 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="kube-rbac-proxy" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107358 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="kube-rbac-proxy-web" Jul 23 00:10:17.107421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.107363 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" containerName="config-reloader" Jul 23 00:10:17.109973 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.109957 2574 scope.go:117] "RemoveContainer" containerID="4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e" Jul 23 00:10:17.110962 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.110925 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.113357 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.113340 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 00:10:17.113481 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.113342 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 00:10:17.113566 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.113549 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 00:10:17.113640 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.113605 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 00:10:17.113640 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.113612 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 00:10:17.113761 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.113703 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 00:10:17.113992 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.113974 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 00:10:17.114274 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.114256 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 00:10:17.114368 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.114286 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 00:10:17.114368 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.114290 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hq2dr\"" Jul 23 00:10:17.114368 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.114310 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 00:10:17.114542 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.114466 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 00:10:17.114668 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.114651 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 00:10:17.114712 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.114694 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ctpljlbnsodv\"" Jul 23 00:10:17.115533 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.115513 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 00:10:17.118512 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.118152 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 00:10:17.119848 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.119819 2574 scope.go:117] "RemoveContainer" containerID="84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab" Jul 23 00:10:17.120211 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:10:17.120176 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": container with ID starting with 84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab not found: ID does not exist" containerID="84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab" Jul 23 00:10:17.120287 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.120223 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab"} err="failed to get container status \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": rpc error: code = NotFound desc = could not find container \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": container with ID starting with 84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab not found: ID does not exist" Jul 23 00:10:17.120287 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.120250 2574 scope.go:117] "RemoveContainer" containerID="5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843" Jul 23 00:10:17.120595 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:10:17.120572 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": container with ID starting with 5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843 not found: ID does not exist" containerID="5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843" Jul 23 00:10:17.120651 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.120606 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843"} err="failed to get container status \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": rpc error: code = NotFound desc = could not find container \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": container with ID starting with 5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843 not found: ID does not exist" Jul 23 00:10:17.120651 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.120631 2574 scope.go:117] "RemoveContainer" containerID="cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104" Jul 23 00:10:17.120796 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.120779 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 00:10:17.120887 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:10:17.120869 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": container with ID starting with cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104 not found: ID does not exist" containerID="cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104" Jul 23 00:10:17.120946 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.120895 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104"} err="failed to get container status \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": rpc error: code = NotFound desc = could not find container \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": container with ID starting with cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104 not found: ID does not exist" Jul 23 00:10:17.120946 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.120917 2574 scope.go:117] "RemoveContainer" containerID="73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756" Jul 23 00:10:17.121212 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:10:17.121197 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": container with ID starting with 73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756 not found: ID does not exist" containerID="73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756" Jul 23 00:10:17.121249 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.121216 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756"} err="failed to get container status \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": rpc error: code = NotFound desc = could not find container \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": container with ID starting with 73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756 not found: ID does not exist" Jul 23 00:10:17.121249 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.121230 2574 scope.go:117] "RemoveContainer" containerID="43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069" Jul 23 00:10:17.121567 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:10:17.121548 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": container with ID starting with 43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069 not found: ID does not exist" containerID="43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069" Jul 23 00:10:17.121629 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.121573 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069"} err="failed to get container status \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": rpc error: code = NotFound desc = could not find container \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": container with ID starting with 43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069 not found: ID does not exist" Jul 23 00:10:17.121629 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.121590 2574 scope.go:117] "RemoveContainer" containerID="218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b" Jul 23 00:10:17.121808 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:10:17.121793 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": container with ID starting with 218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b not found: ID does not exist" containerID="218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b" Jul 23 00:10:17.121844 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.121810 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b"} err="failed to get container status \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": rpc error: code = NotFound desc = could not find container \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": container with ID starting with 218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b not found: ID does not exist" Jul 23 00:10:17.121844 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.121821 2574 scope.go:117] "RemoveContainer" containerID="4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e" Jul 23 00:10:17.121990 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:10:17.121975 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": container with ID starting with 4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e not found: ID does not exist" containerID="4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e" Jul 23 00:10:17.122024 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.121991 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e"} err="failed to get container status \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": rpc error: code = NotFound desc = could not find container \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": container with ID starting with 4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e not found: ID does not exist" Jul 23 00:10:17.122024 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.122001 2574 scope.go:117] "RemoveContainer" containerID="84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab" Jul 23 00:10:17.122177 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.122163 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab"} err="failed to get container status \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": rpc error: code = NotFound desc = could not find container \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": container with ID starting with 84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab not found: ID does not exist" Jul 23 00:10:17.122177 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.122176 2574 scope.go:117] "RemoveContainer" containerID="5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843" Jul 23 00:10:17.122409 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.122369 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843"} err="failed to get container status \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": rpc error: code = NotFound desc = could not find container \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": container with ID starting with 5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843 not found: ID does not exist" Jul 23 00:10:17.122532 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.122411 2574 scope.go:117] "RemoveContainer" containerID="cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104" Jul 23 00:10:17.122647 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.122631 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104"} err="failed to get container status \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": rpc error: code = NotFound desc = could not find container \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": container with ID starting with cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104 not found: ID does not exist" Jul 23 00:10:17.122692 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.122646 2574 scope.go:117] "RemoveContainer" containerID="73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756" Jul 23 00:10:17.122843 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.122825 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756"} err="failed to get container status \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": rpc error: code = NotFound desc = could not find container \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": container with ID starting with 73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756 not found: ID does not exist" Jul 23 00:10:17.122886 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.122845 2574 scope.go:117] "RemoveContainer" containerID="43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069" Jul 23 00:10:17.123038 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.123024 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069"} err="failed to get container status \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": rpc error: code = NotFound desc = could not find container \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": container with ID starting with 43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069 not found: ID does not exist" Jul 23 00:10:17.123038 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.123037 2574 scope.go:117] "RemoveContainer" containerID="218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b" Jul 23 00:10:17.123217 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.123200 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b"} err="failed to get container status \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": rpc error: code = NotFound desc = could not find container \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": container with ID starting with 218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b not found: ID does not exist" Jul 23 00:10:17.123286 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.123220 2574 scope.go:117] "RemoveContainer" containerID="4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e" Jul 23 00:10:17.123421 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.123407 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e"} err="failed to get container status \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": rpc error: code = NotFound desc = could not find container \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": container with ID starting with 4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e not found: ID does not exist" Jul 23 00:10:17.123470 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.123421 2574 scope.go:117] "RemoveContainer" containerID="84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab" Jul 23 00:10:17.123594 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.123580 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab"} err="failed to get container status \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": rpc error: code = NotFound desc = could not find container \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": container with ID starting with 84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab not found: ID does not exist" Jul 23 00:10:17.123637 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.123593 2574 scope.go:117] "RemoveContainer" containerID="5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843" Jul 23 00:10:17.123760 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.123744 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843"} err="failed to get container status \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": rpc error: code = NotFound desc = could not find container \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": container with ID starting with 5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843 not found: ID does not exist" Jul 23 00:10:17.123760 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.123760 2574 scope.go:117] "RemoveContainer" containerID="cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104" Jul 23 00:10:17.123939 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.123922 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104"} err="failed to get container status \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": rpc error: code = NotFound desc = could not find container \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": container with ID starting with cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104 not found: ID does not exist" Jul 23 00:10:17.124008 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.123942 2574 scope.go:117] "RemoveContainer" containerID="73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756" Jul 23 00:10:17.124125 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.124109 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756"} err="failed to get container status \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": rpc error: code = NotFound desc = could not find container \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": container with ID starting with 73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756 not found: ID does not exist" Jul 23 00:10:17.124169 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.124126 2574 scope.go:117] "RemoveContainer" containerID="43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069" Jul 23 00:10:17.124317 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.124298 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069"} err="failed to get container status \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": rpc error: code = NotFound desc = could not find container \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": container with ID starting with 43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069 not found: ID does not exist" Jul 23 00:10:17.124360 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.124319 2574 scope.go:117] "RemoveContainer" containerID="218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b" Jul 23 00:10:17.124528 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.124512 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b"} err="failed to get container status \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": rpc error: code = NotFound desc = could not find container \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": container with ID starting with 218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b not found: ID does not exist" Jul 23 00:10:17.124585 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.124528 2574 scope.go:117] "RemoveContainer" containerID="4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e" Jul 23 00:10:17.124733 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.124716 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e"} err="failed to get container status \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": rpc error: code = NotFound desc = could not find container \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": container with ID starting with 4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e not found: ID does not exist" Jul 23 00:10:17.124775 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.124733 2574 scope.go:117] "RemoveContainer" containerID="84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab" Jul 23 00:10:17.124929 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.124910 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab"} err="failed to get container status \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": rpc error: code = NotFound desc = could not find container \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": container with ID starting with 84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab not found: ID does not exist" Jul 23 00:10:17.124990 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.124931 2574 scope.go:117] "RemoveContainer" containerID="5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843" Jul 23 00:10:17.125140 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.125126 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843"} err="failed to get container status \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": rpc error: code = NotFound desc = could not find container \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": container with ID starting with 5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843 not found: ID does not exist" Jul 23 00:10:17.125188 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.125140 2574 scope.go:117] "RemoveContainer" containerID="cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104" Jul 23 00:10:17.125361 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.125304 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104"} err="failed to get container status \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": rpc error: code = NotFound desc = could not find container \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": container with ID starting with cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104 not found: ID does not exist" Jul 23 00:10:17.125420 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.125363 2574 scope.go:117] "RemoveContainer" containerID="73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756" Jul 23 00:10:17.125565 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.125550 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756"} err="failed to get container status \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": rpc error: code = NotFound desc = could not find container \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": container with ID starting with 73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756 not found: ID does not exist" Jul 23 00:10:17.125602 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.125564 2574 scope.go:117] "RemoveContainer" containerID="43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069" Jul 23 00:10:17.125743 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.125725 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069"} err="failed to get container status \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": rpc error: code = NotFound desc = could not find container \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": container with ID starting with 43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069 not found: ID does not exist" Jul 23 00:10:17.125801 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.125744 2574 scope.go:117] "RemoveContainer" containerID="218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b" Jul 23 00:10:17.125934 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.125919 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b"} err="failed to get container status \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": rpc error: code = NotFound desc = could not find container \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": container with ID starting with 218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b not found: ID does not exist" Jul 23 00:10:17.125978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.125933 2574 scope.go:117] "RemoveContainer" containerID="4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e" Jul 23 00:10:17.126118 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.126104 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e"} err="failed to get container status \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": rpc error: code = NotFound desc = could not find container \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": container with ID starting with 4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e not found: ID does not exist" Jul 23 00:10:17.126157 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.126117 2574 scope.go:117] "RemoveContainer" containerID="84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab" Jul 23 00:10:17.126281 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.126266 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab"} err="failed to get container status \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": rpc error: code = NotFound desc = could not find container \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": container with ID starting with 84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab not found: ID does not exist" Jul 23 00:10:17.126324 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.126281 2574 scope.go:117] "RemoveContainer" containerID="5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843" Jul 23 00:10:17.126487 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.126469 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843"} err="failed to get container status \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": rpc error: code = NotFound desc = could not find container \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": container with ID starting with 5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843 not found: ID does not exist" Jul 23 00:10:17.126559 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.126489 2574 scope.go:117] "RemoveContainer" containerID="cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104" Jul 23 00:10:17.126675 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.126660 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104"} err="failed to get container status \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": rpc error: code = NotFound desc = could not find container \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": container with ID starting with cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104 not found: ID does not exist" Jul 23 00:10:17.126721 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.126675 2574 scope.go:117] "RemoveContainer" containerID="73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756" Jul 23 00:10:17.126842 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.126827 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756"} err="failed to get container status \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": rpc error: code = NotFound desc = could not find container \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": container with ID starting with 73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756 not found: ID does not exist" Jul 23 00:10:17.126842 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.126841 2574 scope.go:117] "RemoveContainer" containerID="43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069" Jul 23 00:10:17.127011 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.126995 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069"} err="failed to get container status \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": rpc error: code = NotFound desc = could not find container \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": container with ID starting with 43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069 not found: ID does not exist" Jul 23 00:10:17.127051 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.127011 2574 scope.go:117] "RemoveContainer" containerID="218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b" Jul 23 00:10:17.127181 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.127164 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b"} err="failed to get container status \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": rpc error: code = NotFound desc = could not find container \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": container with ID starting with 218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b not found: ID does not exist" Jul 23 00:10:17.127250 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.127183 2574 scope.go:117] "RemoveContainer" containerID="4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e" Jul 23 00:10:17.127401 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.127363 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e"} err="failed to get container status \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": rpc error: code = NotFound desc = could not find container \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": container with ID starting with 4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e not found: ID does not exist" Jul 23 00:10:17.127401 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.127391 2574 scope.go:117] "RemoveContainer" containerID="84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab" Jul 23 00:10:17.127571 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.127551 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab"} err="failed to get container status \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": rpc error: code = NotFound desc = could not find container \"84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab\": container with ID starting with 84efaf067bb349328f736a7c98477b3bd5871aea386b66a64a7702df83c483ab not found: ID does not exist" Jul 23 00:10:17.127571 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.127570 2574 scope.go:117] "RemoveContainer" containerID="5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843" Jul 23 00:10:17.127782 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.127759 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843"} err="failed to get container status \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": rpc error: code = NotFound desc = could not find container \"5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843\": container with ID starting with 5a9f86c336644e980d28327cd333c1dfc11615df3ea080dab13c367878b39843 not found: ID does not exist" Jul 23 00:10:17.127782 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.127782 2574 scope.go:117] "RemoveContainer" containerID="cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104" Jul 23 00:10:17.128061 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.128037 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104"} err="failed to get container status \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": rpc error: code = NotFound desc = could not find container \"cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104\": container with ID starting with cea1d3d8ca326b8d3263e4d0bdeef76b55548368f96b344348ad671274a76104 not found: ID does not exist" Jul 23 00:10:17.128174 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.128064 2574 scope.go:117] "RemoveContainer" containerID="73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756" Jul 23 00:10:17.128866 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.128377 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756"} err="failed to get container status \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": rpc error: code = NotFound desc = could not find container \"73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756\": container with ID starting with 73ac06837c6f31ab18aa3ada55af5ca25e483a09a12d2a8ff77524a31f20a756 not found: ID does not exist" Jul 23 00:10:17.128866 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.128437 2574 scope.go:117] "RemoveContainer" containerID="43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069" Jul 23 00:10:17.129056 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.128996 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069"} err="failed to get container status \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": rpc error: code = NotFound desc = could not find container \"43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069\": container with ID starting with 43255eac73b3564e6cdfc39cc3ba727216d5e724e4b550d99ea7f62a482c1069 not found: ID does not exist" Jul 23 00:10:17.129056 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.129018 2574 scope.go:117] "RemoveContainer" containerID="218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b" Jul 23 00:10:17.129280 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.129255 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b"} err="failed to get container status \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": rpc error: code = NotFound desc = could not find container \"218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b\": container with ID starting with 218a349ebb3859fb15b9dc9a334375dfbf87e1c7fcc51f38db9b58b38e7a032b not found: ID does not exist" Jul 23 00:10:17.129368 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.129282 2574 scope.go:117] "RemoveContainer" containerID="4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e" Jul 23 00:10:17.129590 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.129552 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e"} err="failed to get container status \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": rpc error: code = NotFound desc = could not find container \"4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e\": container with ID starting with 4c9b5377ba8a3d2375bb14a5839ea969650e9505aab5e380790c8f965d3d790e not found: ID does not exist" Jul 23 00:10:17.130412 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.130377 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 00:10:17.210047 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210014 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210047 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210056 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-config\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210304 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210076 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210304 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210101 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xflph\" (UniqueName: \"kubernetes.io/projected/95be333c-de14-4818-959c-f269404fa477-kube-api-access-xflph\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210304 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210172 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210304 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210232 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210304 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-web-config\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210304 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210609 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95be333c-de14-4818-959c-f269404fa477-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210609 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210609 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210412 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210609 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210609 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210609 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210609 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210609 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210609 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95be333c-de14-4818-959c-f269404fa477-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210906 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210615 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95be333c-de14-4818-959c-f269404fa477-config-out\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210906 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.210906 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.210646 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311435 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311314 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-config\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311435 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311365 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311435 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xflph\" (UniqueName: \"kubernetes.io/projected/95be333c-de14-4818-959c-f269404fa477-kube-api-access-xflph\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311458 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311505 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-web-config\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311533 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95be333c-de14-4818-959c-f269404fa477-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.311717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311719 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.312268 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.312268 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95be333c-de14-4818-959c-f269404fa477-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.312268 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311807 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95be333c-de14-4818-959c-f269404fa477-config-out\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.312268 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.312268 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.312268 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.311899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.312268 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.312228 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.312653 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.312293 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.312653 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.312603 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.312653 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.312644 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95be333c-de14-4818-959c-f269404fa477-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.314734 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.314710 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.315419 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.314897 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.315419 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.314999 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95be333c-de14-4818-959c-f269404fa477-config-out\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.315419 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.315121 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-web-config\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.315419 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.315173 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-config\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.315419 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.315298 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.315737 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.315531 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95be333c-de14-4818-959c-f269404fa477-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.315914 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.315859 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.316312 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.316258 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.316436 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.316420 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.316511 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.316473 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95be333c-de14-4818-959c-f269404fa477-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.317419 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.317357 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.317787 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.317764 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.318311 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.318288 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.318428 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.318299 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95be333c-de14-4818-959c-f269404fa477-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.319154 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.319136 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xflph\" (UniqueName: \"kubernetes.io/projected/95be333c-de14-4818-959c-f269404fa477-kube-api-access-xflph\") pod \"prometheus-k8s-0\" (UID: \"95be333c-de14-4818-959c-f269404fa477\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.421505 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.421455 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:17.570961 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:17.570879 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 00:10:17.573886 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:10:17.573855 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95be333c_de14_4818_959c_f269404fa477.slice/crio-d64f9bcd84fe9a62bfd94db42e7daee5c9775b87e844fa352a13dba32a204a43 WatchSource:0}: Error finding container d64f9bcd84fe9a62bfd94db42e7daee5c9775b87e844fa352a13dba32a204a43: Status 404 returned error can't find the container with id d64f9bcd84fe9a62bfd94db42e7daee5c9775b87e844fa352a13dba32a204a43 Jul 23 00:10:18.057570 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:18.057533 2574 generic.go:356] "Generic (PLEG): container finished" podID="95be333c-de14-4818-959c-f269404fa477" containerID="a1320135150efb36f5b8a2f0a051816483fafd86e7b3f75a10f77b776f45face" exitCode=0 Jul 23 00:10:18.057770 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:18.057620 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95be333c-de14-4818-959c-f269404fa477","Type":"ContainerDied","Data":"a1320135150efb36f5b8a2f0a051816483fafd86e7b3f75a10f77b776f45face"} Jul 23 00:10:18.057770 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:18.057698 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95be333c-de14-4818-959c-f269404fa477","Type":"ContainerStarted","Data":"d64f9bcd84fe9a62bfd94db42e7daee5c9775b87e844fa352a13dba32a204a43"} Jul 23 00:10:18.654110 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:18.654033 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d088b26-86b6-44e4-9647-3c3cadb14f1a" path="/var/lib/kubelet/pods/7d088b26-86b6-44e4-9647-3c3cadb14f1a/volumes" Jul 23 00:10:19.065555 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:19.065524 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95be333c-de14-4818-959c-f269404fa477","Type":"ContainerStarted","Data":"e8f4efa3f99da1e48d1bd4a6ab5d2d520e9bce5c5d33288c28f6d5669f4fcd6a"} Jul 23 00:10:19.065730 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:19.065587 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95be333c-de14-4818-959c-f269404fa477","Type":"ContainerStarted","Data":"f5cfb0eded4d24bf4063edd1837cf54f997c397355fd6326d99feff2907db7d5"} Jul 23 00:10:19.065730 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:19.065614 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95be333c-de14-4818-959c-f269404fa477","Type":"ContainerStarted","Data":"d6edce45d2421278f7f8b59559979715f83d7ed893808e2ba00b8baca1020a31"} Jul 23 00:10:19.065730 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:19.065637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95be333c-de14-4818-959c-f269404fa477","Type":"ContainerStarted","Data":"b6e3b25647b464115fd5d51488d046aef0dfca5d703a8164bd4354e178298a78"} Jul 23 00:10:19.065730 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:19.065667 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95be333c-de14-4818-959c-f269404fa477","Type":"ContainerStarted","Data":"56c6fb3e54586378a3a57303f241b79c3a27d634cb38d7f32c22ef9fafcb6ee5"} Jul 23 00:10:19.065730 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:19.065689 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95be333c-de14-4818-959c-f269404fa477","Type":"ContainerStarted","Data":"6a7ec7b24208cbcb6e535bffcfd54c0748a963106074b30ee852267714d5b139"} Jul 23 00:10:19.106358 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:19.106290 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.088054813 podStartE2EDuration="2.106265101s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.210288ms" isStatefulPod=false podCreationTimestamp="2026-07-23 00:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:10:19.10451679 +0000 UTC m=+360.968685960" watchObservedRunningTime="2026-07-23 00:10:19.106265101 +0000 UTC m=+360.970434273" Jul 23 00:10:19.870250 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:19.870195 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:19.967837 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:19.967801 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:22.422374 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:22.422328 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:10:31.228769 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:31.228729 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:31.331522 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:31.331475 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:10:31.379273 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:10:31.379232 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:17.421934 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:17.421875 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:11:17.437467 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:17.437441 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:11:18.322376 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:18.322343 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 00:11:25.893650 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:25.893605 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:25.960450 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:25.960414 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:37.771725 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:37.771678 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:37.870889 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:37.870840 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:39.247950 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:39.247913 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:39.352063 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:39.352028 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:39.400147 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:39.400110 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:39.948733 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:39.948650 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:39.996525 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:39.996494 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:45.440632 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:45.440593 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:45.540312 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:45.540274 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:45.853184 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:45.853154 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:50.549307 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:50.549270 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:50.650415 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:50.650350 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:11:50.697371 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:11:50.697329 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:14.222865 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:14.222826 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:14.309720 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:14.309680 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:40.829871 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:40.829826 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:41.613518 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:41.613482 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:44.477584 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:44.477545 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:44.533163 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:44.533119 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:46.109851 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:46.109811 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:46.205944 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:46.205910 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:46.533661 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:46.533614 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:46.636100 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:46.636062 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:48.928728 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:48.928687 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:49.325459 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:49.325417 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:51.444816 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:51.444765 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:51.545704 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:51.545663 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:12:56.524731 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:12:56.524695 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:08.958008 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:08.957973 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:09.055399 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:09.055354 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:14.696009 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:14.695967 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:14.797147 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:14.797114 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:16.465008 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:16.464953 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:22.128636 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:22.128597 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:24.990896 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:24.990849 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:26.499488 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:26.499454 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:31.930362 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:31.930322 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:32.913979 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:32.913943 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:32.966487 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:32.966447 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz"] Jul 23 00:13:32.968601 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:32.968583 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:32.977982 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:32.977958 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 23 00:13:32.978109 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:32.978045 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 23 00:13:32.978804 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:32.978782 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 23 00:13:32.978914 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:32.978802 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 23 00:13:32.978914 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:32.978840 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mjztj\"" Jul 23 00:13:32.978914 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:32.978790 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 23 00:13:32.985613 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:32.985588 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz"] Jul 23 00:13:33.048724 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.048686 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:33.086339 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.086300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjdjv\" (UniqueName: \"kubernetes.io/projected/36430ea1-a1fe-4845-99a1-0c8d935f7256-kube-api-access-qjdjv\") pod \"lws-controller-manager-7dcccd7c7c-njnjz\" (UID: \"36430ea1-a1fe-4845-99a1-0c8d935f7256\") " pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.086339 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.086338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36430ea1-a1fe-4845-99a1-0c8d935f7256-cert\") pod \"lws-controller-manager-7dcccd7c7c-njnjz\" (UID: \"36430ea1-a1fe-4845-99a1-0c8d935f7256\") " pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.086573 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.086372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36430ea1-a1fe-4845-99a1-0c8d935f7256-manager-config\") pod \"lws-controller-manager-7dcccd7c7c-njnjz\" (UID: \"36430ea1-a1fe-4845-99a1-0c8d935f7256\") " pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.086573 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.086462 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36430ea1-a1fe-4845-99a1-0c8d935f7256-metrics-cert\") pod \"lws-controller-manager-7dcccd7c7c-njnjz\" (UID: \"36430ea1-a1fe-4845-99a1-0c8d935f7256\") " pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.187669 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.187567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36430ea1-a1fe-4845-99a1-0c8d935f7256-metrics-cert\") pod \"lws-controller-manager-7dcccd7c7c-njnjz\" (UID: \"36430ea1-a1fe-4845-99a1-0c8d935f7256\") " pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.187841 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.187671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdjv\" (UniqueName: \"kubernetes.io/projected/36430ea1-a1fe-4845-99a1-0c8d935f7256-kube-api-access-qjdjv\") pod \"lws-controller-manager-7dcccd7c7c-njnjz\" (UID: \"36430ea1-a1fe-4845-99a1-0c8d935f7256\") " pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.187841 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.187707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36430ea1-a1fe-4845-99a1-0c8d935f7256-cert\") pod \"lws-controller-manager-7dcccd7c7c-njnjz\" (UID: \"36430ea1-a1fe-4845-99a1-0c8d935f7256\") " pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.187841 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.187737 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36430ea1-a1fe-4845-99a1-0c8d935f7256-manager-config\") pod \"lws-controller-manager-7dcccd7c7c-njnjz\" (UID: \"36430ea1-a1fe-4845-99a1-0c8d935f7256\") " pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.188414 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.188365 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36430ea1-a1fe-4845-99a1-0c8d935f7256-manager-config\") pod \"lws-controller-manager-7dcccd7c7c-njnjz\" (UID: \"36430ea1-a1fe-4845-99a1-0c8d935f7256\") " pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.190195 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.190172 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36430ea1-a1fe-4845-99a1-0c8d935f7256-metrics-cert\") pod \"lws-controller-manager-7dcccd7c7c-njnjz\" (UID: \"36430ea1-a1fe-4845-99a1-0c8d935f7256\") " pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.190300 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.190282 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36430ea1-a1fe-4845-99a1-0c8d935f7256-cert\") pod \"lws-controller-manager-7dcccd7c7c-njnjz\" (UID: \"36430ea1-a1fe-4845-99a1-0c8d935f7256\") " pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.206694 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.206660 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjdjv\" (UniqueName: \"kubernetes.io/projected/36430ea1-a1fe-4845-99a1-0c8d935f7256-kube-api-access-qjdjv\") pod \"lws-controller-manager-7dcccd7c7c-njnjz\" (UID: \"36430ea1-a1fe-4845-99a1-0c8d935f7256\") " pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.278644 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.278608 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:33.429245 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.429219 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz"] Jul 23 00:13:33.431026 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:13:33.430998 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36430ea1_a1fe_4845_99a1_0c8d935f7256.slice/crio-53dabf0f553ba9f8df0beed50958fc28505e23ca674928451f4e770c451e4e1e WatchSource:0}: Error finding container 53dabf0f553ba9f8df0beed50958fc28505e23ca674928451f4e770c451e4e1e: Status 404 returned error can't find the container with id 53dabf0f553ba9f8df0beed50958fc28505e23ca674928451f4e770c451e4e1e Jul 23 00:13:33.432907 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.432893 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 00:13:33.818930 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:33.818892 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" event={"ID":"36430ea1-a1fe-4845-99a1-0c8d935f7256","Type":"ContainerStarted","Data":"53dabf0f553ba9f8df0beed50958fc28505e23ca674928451f4e770c451e4e1e"} Jul 23 00:13:36.832240 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:36.832193 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" event={"ID":"36430ea1-a1fe-4845-99a1-0c8d935f7256","Type":"ContainerStarted","Data":"c240c0b0ab76d308c18de142761a9021ca67685ddea4f2108cceb6d78dbf0a98"} Jul 23 00:13:36.832705 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:36.832342 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:41.138887 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:41.138854 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:41.298554 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:41.298518 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:41.794484 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:41.794452 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:42.325320 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.325290 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:42.420867 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.420832 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:42.527973 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.527921 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" podStartSLOduration=7.650219114 podStartE2EDuration="10.527905373s" totalImagesPullingTime="2.877686259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:13:36.86179373 +0000 UTC m=+558.725962902" watchObservedRunningTime="2026-07-23 00:13:42.527905373 +0000 UTC m=+564.392074544" Jul 23 00:13:42.528478 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.528460 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs"] Jul 23 00:13:42.530859 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.530837 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.536403 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.536361 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 00:13:42.536548 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.536445 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 00:13:42.536756 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.536736 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 00:13:42.536851 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.536826 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zvmmz\"" Jul 23 00:13:42.536981 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.536968 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 00:13:42.580475 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.580376 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs"] Jul 23 00:13:42.676249 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.676196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.676249 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.676248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-manifests\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.676524 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.676397 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-tmp\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.676524 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.676431 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.676524 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.676472 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ml5x\" (UniqueName: \"kubernetes.io/projected/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-kube-api-access-9ml5x\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.777338 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.777305 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.777338 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.777350 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ml5x\" (UniqueName: \"kubernetes.io/projected/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-kube-api-access-9ml5x\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.777618 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.777392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.777618 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.777420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-manifests\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.777618 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.777588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-tmp\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.778030 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.777998 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-manifests\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.780167 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.780135 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.780324 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.780303 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-tmp\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.780569 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.780547 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.795885 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.795848 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ml5x\" (UniqueName: \"kubernetes.io/projected/c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb-kube-api-access-9ml5x\") pod \"opendatahub-operator-controller-manager-86b98fc76f-7vsvs\" (UID: \"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.826473 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.826435 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:42.841376 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.841297 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:42.932119 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.932063 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:42.988728 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:42.988695 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs"] Jul 23 00:13:42.992041 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:13:42.992012 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77abcbe_c0fa_43fa_a88b_8abf6be8ceeb.slice/crio-ef93a2b7390a41c0da55ffb2b1dabb80a13d90dd454f687a47bd8c5a91e2f3db WatchSource:0}: Error finding container ef93a2b7390a41c0da55ffb2b1dabb80a13d90dd454f687a47bd8c5a91e2f3db: Status 404 returned error can't find the container with id ef93a2b7390a41c0da55ffb2b1dabb80a13d90dd454f687a47bd8c5a91e2f3db Jul 23 00:13:43.034580 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:43.034548 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:43.158291 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:43.158195 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:43.294027 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:43.293996 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:43.861319 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:43.861279 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" event={"ID":"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb","Type":"ContainerStarted","Data":"ef93a2b7390a41c0da55ffb2b1dabb80a13d90dd454f687a47bd8c5a91e2f3db"} Jul 23 00:13:46.876914 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:46.876877 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" event={"ID":"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb","Type":"ContainerStarted","Data":"3c09d7e5b2665efddf3909aba74a2c3b5144718b315389c3c367f8625566dc83"} Jul 23 00:13:47.838596 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:47.838568 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7dcccd7c7c-njnjz" Jul 23 00:13:47.883348 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:47.883315 2574 generic.go:356] "Generic (PLEG): container finished" podID="c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb" containerID="3c09d7e5b2665efddf3909aba74a2c3b5144718b315389c3c367f8625566dc83" exitCode=0 Jul 23 00:13:47.883766 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:47.883421 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" event={"ID":"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb","Type":"ContainerDied","Data":"3c09d7e5b2665efddf3909aba74a2c3b5144718b315389c3c367f8625566dc83"} Jul 23 00:13:48.894149 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:48.894112 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" event={"ID":"c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb","Type":"ContainerStarted","Data":"4d4d67e8435d003fb3b230d677dab18da29a68628448a697c402dec655e2f936"} Jul 23 00:13:48.894551 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:48.894230 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:13:48.919276 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:48.919224 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" podStartSLOduration=2.311123785 podStartE2EDuration="6.919208532s" totalImagesPullingTime="3.524849928s" totalInitContainerRuntime="1.083234819s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:13:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:13:48.917149576 +0000 UTC m=+570.781318740" watchObservedRunningTime="2026-07-23 00:13:48.919208532 +0000 UTC m=+570.783377703" Jul 23 00:13:50.050720 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:50.050689 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:50.151429 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:50.151372 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:13:59.901324 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:13:59.901287 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-7vsvs" Jul 23 00:14:02.020224 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:02.020176 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:02.269519 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:02.269478 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:02.994533 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:02.994500 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:03.156542 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:03.156511 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:03.310078 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:03.309986 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:03.778350 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:03.778308 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:04.099870 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:04.099775 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:04.205042 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:04.205005 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:12.927657 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:12.927623 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:13.072236 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.072192 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:13.288299 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.288255 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:13.463230 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.463189 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:13.545906 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.545827 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-76d98b647-m7hn4"] Jul 23 00:14:13.548664 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.548644 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" Jul 23 00:14:13.552183 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.552156 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 23 00:14:13.552365 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.552337 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 23 00:14:13.552365 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.552360 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-v2hxc\"" Jul 23 00:14:13.552558 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.552494 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 00:14:13.552844 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.552828 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 00:14:13.563588 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.563560 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76d98b647-m7hn4"] Jul 23 00:14:13.597490 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.597454 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:13.617513 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.617475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12ebc3d7-bd4e-4428-a1d1-07c8b92be165-tls-certs\") pod \"kube-auth-proxy-76d98b647-m7hn4\" (UID: \"12ebc3d7-bd4e-4428-a1d1-07c8b92be165\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" Jul 23 00:14:13.617658 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.617530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g87rh\" (UniqueName: \"kubernetes.io/projected/12ebc3d7-bd4e-4428-a1d1-07c8b92be165-kube-api-access-g87rh\") pod \"kube-auth-proxy-76d98b647-m7hn4\" (UID: \"12ebc3d7-bd4e-4428-a1d1-07c8b92be165\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" Jul 23 00:14:13.617658 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.617648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ebc3d7-bd4e-4428-a1d1-07c8b92be165-tmp\") pod \"kube-auth-proxy-76d98b647-m7hn4\" (UID: \"12ebc3d7-bd4e-4428-a1d1-07c8b92be165\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" Jul 23 00:14:13.689161 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.689118 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:13.718917 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.718877 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12ebc3d7-bd4e-4428-a1d1-07c8b92be165-tls-certs\") pod \"kube-auth-proxy-76d98b647-m7hn4\" (UID: \"12ebc3d7-bd4e-4428-a1d1-07c8b92be165\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" Jul 23 00:14:13.718917 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.718924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g87rh\" (UniqueName: \"kubernetes.io/projected/12ebc3d7-bd4e-4428-a1d1-07c8b92be165-kube-api-access-g87rh\") pod \"kube-auth-proxy-76d98b647-m7hn4\" (UID: \"12ebc3d7-bd4e-4428-a1d1-07c8b92be165\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" Jul 23 00:14:13.719171 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.718958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ebc3d7-bd4e-4428-a1d1-07c8b92be165-tmp\") pod \"kube-auth-proxy-76d98b647-m7hn4\" (UID: \"12ebc3d7-bd4e-4428-a1d1-07c8b92be165\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" Jul 23 00:14:13.725416 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.721810 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ebc3d7-bd4e-4428-a1d1-07c8b92be165-tmp\") pod \"kube-auth-proxy-76d98b647-m7hn4\" (UID: \"12ebc3d7-bd4e-4428-a1d1-07c8b92be165\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" Jul 23 00:14:13.730929 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.730897 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12ebc3d7-bd4e-4428-a1d1-07c8b92be165-tls-certs\") pod \"kube-auth-proxy-76d98b647-m7hn4\" (UID: \"12ebc3d7-bd4e-4428-a1d1-07c8b92be165\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" Jul 23 00:14:13.733687 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.733659 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g87rh\" (UniqueName: \"kubernetes.io/projected/12ebc3d7-bd4e-4428-a1d1-07c8b92be165-kube-api-access-g87rh\") pod \"kube-auth-proxy-76d98b647-m7hn4\" (UID: \"12ebc3d7-bd4e-4428-a1d1-07c8b92be165\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" Jul 23 00:14:13.858492 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.858410 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" Jul 23 00:14:13.993827 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:13.993670 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76d98b647-m7hn4"] Jul 23 00:14:13.996509 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:14:13.996476 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ebc3d7_bd4e_4428_a1d1_07c8b92be165.slice/crio-15aebe630be7759e77736962c86f5e3b0935c02c3845f73ded332f3f2d3f237f WatchSource:0}: Error finding container 15aebe630be7759e77736962c86f5e3b0935c02c3845f73ded332f3f2d3f237f: Status 404 returned error can't find the container with id 15aebe630be7759e77736962c86f5e3b0935c02c3845f73ded332f3f2d3f237f Jul 23 00:14:14.221260 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:14.221209 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:14.320240 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:14.320196 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:14.429308 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:14.429221 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:15.006069 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:15.006027 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" event={"ID":"12ebc3d7-bd4e-4428-a1d1-07c8b92be165","Type":"ContainerStarted","Data":"15aebe630be7759e77736962c86f5e3b0935c02c3845f73ded332f3f2d3f237f"} Jul 23 00:14:15.533864 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:15.533816 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:15.631730 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:15.631691 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:16.697177 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:16.697136 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:18.019971 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:18.019925 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" event={"ID":"12ebc3d7-bd4e-4428-a1d1-07c8b92be165","Type":"ContainerStarted","Data":"15ca5b79fe8d12e3d2dab888e9d9ffc16017961c3d2a5b728dc5627a1571334c"} Jul 23 00:14:18.036582 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:18.036530 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-76d98b647-m7hn4" podStartSLOduration=1.7021477059999999 podStartE2EDuration="5.036511654s" totalImagesPullingTime="3.334363948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:14:18.034872969 +0000 UTC m=+599.899042142" watchObservedRunningTime="2026-07-23 00:14:18.036511654 +0000 UTC m=+599.900680825" Jul 23 00:14:18.550108 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:18.550081 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:14:18.550348 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:18.550319 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:14:20.209862 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:20.209823 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:20.310292 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:20.310259 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:20.501394 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:20.501348 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:20.695040 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:20.695005 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:21.074905 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:21.074867 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:50.195868 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:50.195777 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:14:50.296584 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:14:50.296552 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:03.456204 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:03.456171 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:03.556991 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:03.556955 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:03.654738 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:03.654700 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:04.406914 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:04.406869 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:04.604725 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:04.604684 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:32.517923 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:32.517887 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:36.040966 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:36.040881 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:37.089762 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:37.089730 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:39.152756 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:39.152711 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:40.524222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:40.524183 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:40.650935 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:40.650899 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:41.233220 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:41.233182 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:43.896010 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:43.895978 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:43.933694 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:43.933662 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt"] Jul 23 00:15:43.935781 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:43.935763 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt" Jul 23 00:15:43.938114 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:43.938087 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 00:15:43.938228 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:43.938087 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 00:15:43.938731 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:43.938717 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-x98qs\"" Jul 23 00:15:43.946170 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:43.946145 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt"] Jul 23 00:15:44.056276 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:44.056240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkr78\" (UniqueName: \"kubernetes.io/projected/3bc060ea-9129-4dbe-8084-460828d50a69-kube-api-access-dkr78\") pod \"authorino-operator-75cc8d5cb7-c2gdt\" (UID: \"3bc060ea-9129-4dbe-8084-460828d50a69\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt" Jul 23 00:15:44.157492 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:44.157360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkr78\" (UniqueName: \"kubernetes.io/projected/3bc060ea-9129-4dbe-8084-460828d50a69-kube-api-access-dkr78\") pod \"authorino-operator-75cc8d5cb7-c2gdt\" (UID: \"3bc060ea-9129-4dbe-8084-460828d50a69\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt" Jul 23 00:15:44.170336 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:44.170310 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkr78\" (UniqueName: \"kubernetes.io/projected/3bc060ea-9129-4dbe-8084-460828d50a69-kube-api-access-dkr78\") pod \"authorino-operator-75cc8d5cb7-c2gdt\" (UID: \"3bc060ea-9129-4dbe-8084-460828d50a69\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt" Jul 23 00:15:44.246546 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:44.246507 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt" Jul 23 00:15:44.368853 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:44.368817 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:44.377951 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:44.377930 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt"] Jul 23 00:15:44.380447 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:15:44.380421 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc060ea_9129_4dbe_8084_460828d50a69.slice/crio-761bd2843bdabb78a985ef13b5ca5f867056df19614f3d8bf5137fb84c9bcbe1 WatchSource:0}: Error finding container 761bd2843bdabb78a985ef13b5ca5f867056df19614f3d8bf5137fb84c9bcbe1: Status 404 returned error can't find the container with id 761bd2843bdabb78a985ef13b5ca5f867056df19614f3d8bf5137fb84c9bcbe1 Jul 23 00:15:44.844500 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:44.844463 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:45.386334 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:45.386292 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt" event={"ID":"3bc060ea-9129-4dbe-8084-460828d50a69","Type":"ContainerStarted","Data":"761bd2843bdabb78a985ef13b5ca5f867056df19614f3d8bf5137fb84c9bcbe1"} Jul 23 00:15:46.418788 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:46.418746 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:46.521412 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:46.521365 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:46.674994 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:46.674907 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:47.396365 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:47.396329 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt" event={"ID":"3bc060ea-9129-4dbe-8084-460828d50a69","Type":"ContainerStarted","Data":"a44b6d8898417fe7a3c5bd7edd13757458c1a36ba1800a188bd50384fc8e97e1"} Jul 23 00:15:47.396560 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:47.396476 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt" Jul 23 00:15:47.421189 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:47.421135 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt" podStartSLOduration=2.022428953 podStartE2EDuration="4.421118274s" totalImagesPullingTime="2.398689321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:15:47.419605636 +0000 UTC m=+689.283774811" watchObservedRunningTime="2026-07-23 00:15:47.421118274 +0000 UTC m=+689.285287444" Jul 23 00:15:47.835314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:47.835277 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:47.939506 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:47.939474 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:48.066471 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:48.066437 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:48.256815 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:48.256778 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:48.354533 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:48.354500 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:50.109108 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:50.109074 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:50.733859 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:50.733817 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:51.148299 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:51.148203 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:51.846829 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:51.846791 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:51.947152 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:51.947115 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:15:58.403681 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:15:58.403646 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-c2gdt" Jul 23 00:16:00.055964 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.055929 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl"] Jul 23 00:16:00.064927 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.064894 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:00.067442 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.067412 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mdpk6\"" Jul 23 00:16:00.070809 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.070786 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl"] Jul 23 00:16:00.101218 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.101183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjx8h\" (UniqueName: \"kubernetes.io/projected/9abdef4e-b79a-4687-a495-c3e762675897-kube-api-access-kjx8h\") pod \"kuadrant-operator-controller-manager-55467d9f7-6jtjl\" (UID: \"9abdef4e-b79a-4687-a495-c3e762675897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:00.101444 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.101287 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9abdef4e-b79a-4687-a495-c3e762675897-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6jtjl\" (UID: \"9abdef4e-b79a-4687-a495-c3e762675897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:00.202357 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.202314 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjx8h\" (UniqueName: \"kubernetes.io/projected/9abdef4e-b79a-4687-a495-c3e762675897-kube-api-access-kjx8h\") pod \"kuadrant-operator-controller-manager-55467d9f7-6jtjl\" (UID: \"9abdef4e-b79a-4687-a495-c3e762675897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:00.202552 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.202423 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9abdef4e-b79a-4687-a495-c3e762675897-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6jtjl\" (UID: \"9abdef4e-b79a-4687-a495-c3e762675897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:00.202762 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.202746 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9abdef4e-b79a-4687-a495-c3e762675897-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6jtjl\" (UID: \"9abdef4e-b79a-4687-a495-c3e762675897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:00.210791 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.210763 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjx8h\" (UniqueName: \"kubernetes.io/projected/9abdef4e-b79a-4687-a495-c3e762675897-kube-api-access-kjx8h\") pod \"kuadrant-operator-controller-manager-55467d9f7-6jtjl\" (UID: \"9abdef4e-b79a-4687-a495-c3e762675897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:00.376271 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.376174 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:00.460347 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.460313 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl"] Jul 23 00:16:00.469606 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:00.469570 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl"] Jul 23 00:16:00.645727 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:16:00.645699 2574 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 23 00:16:00.645727 ip-10-0-137-249 kubenswrapper[2574]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-6jtjl_kuadrant-system_9abdef4e-b79a-4687-a495-c3e762675897_0(64f85d2e812802163db361d04e25d0a6b497c7564affb854c780858fa4d783ef): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-6jtjl to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"64f85d2e812802163db361d04e25d0a6b497c7564affb854c780858fa4d783ef" Netns:"/var/run/netns/841a3102-bdf9-4ce4-8c5a-64023fad3738" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-6jtjl;K8S_POD_INFRA_CONTAINER_ID=64f85d2e812802163db361d04e25d0a6b497c7564affb854c780858fa4d783ef;K8S_POD_UID=9abdef4e-b79a-4687-a495-c3e762675897" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl/9abdef4e-b79a-4687-a495-c3e762675897:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl 64f85d2e812802163db361d04e25d0a6b497c7564affb854c780858fa4d783ef network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl 64f85d2e812802163db361d04e25d0a6b497c7564affb854c780858fa4d783ef network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:19 [10.134.0.25/23] Jul 23 00:16:00.645727 ip-10-0-137-249 kubenswrapper[2574]: ' Jul 23 00:16:00.645727 ip-10-0-137-249 kubenswrapper[2574]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 23 00:16:00.645727 ip-10-0-137-249 kubenswrapper[2574]: > Jul 23 00:16:00.645911 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:16:00.645752 2574 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 23 00:16:00.645911 ip-10-0-137-249 kubenswrapper[2574]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-6jtjl_kuadrant-system_9abdef4e-b79a-4687-a495-c3e762675897_0(64f85d2e812802163db361d04e25d0a6b497c7564affb854c780858fa4d783ef): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-6jtjl to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"64f85d2e812802163db361d04e25d0a6b497c7564affb854c780858fa4d783ef" Netns:"/var/run/netns/841a3102-bdf9-4ce4-8c5a-64023fad3738" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-6jtjl;K8S_POD_INFRA_CONTAINER_ID=64f85d2e812802163db361d04e25d0a6b497c7564affb854c780858fa4d783ef;K8S_POD_UID=9abdef4e-b79a-4687-a495-c3e762675897" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl/9abdef4e-b79a-4687-a495-c3e762675897:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl 64f85d2e812802163db361d04e25d0a6b497c7564affb854c780858fa4d783ef network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl 64f85d2e812802163db361d04e25d0a6b497c7564affb854c780858fa4d783ef network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:19 [10.134.0.25/23] Jul 23 00:16:00.645911 ip-10-0-137-249 kubenswrapper[2574]: ' Jul 23 00:16:00.645911 ip-10-0-137-249 kubenswrapper[2574]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 23 00:16:00.645911 ip-10-0-137-249 kubenswrapper[2574]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:01.085446 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:01.085403 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:01.458821 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:01.458739 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:01.460446 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:01.460419 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:01.467478 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:01.467454 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:01.469620 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:16:01.469595 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6jtjl\" is forbidden: User \"system:node:ip-10-0-137-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-249.ec2.internal' and this object" podUID="9abdef4e-b79a-4687-a495-c3e762675897" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:01.512763 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:01.512730 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjx8h\" (UniqueName: \"kubernetes.io/projected/9abdef4e-b79a-4687-a495-c3e762675897-kube-api-access-kjx8h\") pod \"9abdef4e-b79a-4687-a495-c3e762675897\" (UID: \"9abdef4e-b79a-4687-a495-c3e762675897\") " Jul 23 00:16:01.512861 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:01.512804 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9abdef4e-b79a-4687-a495-c3e762675897-extensions-socket-volume\") pod \"9abdef4e-b79a-4687-a495-c3e762675897\" (UID: \"9abdef4e-b79a-4687-a495-c3e762675897\") " Jul 23 00:16:01.513078 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:01.513051 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9abdef4e-b79a-4687-a495-c3e762675897-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9abdef4e-b79a-4687-a495-c3e762675897" (UID: "9abdef4e-b79a-4687-a495-c3e762675897"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:16:01.514856 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:01.514824 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9abdef4e-b79a-4687-a495-c3e762675897-kube-api-access-kjx8h" (OuterVolumeSpecName: "kube-api-access-kjx8h") pod "9abdef4e-b79a-4687-a495-c3e762675897" (UID: "9abdef4e-b79a-4687-a495-c3e762675897"). InnerVolumeSpecName "kube-api-access-kjx8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 00:16:01.613465 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:01.613421 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9abdef4e-b79a-4687-a495-c3e762675897-extensions-socket-volume\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:16:01.613465 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:01.613455 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjx8h\" (UniqueName: \"kubernetes.io/projected/9abdef4e-b79a-4687-a495-c3e762675897-kube-api-access-kjx8h\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:16:02.462819 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:02.462790 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:02.473904 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:16:02.473868 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6jtjl\" is forbidden: User \"system:node:ip-10-0-137-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-249.ec2.internal' and this object" podUID="9abdef4e-b79a-4687-a495-c3e762675897" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:02.480179 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:16:02.480149 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6jtjl\" is forbidden: User \"system:node:ip-10-0-137-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-249.ec2.internal' and this object" podUID="9abdef4e-b79a-4687-a495-c3e762675897" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jtjl" Jul 23 00:16:02.654500 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:02.654468 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9abdef4e-b79a-4687-a495-c3e762675897" path="/var/lib/kubelet/pods/9abdef4e-b79a-4687-a495-c3e762675897/volumes" Jul 23 00:16:04.135919 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:04.135880 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:04.236894 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:04.236858 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:06.675978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:06.675945 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:06.776751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:06.776712 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:10.468406 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:10.468295 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:10.526120 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:10.526084 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:21.857477 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:21.857443 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:21.958268 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:21.958203 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:22.472073 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:22.472038 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:22.573688 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:22.573656 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:24.072677 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:24.072642 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:24.188184 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:24.188145 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:32.790855 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:32.790822 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:32.853918 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:32.853882 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:47.051515 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.051479 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:47.182314 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.182279 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:47.281954 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.281919 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:47.350029 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.349949 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:16:47.353307 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.353283 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" Jul 23 00:16:47.355462 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.355436 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 23 00:16:47.355597 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.355462 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mrkb7\"" Jul 23 00:16:47.362262 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.362237 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:16:47.391397 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.391356 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:16:47.407212 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.407182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk7nd\" (UniqueName: \"kubernetes.io/projected/18c00224-e54b-47a4-aab5-7fbcfc68beed-kube-api-access-vk7nd\") pod \"limitador-limitador-54d6d988d5-tkk65\" (UID: \"18c00224-e54b-47a4-aab5-7fbcfc68beed\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" Jul 23 00:16:47.407365 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.407284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/18c00224-e54b-47a4-aab5-7fbcfc68beed-config-file\") pod \"limitador-limitador-54d6d988d5-tkk65\" (UID: \"18c00224-e54b-47a4-aab5-7fbcfc68beed\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" Jul 23 00:16:47.508001 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.507962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/18c00224-e54b-47a4-aab5-7fbcfc68beed-config-file\") pod \"limitador-limitador-54d6d988d5-tkk65\" (UID: \"18c00224-e54b-47a4-aab5-7fbcfc68beed\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" Jul 23 00:16:47.508191 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.508020 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk7nd\" (UniqueName: \"kubernetes.io/projected/18c00224-e54b-47a4-aab5-7fbcfc68beed-kube-api-access-vk7nd\") pod \"limitador-limitador-54d6d988d5-tkk65\" (UID: \"18c00224-e54b-47a4-aab5-7fbcfc68beed\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" Jul 23 00:16:47.508630 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.508610 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/18c00224-e54b-47a4-aab5-7fbcfc68beed-config-file\") pod \"limitador-limitador-54d6d988d5-tkk65\" (UID: \"18c00224-e54b-47a4-aab5-7fbcfc68beed\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" Jul 23 00:16:47.516211 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.516188 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk7nd\" (UniqueName: \"kubernetes.io/projected/18c00224-e54b-47a4-aab5-7fbcfc68beed-kube-api-access-vk7nd\") pod \"limitador-limitador-54d6d988d5-tkk65\" (UID: \"18c00224-e54b-47a4-aab5-7fbcfc68beed\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" Jul 23 00:16:47.664179 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.664082 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" Jul 23 00:16:47.795599 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.795525 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:16:47.798966 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:16:47.798929 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c00224_e54b_47a4_aab5_7fbcfc68beed.slice/crio-4e863d7e7b63cd36e4b1531ad030ac25b8d7fd4b96a4eeeea0b2f263479e1fb2 WatchSource:0}: Error finding container 4e863d7e7b63cd36e4b1531ad030ac25b8d7fd4b96a4eeeea0b2f263479e1fb2: Status 404 returned error can't find the container with id 4e863d7e7b63cd36e4b1531ad030ac25b8d7fd4b96a4eeeea0b2f263479e1fb2 Jul 23 00:16:47.830733 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.830698 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-qz79r"] Jul 23 00:16:47.835258 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.835228 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qz79r" Jul 23 00:16:47.837218 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.837194 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-btg5v\"" Jul 23 00:16:47.840780 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.840755 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qz79r"] Jul 23 00:16:47.899924 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.899895 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:47.910906 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.910874 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b52sm\" (UniqueName: \"kubernetes.io/projected/22b6ade0-5d32-4c3b-b641-bbf159f91da2-kube-api-access-b52sm\") pod \"authorino-58cd955675-qz79r\" (UID: \"22b6ade0-5d32-4c3b-b641-bbf159f91da2\") " pod="kuadrant-system/authorino-58cd955675-qz79r" Jul 23 00:16:47.995623 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:47.995590 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:48.011378 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:48.011348 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b52sm\" (UniqueName: \"kubernetes.io/projected/22b6ade0-5d32-4c3b-b641-bbf159f91da2-kube-api-access-b52sm\") pod \"authorino-58cd955675-qz79r\" (UID: \"22b6ade0-5d32-4c3b-b641-bbf159f91da2\") " pod="kuadrant-system/authorino-58cd955675-qz79r" Jul 23 00:16:48.021068 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:48.021040 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b52sm\" (UniqueName: \"kubernetes.io/projected/22b6ade0-5d32-4c3b-b641-bbf159f91da2-kube-api-access-b52sm\") pod \"authorino-58cd955675-qz79r\" (UID: \"22b6ade0-5d32-4c3b-b641-bbf159f91da2\") " pod="kuadrant-system/authorino-58cd955675-qz79r" Jul 23 00:16:48.146810 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:48.146765 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qz79r" Jul 23 00:16:48.290863 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:48.290787 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qz79r"] Jul 23 00:16:48.294184 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:16:48.294161 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22b6ade0_5d32_4c3b_b641_bbf159f91da2.slice/crio-f1e13fba938794c92f0997407e2733faffe411af9ca066b17caff359e9474aa8 WatchSource:0}: Error finding container f1e13fba938794c92f0997407e2733faffe411af9ca066b17caff359e9474aa8: Status 404 returned error can't find the container with id f1e13fba938794c92f0997407e2733faffe411af9ca066b17caff359e9474aa8 Jul 23 00:16:48.662436 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:48.662332 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qz79r" event={"ID":"22b6ade0-5d32-4c3b-b641-bbf159f91da2","Type":"ContainerStarted","Data":"f1e13fba938794c92f0997407e2733faffe411af9ca066b17caff359e9474aa8"} Jul 23 00:16:48.664186 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:48.664157 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" event={"ID":"18c00224-e54b-47a4-aab5-7fbcfc68beed","Type":"ContainerStarted","Data":"4e863d7e7b63cd36e4b1531ad030ac25b8d7fd4b96a4eeeea0b2f263479e1fb2"} Jul 23 00:16:49.942956 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:49.942905 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:16:52.089788 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:52.089743 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qz79r"] Jul 23 00:16:52.686351 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:52.686242 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qz79r" event={"ID":"22b6ade0-5d32-4c3b-b641-bbf159f91da2","Type":"ContainerStarted","Data":"b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d"} Jul 23 00:16:52.686351 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:52.686257 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-qz79r" podUID="22b6ade0-5d32-4c3b-b641-bbf159f91da2" containerName="authorino" containerID="cri-o://b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d" gracePeriod=30 Jul 23 00:16:52.687680 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:52.687647 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" event={"ID":"18c00224-e54b-47a4-aab5-7fbcfc68beed","Type":"ContainerStarted","Data":"4ecd1cf02cabc4dec77c438f8f77dcce9a4d6d696e6be7a1727c849849d3a3e1"} Jul 23 00:16:52.687840 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:52.687771 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" Jul 23 00:16:52.701027 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:52.700980 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-qz79r" podStartSLOduration=1.638880243 podStartE2EDuration="5.70096483s" totalImagesPullingTime="4.062084587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:16:52.69916708 +0000 UTC m=+754.563336253" watchObservedRunningTime="2026-07-23 00:16:52.70096483 +0000 UTC m=+754.565134002" Jul 23 00:16:52.714707 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:52.714657 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" podStartSLOduration=1.158522117 podStartE2EDuration="5.714642158s" totalImagesPullingTime="4.556120041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:16:52.713629348 +0000 UTC m=+754.577798520" watchObservedRunningTime="2026-07-23 00:16:52.714642158 +0000 UTC m=+754.578811329" Jul 23 00:16:52.944557 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:52.944488 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qz79r" Jul 23 00:16:52.956964 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:52.956926 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b52sm\" (UniqueName: \"kubernetes.io/projected/22b6ade0-5d32-4c3b-b641-bbf159f91da2-kube-api-access-b52sm\") pod \"22b6ade0-5d32-4c3b-b641-bbf159f91da2\" (UID: \"22b6ade0-5d32-4c3b-b641-bbf159f91da2\") " Jul 23 00:16:52.959517 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:52.959487 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22b6ade0-5d32-4c3b-b641-bbf159f91da2-kube-api-access-b52sm" (OuterVolumeSpecName: "kube-api-access-b52sm") pod "22b6ade0-5d32-4c3b-b641-bbf159f91da2" (UID: "22b6ade0-5d32-4c3b-b641-bbf159f91da2"). InnerVolumeSpecName "kube-api-access-b52sm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 00:16:53.058244 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:53.058193 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b52sm\" (UniqueName: \"kubernetes.io/projected/22b6ade0-5d32-4c3b-b641-bbf159f91da2-kube-api-access-b52sm\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:16:53.692920 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:53.692834 2574 generic.go:356] "Generic (PLEG): container finished" podID="22b6ade0-5d32-4c3b-b641-bbf159f91da2" containerID="b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d" exitCode=0 Jul 23 00:16:53.692920 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:53.692879 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qz79r" Jul 23 00:16:53.693433 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:53.692918 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qz79r" event={"ID":"22b6ade0-5d32-4c3b-b641-bbf159f91da2","Type":"ContainerDied","Data":"b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d"} Jul 23 00:16:53.693433 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:53.692958 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qz79r" event={"ID":"22b6ade0-5d32-4c3b-b641-bbf159f91da2","Type":"ContainerDied","Data":"f1e13fba938794c92f0997407e2733faffe411af9ca066b17caff359e9474aa8"} Jul 23 00:16:53.693433 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:53.692977 2574 scope.go:117] "RemoveContainer" containerID="b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d" Jul 23 00:16:53.700955 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:53.700938 2574 scope.go:117] "RemoveContainer" containerID="b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d" Jul 23 00:16:53.701280 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:16:53.701261 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d\": container with ID starting with b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d not found: ID does not exist" containerID="b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d" Jul 23 00:16:53.701324 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:53.701289 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d"} err="failed to get container status \"b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d\": rpc error: code = NotFound desc = could not find container \"b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d\": container with ID starting with b60c948987d3cd4623def8456e3f88cbdd4533d60af37efb1b9fa7b0fb58d73d not found: ID does not exist" Jul 23 00:16:53.712729 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:53.712700 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qz79r"] Jul 23 00:16:53.716345 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:53.716321 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-qz79r"] Jul 23 00:16:54.657803 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:16:54.657753 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22b6ade0-5d32-4c3b-b641-bbf159f91da2" path="/var/lib/kubelet/pods/22b6ade0-5d32-4c3b-b641-bbf159f91da2/volumes" Jul 23 00:17:03.694062 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:17:03.694033 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tkk65" Jul 23 00:17:09.050402 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:17:09.050352 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:17:09.147963 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:17:09.147928 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:17:09.523222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:17:09.523176 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:17:21.060338 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:17:21.060297 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:17:21.655039 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:17:21.654976 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:17:28.946259 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:17:28.946210 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:17:29.045833 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:17:29.045778 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:17:29.137076 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:17:29.136999 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:17:32.093286 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:17:32.093255 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:17:32.369429 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:17:32.369330 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:03.788849 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:03.788764 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:03.889619 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:03.889582 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:04.391351 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:04.391316 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:04.545942 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:04.545904 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:04.831918 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:04.831890 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:04.908582 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:04.908543 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:05.016521 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:05.016485 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:18:15.128238 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:15.128199 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:15.228847 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:15.228811 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:21.766541 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:21.766506 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:22.252310 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:22.252277 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:18:26.377914 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:26.377879 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:27.332919 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:27.332882 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:18:35.940665 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:35.940633 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm"] Jul 23 00:18:35.941073 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:35.940951 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22b6ade0-5d32-4c3b-b641-bbf159f91da2" containerName="authorino" Jul 23 00:18:35.941073 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:35.940962 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="22b6ade0-5d32-4c3b-b641-bbf159f91da2" containerName="authorino" Jul 23 00:18:35.941073 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:35.941022 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="22b6ade0-5d32-4c3b-b641-bbf159f91da2" containerName="authorino" Jul 23 00:18:35.943426 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:35.943377 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:35.945744 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:35.945723 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 23 00:18:35.946569 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:35.946552 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xwdgp\"" Jul 23 00:18:35.946653 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:35.946595 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 23 00:18:35.946721 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:35.946663 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 23 00:18:35.951598 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:35.951573 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm"] Jul 23 00:18:35.968990 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:35.968961 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:36.125730 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.125682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/095546e1-0e33-455d-824b-de4bc6aaa972-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.125730 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.125733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/095546e1-0e33-455d-824b-de4bc6aaa972-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.125974 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.125773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l54h2\" (UniqueName: \"kubernetes.io/projected/095546e1-0e33-455d-824b-de4bc6aaa972-kube-api-access-l54h2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.125974 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.125799 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/095546e1-0e33-455d-824b-de4bc6aaa972-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.125974 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.125822 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/095546e1-0e33-455d-824b-de4bc6aaa972-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.125974 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.125854 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/095546e1-0e33-455d-824b-de4bc6aaa972-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.227323 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.227232 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/095546e1-0e33-455d-824b-de4bc6aaa972-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.227323 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.227274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/095546e1-0e33-455d-824b-de4bc6aaa972-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.227323 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.227303 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l54h2\" (UniqueName: \"kubernetes.io/projected/095546e1-0e33-455d-824b-de4bc6aaa972-kube-api-access-l54h2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.227628 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.227329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/095546e1-0e33-455d-824b-de4bc6aaa972-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.227628 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.227359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/095546e1-0e33-455d-824b-de4bc6aaa972-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.227628 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.227412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/095546e1-0e33-455d-824b-de4bc6aaa972-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.227784 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.227719 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/095546e1-0e33-455d-824b-de4bc6aaa972-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.227839 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.227803 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/095546e1-0e33-455d-824b-de4bc6aaa972-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.227839 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.227816 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/095546e1-0e33-455d-824b-de4bc6aaa972-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.229589 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.229558 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/095546e1-0e33-455d-824b-de4bc6aaa972-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.229820 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.229800 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/095546e1-0e33-455d-824b-de4bc6aaa972-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.234956 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.234931 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l54h2\" (UniqueName: \"kubernetes.io/projected/095546e1-0e33-455d-824b-de4bc6aaa972-kube-api-access-l54h2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bgpvm\" (UID: \"095546e1-0e33-455d-824b-de4bc6aaa972\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.254805 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.254773 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:36.387618 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.387595 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm"] Jul 23 00:18:36.389662 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:18:36.389633 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095546e1_0e33_455d_824b_de4bc6aaa972.slice/crio-1db8efc5f3c357893cbc26f6d6a2331915cdeb7904022ba19907fa423d676480 WatchSource:0}: Error finding container 1db8efc5f3c357893cbc26f6d6a2331915cdeb7904022ba19907fa423d676480: Status 404 returned error can't find the container with id 1db8efc5f3c357893cbc26f6d6a2331915cdeb7904022ba19907fa423d676480 Jul 23 00:18:36.391467 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:36.391445 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 00:18:37.124270 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:37.124226 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:18:37.137807 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:37.137773 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" event={"ID":"095546e1-0e33-455d-824b-de4bc6aaa972","Type":"ContainerStarted","Data":"1db8efc5f3c357893cbc26f6d6a2331915cdeb7904022ba19907fa423d676480"} Jul 23 00:18:38.144009 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:38.143978 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" event={"ID":"095546e1-0e33-455d-824b-de4bc6aaa972","Type":"ContainerStarted","Data":"d84c4f4308c63639478768527f50da8113500c59f3367fe07ba26a6c074b9cbb"} Jul 23 00:18:38.159835 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:38.159785 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" podStartSLOduration=2.170482926 podStartE2EDuration="3.159764086s" totalImagesPullingTime="989.28116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:18:38.159298253 +0000 UTC m=+860.023467445" watchObservedRunningTime="2026-07-23 00:18:38.159764086 +0000 UTC m=+860.023933258" Jul 23 00:18:40.430857 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:40.430821 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:41.330597 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:41.330562 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:18:46.255102 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:46.255063 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:46.255642 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:46.255144 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:46.268020 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:46.267988 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:47.198369 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:47.198343 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bgpvm" Jul 23 00:18:47.853457 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:47.853425 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:47.953798 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:47.953770 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:49.366748 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:49.366717 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:51.485053 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:51.485019 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:54.028892 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:54.028857 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:18:59.449897 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.449865 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv"] Jul 23 00:18:59.453158 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.453140 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.455762 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.455739 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 23 00:18:59.462694 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.462665 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv"] Jul 23 00:18:59.469614 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.469587 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:18:59.516599 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.516564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb531b79-620b-40bc-acab-5fde4760e0d5-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.516808 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.516653 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb531b79-620b-40bc-acab-5fde4760e0d5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.516808 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.516680 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c76pn\" (UniqueName: \"kubernetes.io/projected/bb531b79-620b-40bc-acab-5fde4760e0d5-kube-api-access-c76pn\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.516808 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.516719 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb531b79-620b-40bc-acab-5fde4760e0d5-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.516808 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.516744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb531b79-620b-40bc-acab-5fde4760e0d5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.516808 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.516767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb531b79-620b-40bc-acab-5fde4760e0d5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.617507 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.617470 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb531b79-620b-40bc-acab-5fde4760e0d5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.617507 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.617508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c76pn\" (UniqueName: \"kubernetes.io/projected/bb531b79-620b-40bc-acab-5fde4760e0d5-kube-api-access-c76pn\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.617755 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.617541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb531b79-620b-40bc-acab-5fde4760e0d5-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.617755 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.617559 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb531b79-620b-40bc-acab-5fde4760e0d5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.617755 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.617580 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb531b79-620b-40bc-acab-5fde4760e0d5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.617755 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.617612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb531b79-620b-40bc-acab-5fde4760e0d5-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.617975 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.617908 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb531b79-620b-40bc-acab-5fde4760e0d5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.617975 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.617948 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb531b79-620b-40bc-acab-5fde4760e0d5-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.618135 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.618110 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb531b79-620b-40bc-acab-5fde4760e0d5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.619937 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.619914 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb531b79-620b-40bc-acab-5fde4760e0d5-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.620204 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.620185 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb531b79-620b-40bc-acab-5fde4760e0d5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.624539 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.624515 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c76pn\" (UniqueName: \"kubernetes.io/projected/bb531b79-620b-40bc-acab-5fde4760e0d5-kube-api-access-c76pn\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g4brv\" (UID: \"bb531b79-620b-40bc-acab-5fde4760e0d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.763548 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.763509 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:18:59.894797 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:18:59.894768 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv"] Jul 23 00:18:59.897161 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:18:59.897123 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb531b79_620b_40bc_acab_5fde4760e0d5.slice/crio-35bbe531da07ee5156317f643827a69bd1e2cfac18e68b4730c12df51cb9dc94 WatchSource:0}: Error finding container 35bbe531da07ee5156317f643827a69bd1e2cfac18e68b4730c12df51cb9dc94: Status 404 returned error can't find the container with id 35bbe531da07ee5156317f643827a69bd1e2cfac18e68b4730c12df51cb9dc94 Jul 23 00:19:00.244877 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:00.244840 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" event={"ID":"bb531b79-620b-40bc-acab-5fde4760e0d5","Type":"ContainerStarted","Data":"867c79d90ec3439f3551f3b8d5328b380deddedfe436230872c8de8160b7320a"} Jul 23 00:19:00.244877 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:00.244881 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" event={"ID":"bb531b79-620b-40bc-acab-5fde4760e0d5","Type":"ContainerStarted","Data":"35bbe531da07ee5156317f643827a69bd1e2cfac18e68b4730c12df51cb9dc94"} Jul 23 00:19:00.263094 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:00.263043 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" podStartSLOduration=1.076579374 podStartE2EDuration="1.263024142s" totalImagesPullingTime="186.444768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:19:00.262069995 +0000 UTC m=+882.126239168" watchObservedRunningTime="2026-07-23 00:19:00.263024142 +0000 UTC m=+882.127193314" Jul 23 00:19:02.839337 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:02.839304 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:19:09.763664 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:09.763624 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:19:09.763664 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:09.763668 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:19:09.776410 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:09.776353 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:19:10.298400 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:10.298360 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g4brv" Jul 23 00:19:18.577327 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:18.577294 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:19:18.577761 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:18.577727 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:19:47.192625 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:47.192586 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:19:59.513021 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.512986 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d9766f9c7-k2n92"] Jul 23 00:19:59.516120 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.516095 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9766f9c7-k2n92" Jul 23 00:19:59.519149 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.519124 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 23 00:19:59.519302 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.519148 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-btg5v\"" Jul 23 00:19:59.522732 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.522703 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d9766f9c7-k2n92"] Jul 23 00:19:59.629093 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.629057 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrswh\" (UniqueName: \"kubernetes.io/projected/3fee2e83-ef5f-4535-bddf-3fec69a5f28f-kube-api-access-rrswh\") pod \"authorino-d9766f9c7-k2n92\" (UID: \"3fee2e83-ef5f-4535-bddf-3fec69a5f28f\") " pod="kuadrant-system/authorino-d9766f9c7-k2n92" Jul 23 00:19:59.629272 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.629136 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3fee2e83-ef5f-4535-bddf-3fec69a5f28f-tls-cert\") pod \"authorino-d9766f9c7-k2n92\" (UID: \"3fee2e83-ef5f-4535-bddf-3fec69a5f28f\") " pod="kuadrant-system/authorino-d9766f9c7-k2n92" Jul 23 00:19:59.730210 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.730165 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3fee2e83-ef5f-4535-bddf-3fec69a5f28f-tls-cert\") pod \"authorino-d9766f9c7-k2n92\" (UID: \"3fee2e83-ef5f-4535-bddf-3fec69a5f28f\") " pod="kuadrant-system/authorino-d9766f9c7-k2n92" Jul 23 00:19:59.730457 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.730251 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrswh\" (UniqueName: \"kubernetes.io/projected/3fee2e83-ef5f-4535-bddf-3fec69a5f28f-kube-api-access-rrswh\") pod \"authorino-d9766f9c7-k2n92\" (UID: \"3fee2e83-ef5f-4535-bddf-3fec69a5f28f\") " pod="kuadrant-system/authorino-d9766f9c7-k2n92" Jul 23 00:19:59.733480 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.733441 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3fee2e83-ef5f-4535-bddf-3fec69a5f28f-tls-cert\") pod \"authorino-d9766f9c7-k2n92\" (UID: \"3fee2e83-ef5f-4535-bddf-3fec69a5f28f\") " pod="kuadrant-system/authorino-d9766f9c7-k2n92" Jul 23 00:19:59.739039 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.738993 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:19:59.741512 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.741481 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrswh\" (UniqueName: \"kubernetes.io/projected/3fee2e83-ef5f-4535-bddf-3fec69a5f28f-kube-api-access-rrswh\") pod \"authorino-d9766f9c7-k2n92\" (UID: \"3fee2e83-ef5f-4535-bddf-3fec69a5f28f\") " pod="kuadrant-system/authorino-d9766f9c7-k2n92" Jul 23 00:19:59.827072 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.826979 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9766f9c7-k2n92" Jul 23 00:19:59.837346 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.837316 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:19:59.966463 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:19:59.966436 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d9766f9c7-k2n92"] Jul 23 00:19:59.968950 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:19:59.968918 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fee2e83_ef5f_4535_bddf_3fec69a5f28f.slice/crio-2cdd29a1df352d840751d635ddb0d070748a65f0ac133e7c7c67b9cb859b97c5 WatchSource:0}: Error finding container 2cdd29a1df352d840751d635ddb0d070748a65f0ac133e7c7c67b9cb859b97c5: Status 404 returned error can't find the container with id 2cdd29a1df352d840751d635ddb0d070748a65f0ac133e7c7c67b9cb859b97c5 Jul 23 00:20:00.505726 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:20:00.505687 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d9766f9c7-k2n92" event={"ID":"3fee2e83-ef5f-4535-bddf-3fec69a5f28f","Type":"ContainerStarted","Data":"2cdd29a1df352d840751d635ddb0d070748a65f0ac133e7c7c67b9cb859b97c5"} Jul 23 00:20:00.883715 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:20:00.883619 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:20:01.030011 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:20:01.029966 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:20:01.513976 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:20:01.513934 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d9766f9c7-k2n92" event={"ID":"3fee2e83-ef5f-4535-bddf-3fec69a5f28f","Type":"ContainerStarted","Data":"495f22eb0f3d3916ee6ef9a71a5dd11c09c47bfbd6d2fc7e2e057cd664e8364f"} Jul 23 00:20:01.536028 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:20:01.535970 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d9766f9c7-k2n92" podStartSLOduration=1.995613551 podStartE2EDuration="2.535951968s" totalImagesPullingTime="540.338417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:20:01.535831788 +0000 UTC m=+943.400000960" watchObservedRunningTime="2026-07-23 00:20:01.535951968 +0000 UTC m=+943.400121141" Jul 23 00:20:29.132022 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:20:29.131972 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:20:38.617964 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:20:38.617925 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:20:46.016542 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:20:46.016462 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:20:48.834121 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:20:48.834084 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:21:45.692738 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:21:45.692700 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:05.692080 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:05.692038 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:06.801857 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:06.801826 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:07.496843 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:07.496804 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:14.606047 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:14.606010 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:31.628519 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:31.628478 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:22:42.125334 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:42.125290 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:22:47.776746 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:47.776705 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:47.876817 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:47.876782 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:48.175000 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:48.174915 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:53.844624 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:53.844590 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:53.919424 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:53.919366 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:54.047252 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:54.047215 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:54.182927 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:54.182838 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:54.449261 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:54.449171 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:22:59.921143 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:22:59.921103 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:23:00.173938 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:23:00.173842 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:23:00.274128 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:23:00.274088 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:23:17.132958 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:23:17.132922 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:23:26.921497 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:23:26.921467 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:23:35.437928 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:23:35.437887 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:23:47.533984 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:23:47.533906 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:23:58.737912 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:23:58.737874 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:24:08.051626 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:24:08.051583 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:24:18.604672 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:24:18.604634 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:24:18.606034 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:24:18.605989 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:24:19.027781 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:24:19.027746 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:24:28.556489 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:24:28.556448 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:24:51.573642 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:24:51.573606 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:25:03.644625 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:25:03.644591 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:25:18.116572 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:25:18.116492 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:25:28.166714 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:25:28.166672 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:25:40.862045 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:25:40.862004 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:25:58.136828 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:25:58.136795 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:26:00.197213 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:26:00.197169 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:26:07.934213 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:26:07.934177 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:26:17.135204 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:26:17.135164 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:26:26.526614 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:26:26.526575 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:26:35.133130 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:26:35.133090 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:26:58.396008 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:26:58.395917 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:28:23.040229 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:28:23.040181 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:28:34.870592 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:28:34.870557 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:28:45.544687 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:28:45.544647 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:28:59.373413 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:28:59.373361 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:29:05.763492 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:29:05.763452 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:29:09.568349 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:29:09.568308 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:29:18.633042 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:29:18.633012 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:29:18.635596 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:29:18.635567 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:29:20.744285 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:29:20.744240 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:29:28.373507 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:29:28.373469 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:29:39.430132 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:29:39.430097 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:29:50.041576 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:29:50.041531 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:29:50.535480 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:29:50.535443 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:29:59.739567 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:29:59.739528 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:30:10.733004 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:30:10.732963 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:30:14.729212 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:30:14.729175 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:30:35.640100 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:30:35.640063 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:30:40.889282 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:30:40.889242 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:30:43.968502 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:30:43.968467 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:30:44.443063 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:30:44.443016 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:30:58.739829 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:30:58.739794 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:31:16.896489 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:31:16.896454 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:31:17.782925 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:31:17.782891 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:31:20.840220 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:31:20.840181 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:31:34.755899 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:31:34.755866 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:31:41.633201 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:31:41.633159 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:31:57.752495 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:31:57.752453 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:32:07.599623 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:32:07.599583 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:32:12.601482 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:32:12.601445 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:32:22.034076 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:32:22.034041 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:32:35.128832 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:32:35.128797 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:32:44.227734 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:32:44.227640 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:32:58.376945 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:32:58.376909 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:33:07.331003 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:33:07.330961 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:33:17.235287 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:33:17.235251 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:33:29.062917 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:33:29.062880 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:33:40.680362 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:33:40.680323 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:33:49.754469 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:33:49.754427 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:34:02.241705 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:34:02.241666 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:34:15.247779 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:34:15.247687 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:34:18.666802 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:34:18.666773 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:34:18.670012 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:34:18.669989 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:34:28.025308 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:34:28.025274 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:34:30.697473 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:34:30.697435 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:34:36.731591 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:34:36.731555 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:34:54.272322 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:34:54.272283 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:34:57.450477 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:34:57.450446 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:34:58.897229 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:34:58.897193 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:34:59.333203 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:34:59.333138 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:34:59.434206 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:34:59.434166 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:03.827826 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:03.827791 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:03.927735 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:03.927705 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:04.106163 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:04.106085 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:04.410689 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:04.410606 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:04.509823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:04.509793 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:07.169185 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:07.169149 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:07.280577 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:07.280547 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:07.376934 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:07.376897 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:07.841946 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:07.841915 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:07.979725 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:07.979682 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:08.074064 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:08.074030 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:13.970458 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:13.970426 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:35:43.379985 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:43.379893 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:46.131982 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:46.131939 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:35:47.889674 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:47.889639 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:48.065462 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:48.065428 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:48.308895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:48.308856 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:48.610821 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:48.610714 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:48.699531 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:48.699478 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:48.797454 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:48.797416 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:49.232840 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:49.232807 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:49.501335 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:49.501253 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:51.462209 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:51.462172 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:51.570517 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:51.570478 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:51.683768 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:51.683735 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:52.166290 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:52.166258 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:52.261079 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:52.261052 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:35:58.743111 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:35:58.743076 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:36:27.083059 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:27.083025 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:29.827245 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:29.827208 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:36:31.600294 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:31.600203 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:31.782397 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:31.782351 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:32.026762 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:32.026726 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:32.314629 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:32.314534 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:32.598640 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:32.598549 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:32.827175 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:32.827139 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:34.675600 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:34.675564 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:34.775078 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:34.775037 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:34.855469 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:34.855431 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:35.106095 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:35.106060 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:35.405751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:35.405661 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:35.507357 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:35.507324 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:36:41.971553 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:41.971519 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:36:57.583214 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:36:57.583177 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:11.236659 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:11.236574 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:14.126805 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:14.126767 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:37:15.573245 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:15.573213 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:16.895496 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:16.895454 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:17.135426 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:17.135375 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:17.368983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:17.368949 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:20.229605 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:20.229573 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:20.377327 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:20.377290 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:20.504404 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:20.504296 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:21.089559 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:21.089523 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:21.243858 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:21.243825 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:21.477539 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:21.477457 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:21.587263 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:21.587223 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:26.353935 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:26.353902 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:37:30.127378 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:30.127340 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:30.221186 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:30.221149 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:43.224268 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:43.224229 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:43.323533 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:43.323498 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:55.598777 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:55.598741 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:37:58.427505 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:58.427466 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:37:59.922942 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:37:59.922906 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:00.124644 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:00.124603 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:00.347327 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:00.347272 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:00.903195 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:00.903161 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:01.017149 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:01.017107 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:02.675484 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:02.675450 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:08.767659 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:08.767623 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:08.880110 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:08.880072 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:08.983898 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:08.983845 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:12.144157 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:12.144113 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:12.265063 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:12.265028 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:35.662242 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:35.662203 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:43.213557 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:43.213466 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:43.325586 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:43.325541 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:43.421415 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:43.421352 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:38:59.456744 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:38:59.456708 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:05.265284 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:05.265243 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:05.370184 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:05.370137 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:05.484065 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:05.484030 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:16.101631 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:16.101591 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:16.942606 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:16.942572 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:18.701282 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:18.701253 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:39:18.705348 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:18.705325 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:39:23.101244 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:23.101204 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:23.208035 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:23.208000 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:23.303658 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:23.303611 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:23.403124 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:23.403038 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:24.578084 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:24.578048 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:24.706061 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:24.706028 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:27.138959 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:27.138917 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:39:31.612465 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:31.612424 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:37.744432 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:37.744375 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:39:38.010796 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:38.010668 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:40.825695 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:40.825660 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:40.926813 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:40.926763 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:44.559614 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:44.559577 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:44.654803 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:44.654766 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:44.804988 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:44.804954 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:45.170417 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:45.170371 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:45.269136 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:45.269087 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:48.183134 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:48.183077 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:48.354973 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:48.354935 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:48.461066 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:48.460965 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:48.544872 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:48.544835 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:39:48.663038 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:48.663005 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:48.957128 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:48.957089 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:49.059975 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:49.059935 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:52.730296 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:52.730259 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:53.459497 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:53.459456 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:53.565493 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:53.565458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:53.930796 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:53.930732 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:57.229718 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:57.229680 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:39:59.802608 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:59.802572 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:39:59.897993 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:39:59.897961 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:10.683952 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:10.683865 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:13.331074 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:13.331033 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:40:15.351479 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:15.351435 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:15.772294 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:15.772243 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:21.513879 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:21.513847 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:21.619670 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:21.619622 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:21.846607 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:21.846493 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:22.069530 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:22.069492 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:22.202740 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:22.202640 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:22.303554 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:22.303518 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:22.439672 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:22.439640 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:28.376749 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:28.376691 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:28.439238 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:28.439201 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:28.530775 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:28.530737 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:28.632959 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:28.632874 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:28.783632 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:28.783599 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:34.645588 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:34.645545 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:34.710449 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:34.710372 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:41.634812 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:41.634781 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:42.000638 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:42.000600 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:42.247200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:42.247165 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:45.448948 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:45.448917 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:46.904447 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:46.904405 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:50.004605 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:50.004565 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:40:51.630669 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:40:51.630629 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:41:08.690034 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:41:08.689996 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:41:11.831261 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:41:11.831230 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:41:26.833879 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:41:26.833834 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:41:47.737751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:41:47.737667 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:41:49.381610 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:41:49.381554 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:41:53.906608 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:41:53.906575 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:41:56.303458 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:41:56.303416 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:41:57.732910 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:41:57.732873 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:42:01.373133 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:01.373097 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:31.021656 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:31.021619 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:31.118726 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:31.118692 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:38.531018 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:38.530982 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:39.445561 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:39.445523 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:45.655780 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:45.655746 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:45.756574 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:45.756543 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:45.857193 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:45.857158 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:46.959229 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:46.959195 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:47.063305 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:47.063274 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:47.973677 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:47.973646 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:48.063015 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:48.062983 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:48.166948 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:48.166912 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:49.654999 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:49.654968 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:56.343398 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:56.343335 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:42:57.180052 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:57.180011 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:42:57.282972 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:42:57.282943 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:02.952976 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:02.952914 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:03.059935 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:03.059881 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:03.156477 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:03.156444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:04.642397 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:04.642342 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:43:13.813062 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:13.812972 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:14.097935 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:14.097836 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:24.757658 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:24.757599 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:24.858704 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:24.858668 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:35.184963 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:35.184924 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:42.542137 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:42.542100 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:42.644525 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:42.644481 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:42.926157 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:42.926073 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:43.402126 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:43.402096 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:43.624528 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:43.624491 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:45.892059 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:45.892020 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:46.644052 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:46.644010 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:46.822953 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:46.822918 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:46.974663 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:46.974579 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:47.338667 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:47.338637 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:48.043160 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:48.043124 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:48.159278 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:48.159239 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:50.854225 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:50.854188 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:43:51.092925 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:51.092890 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:51.454844 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:51.454810 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:51.883315 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:51.883272 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:51.970006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:51.969955 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:54.386134 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:54.386098 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:54.481002 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:54.480969 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:54.614963 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:54.614923 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:54.990946 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:54.990915 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:55.337997 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:55.337896 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:55.437974 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:55.437941 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:43:58.913268 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:43:58.913216 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:44:03.563310 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.563275 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr"] Jul 23 00:44:03.566560 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.566541 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.570160 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.570108 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e94467\"/\"kube-root-ca.crt\"" Jul 23 00:44:03.570160 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.570125 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e94467\"/\"default-dockercfg-sx9pt\"" Jul 23 00:44:03.570160 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.570105 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e94467\"/\"openshift-service-ca.crt\"" Jul 23 00:44:03.570458 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.570108 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e94467\"/\"test-model-e94467-kserve-self-signed-certs\"" Jul 23 00:44:03.580607 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.580580 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr"] Jul 23 00:44:03.590088 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.590062 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:44:03.656103 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.656061 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbrzk\" (UniqueName: \"kubernetes.io/projected/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-kube-api-access-tbrzk\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.656103 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.656106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-tls-certs\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.656330 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.656130 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-home\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.656330 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.656201 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-tmp-dir\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.656330 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.656298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-dshm\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.656467 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.656351 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-model-cache\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.757178 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.757136 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-model-cache\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.757178 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.757180 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbrzk\" (UniqueName: \"kubernetes.io/projected/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-kube-api-access-tbrzk\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.757514 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.757207 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-tls-certs\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.757514 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.757238 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-home\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.757514 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.757257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-tmp-dir\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.757514 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.757321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-dshm\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.757729 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.757647 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-model-cache\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.757729 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.757715 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-tmp-dir\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.757834 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.757819 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-home\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.759675 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.759657 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-dshm\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.759765 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.759751 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-tls-certs\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.766544 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.766518 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbrzk\" (UniqueName: \"kubernetes.io/projected/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-kube-api-access-tbrzk\") pod \"test-model-e94467-kserve-68cf7f5b59-rbdvr\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:03.875950 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:03.875850 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:04.012344 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:04.012316 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr"] Jul 23 00:44:04.014495 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:44:04.014462 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac2e1d4b_3c7c_4a33_a0c4_9dbbadf068a1.slice/crio-62d166d60894acf5572a3428af99a46bbea0f3491659a0ba8b7d601f56735459 WatchSource:0}: Error finding container 62d166d60894acf5572a3428af99a46bbea0f3491659a0ba8b7d601f56735459: Status 404 returned error can't find the container with id 62d166d60894acf5572a3428af99a46bbea0f3491659a0ba8b7d601f56735459 Jul 23 00:44:05.002660 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:05.002619 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" event={"ID":"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1","Type":"ContainerStarted","Data":"0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7"} Jul 23 00:44:05.002660 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:05.002664 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" event={"ID":"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1","Type":"ContainerStarted","Data":"62d166d60894acf5572a3428af99a46bbea0f3491659a0ba8b7d601f56735459"} Jul 23 00:44:05.031015 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:05.030955 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" podStartSLOduration=2.030938011 podStartE2EDuration="2.030938011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:44:05.027568926 +0000 UTC m=+2386.891738118" watchObservedRunningTime="2026-07-23 00:44:05.030938011 +0000 UTC m=+2386.895107181" Jul 23 00:44:09.128967 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:09.128930 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:44:09.182443 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:09.182399 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:44:09.274474 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:09.274435 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:44:13.876306 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:13.876257 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:13.876752 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:13.876323 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:13.888772 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:13.888742 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:14.053344 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:14.053313 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:44:16.237618 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:16.237587 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:44:16.338514 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:16.338479 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:44:18.728360 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:18.728334 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:44:18.733475 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:18.733448 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:44:37.795213 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:37.795173 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:44:54.249706 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:54.249592 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:44:58.548779 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:58.548723 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:44:58.635671 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:58.635632 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:44:58.652737 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:44:58.652688 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:45:12.059556 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:45:12.059521 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:45:49.623050 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:45:49.623019 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr"] Jul 23 00:45:49.650285 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:45:49.650232 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:45:54.246561 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:45:54.246522 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:45:56.016212 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:45:56.016178 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:01.245735 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:01.245699 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:04.644140 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.644097 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" podUID="ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1" containerName="main" containerID="cri-o://0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7" gracePeriod=45 Jul 23 00:46:04.897291 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.897221 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:46:04.952845 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.952810 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-dshm\") pod \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " Jul 23 00:46:04.952845 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.952862 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbrzk\" (UniqueName: \"kubernetes.io/projected/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-kube-api-access-tbrzk\") pod \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " Jul 23 00:46:04.953115 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.952894 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-tls-certs\") pod \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " Jul 23 00:46:04.953115 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.952925 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-home\") pod \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " Jul 23 00:46:04.953115 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.953043 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-tmp-dir\") pod \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " Jul 23 00:46:04.953287 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.953124 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-model-cache\") pod \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\" (UID: \"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1\") " Jul 23 00:46:04.953287 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.953163 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-home" (OuterVolumeSpecName: "home") pod "ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1" (UID: "ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:46:04.953418 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.953280 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1" (UID: "ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:46:04.953418 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.953360 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-model-cache" (OuterVolumeSpecName: "model-cache") pod "ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1" (UID: "ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:46:04.953528 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.953509 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-home\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:46:04.953572 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.953534 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-tmp-dir\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:46:04.953572 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.953549 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-model-cache\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:46:04.955370 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.955342 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-kube-api-access-tbrzk" (OuterVolumeSpecName: "kube-api-access-tbrzk") pod "ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1" (UID: "ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1"). InnerVolumeSpecName "kube-api-access-tbrzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 00:46:04.955484 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.955342 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-dshm" (OuterVolumeSpecName: "dshm") pod "ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1" (UID: "ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:46:04.955484 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:04.955331 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1" (UID: "ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:46:05.054537 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.054497 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-dshm\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:46:05.054537 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.054542 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbrzk\" (UniqueName: \"kubernetes.io/projected/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-kube-api-access-tbrzk\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:46:05.054754 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.054554 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1-tls-certs\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:46:05.548544 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.548505 2574 generic.go:356] "Generic (PLEG): container finished" podID="ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1" containerID="0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7" exitCode=0 Jul 23 00:46:05.548754 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.548573 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" Jul 23 00:46:05.548754 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.548595 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" event={"ID":"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1","Type":"ContainerDied","Data":"0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7"} Jul 23 00:46:05.548754 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.548641 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr" event={"ID":"ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1","Type":"ContainerDied","Data":"62d166d60894acf5572a3428af99a46bbea0f3491659a0ba8b7d601f56735459"} Jul 23 00:46:05.548754 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.548660 2574 scope.go:117] "RemoveContainer" containerID="0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7" Jul 23 00:46:05.557611 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.557592 2574 scope.go:117] "RemoveContainer" containerID="0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7" Jul 23 00:46:05.557964 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:46:05.557940 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7\": container with ID starting with 0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7 not found: ID does not exist" containerID="0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7" Jul 23 00:46:05.558038 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.557974 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7"} err="failed to get container status \"0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7\": rpc error: code = NotFound desc = could not find container \"0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7\": container with ID starting with 0ba0ddf7ecdd87a8b9e586b35264b33153b6453dcf806440f73e59d3c78d94e7 not found: ID does not exist" Jul 23 00:46:05.570544 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.570515 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr"] Jul 23 00:46:05.574578 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.574550 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-e94467/test-model-e94467-kserve-68cf7f5b59-rbdvr"] Jul 23 00:46:05.821174 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:05.821084 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:06.263434 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:06.263377 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:06.655076 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:06.654993 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1" path="/var/lib/kubelet/pods/ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1/volumes" Jul 23 00:46:06.740418 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:06.740362 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:46:12.239821 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:12.239732 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:12.351727 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:12.351692 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:12.576311 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:12.576213 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:12.790105 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:12.790069 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:13.514212 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:13.514184 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:13.618008 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:13.617969 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:23.427593 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:23.427550 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:26.032275 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:26.032230 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:46:28.001109 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:28.001075 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:28.409577 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:28.409495 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:34.558509 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:34.558463 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:34.660656 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:34.660622 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:34.882650 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:34.882564 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:35.110465 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:35.110427 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:35.497926 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:35.497894 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:35.825684 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:35.825585 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:36.005639 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:36.005587 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:39.256976 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:39.256940 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:39.345176 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:39.345130 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:39.424976 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:39.424929 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:39.519051 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:39.518958 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:40.024576 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:40.024543 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:40.124634 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:40.124598 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:43.807311 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:43.807253 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:44.418569 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:44.418525 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:44.703834 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:44.703721 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:45.128179 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:45.128141 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:45.267587 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:45.267543 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:46:47.428885 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:47.428849 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:49.578271 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:49.578225 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:49.677759 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:49.677720 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:51.965666 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:51.965636 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:46:55.333642 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:46:55.333599 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:47:00.757478 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:00.757444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:00.860362 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:00.860326 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:10.909727 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:10.909676 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:11.009228 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:11.009189 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:16.107319 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:16.107286 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:18.949482 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:18.949442 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:47:20.315180 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:20.315128 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:20.716730 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:20.716618 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:27.383259 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:27.383205 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:27.483315 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:27.483282 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:27.684184 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:27.684061 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:27.915754 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:27.915723 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:28.573321 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:28.573286 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:28.676160 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:28.676124 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:31.819062 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:31.818982 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:33.791027 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:33.790989 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:38.626619 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:38.626580 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:38.727370 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:38.727337 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:43.926479 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:43.926368 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:47.121777 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:47.121732 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:47.225947 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:47.225910 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:47.647652 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:47.647615 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:47:48.139067 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:48.139035 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:48.544126 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:48.544092 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:55.007122 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:55.007062 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:55.111068 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:55.111043 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:55.316818 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:55.316731 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:55.561368 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:55.561336 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:55.934662 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:55.934631 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:56.299702 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:56.299668 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:56.681041 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:56.680954 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:59.699601 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:59.699560 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:59.820900 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:59.820867 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:47:59.926717 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:47:59.926681 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:00.157079 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:00.157041 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:00.781956 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:00.781917 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:00.878067 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:00.878033 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:04.255294 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:04.255252 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:04.607639 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:04.607552 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:05.004737 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:05.004694 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:05.105502 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:05.105444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:05.154442 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:05.154408 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:48:07.913012 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:07.912972 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:08.011947 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:08.011912 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:08.105090 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:08.105059 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:08.204132 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:08.204034 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:08.836027 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:08.835997 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:08.934956 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:08.934913 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:12.419612 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:12.419563 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:13.931959 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:13.931921 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:48:23.239748 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:23.239709 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:23.346020 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:23.345987 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:24.272477 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.272435 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67"] Jul 23 00:48:24.275617 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.273760 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1" containerName="main" Jul 23 00:48:24.275617 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.273799 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1" containerName="main" Jul 23 00:48:24.275617 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.273954 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac2e1d4b-3c7c-4a33-a0c4-9dbbadf068a1" containerName="main" Jul 23 00:48:24.279023 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.278045 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.281227 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.281203 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-59a77d\"/\"auth-test-model-59a77d-kserve-self-signed-certs\"" Jul 23 00:48:24.281509 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.281487 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-59a77d\"/\"openshift-service-ca.crt\"" Jul 23 00:48:24.282143 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.282112 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-59a77d\"/\"kube-root-ca.crt\"" Jul 23 00:48:24.282268 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.282225 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-59a77d\"/\"default-dockercfg-lh9xc\"" Jul 23 00:48:24.286804 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.286774 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67"] Jul 23 00:48:24.336046 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.336012 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:24.390009 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.389972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-tmp-dir\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.390009 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.390015 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-dshm\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.390233 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.390036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-home\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.390233 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.390079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8aea417d-60cd-4b17-a8d0-4673748d806e-tls-certs\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.390233 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.390110 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-model-cache\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.390233 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.390172 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kg7s\" (UniqueName: \"kubernetes.io/projected/8aea417d-60cd-4b17-a8d0-4673748d806e-kube-api-access-9kg7s\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.491634 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.491596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-dshm\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.491634 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.491635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-home\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.491845 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.491659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8aea417d-60cd-4b17-a8d0-4673748d806e-tls-certs\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.491845 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.491719 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-model-cache\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.491845 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.491786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kg7s\" (UniqueName: \"kubernetes.io/projected/8aea417d-60cd-4b17-a8d0-4673748d806e-kube-api-access-9kg7s\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.491845 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.491841 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-tmp-dir\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.492147 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.492119 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-home\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.492147 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.492139 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-tmp-dir\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.492358 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.492179 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-model-cache\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.494141 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.494107 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-dshm\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.494403 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.494367 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8aea417d-60cd-4b17-a8d0-4673748d806e-tls-certs\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.500233 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.500213 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kg7s\" (UniqueName: \"kubernetes.io/projected/8aea417d-60cd-4b17-a8d0-4673748d806e-kube-api-access-9kg7s\") pod \"auth-test-model-59a77d-kserve-755b569c9f-vqh67\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.590071 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.589977 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:24.729173 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:24.729141 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67"] Jul 23 00:48:24.731760 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:48:24.731727 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8aea417d_60cd_4b17_a8d0_4673748d806e.slice/crio-7722c55a8b3c89b9ce128c285994785e902edc62b80e279c63993cd6344c1373 WatchSource:0}: Error finding container 7722c55a8b3c89b9ce128c285994785e902edc62b80e279c63993cd6344c1373: Status 404 returned error can't find the container with id 7722c55a8b3c89b9ce128c285994785e902edc62b80e279c63993cd6344c1373 Jul 23 00:48:25.178567 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:25.178528 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" event={"ID":"8aea417d-60cd-4b17-a8d0-4673748d806e","Type":"ContainerStarted","Data":"8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e"} Jul 23 00:48:25.178567 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:25.178572 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" event={"ID":"8aea417d-60cd-4b17-a8d0-4673748d806e","Type":"ContainerStarted","Data":"7722c55a8b3c89b9ce128c285994785e902edc62b80e279c63993cd6344c1373"} Jul 23 00:48:25.199977 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:25.199926 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" podStartSLOduration=1.199909948 podStartE2EDuration="1.199909948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:48:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:48:25.198095949 +0000 UTC m=+2647.062265123" watchObservedRunningTime="2026-07-23 00:48:25.199909948 +0000 UTC m=+2647.064079119" Jul 23 00:48:29.241354 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:29.241317 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:48:29.939843 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:29.939806 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:30.030799 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:30.030765 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:34.590978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:34.590938 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:34.590978 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:34.590981 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:34.603512 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:34.603487 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:35.235400 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:35.235355 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:48:43.113130 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:43.113096 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:48:46.937173 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:48:46.937136 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:49:07.039526 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:49:07.039487 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:49:18.755859 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:49:18.755783 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:49:18.762132 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:49:18.762106 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:49:24.630580 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:49:24.630538 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:49:42.230917 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:49:42.230878 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:49:58.627158 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:49:58.627121 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:50:12.442438 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:50:12.442407 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:50:29.940623 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:50:29.940584 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:50:45.404257 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:50:45.404159 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67"] Jul 23 00:50:45.522341 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:50:45.522310 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:50:46.308671 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:50:46.308640 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:50:48.353474 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:50:48.353430 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:50:59.510786 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:50:59.510735 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:51:00.425269 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.425229 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" podUID="8aea417d-60cd-4b17-a8d0-4673748d806e" containerName="main" containerID="cri-o://8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e" gracePeriod=45 Jul 23 00:51:00.675200 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.675172 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:51:00.846983 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.846955 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-dshm\") pod \"8aea417d-60cd-4b17-a8d0-4673748d806e\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " Jul 23 00:51:00.847194 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.847032 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kg7s\" (UniqueName: \"kubernetes.io/projected/8aea417d-60cd-4b17-a8d0-4673748d806e-kube-api-access-9kg7s\") pod \"8aea417d-60cd-4b17-a8d0-4673748d806e\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " Jul 23 00:51:00.847194 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.847061 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-model-cache\") pod \"8aea417d-60cd-4b17-a8d0-4673748d806e\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " Jul 23 00:51:00.847194 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.847079 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-home\") pod \"8aea417d-60cd-4b17-a8d0-4673748d806e\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " Jul 23 00:51:00.847194 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.847095 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8aea417d-60cd-4b17-a8d0-4673748d806e-tls-certs\") pod \"8aea417d-60cd-4b17-a8d0-4673748d806e\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " Jul 23 00:51:00.847194 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.847170 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-tmp-dir\") pod \"8aea417d-60cd-4b17-a8d0-4673748d806e\" (UID: \"8aea417d-60cd-4b17-a8d0-4673748d806e\") " Jul 23 00:51:00.847484 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.847273 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-model-cache" (OuterVolumeSpecName: "model-cache") pod "8aea417d-60cd-4b17-a8d0-4673748d806e" (UID: "8aea417d-60cd-4b17-a8d0-4673748d806e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:51:00.847484 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.847421 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-model-cache\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:51:00.847484 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.847416 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-home" (OuterVolumeSpecName: "home") pod "8aea417d-60cd-4b17-a8d0-4673748d806e" (UID: "8aea417d-60cd-4b17-a8d0-4673748d806e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:51:00.847582 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.847472 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8aea417d-60cd-4b17-a8d0-4673748d806e" (UID: "8aea417d-60cd-4b17-a8d0-4673748d806e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:51:00.849488 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.849461 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aea417d-60cd-4b17-a8d0-4673748d806e-kube-api-access-9kg7s" (OuterVolumeSpecName: "kube-api-access-9kg7s") pod "8aea417d-60cd-4b17-a8d0-4673748d806e" (UID: "8aea417d-60cd-4b17-a8d0-4673748d806e"). InnerVolumeSpecName "kube-api-access-9kg7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 00:51:00.849603 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.849480 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aea417d-60cd-4b17-a8d0-4673748d806e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8aea417d-60cd-4b17-a8d0-4673748d806e" (UID: "8aea417d-60cd-4b17-a8d0-4673748d806e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:51:00.849603 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.849488 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-dshm" (OuterVolumeSpecName: "dshm") pod "8aea417d-60cd-4b17-a8d0-4673748d806e" (UID: "8aea417d-60cd-4b17-a8d0-4673748d806e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:51:00.895105 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.895067 2574 generic.go:356] "Generic (PLEG): container finished" podID="8aea417d-60cd-4b17-a8d0-4673748d806e" containerID="8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e" exitCode=0 Jul 23 00:51:00.895293 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.895114 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" Jul 23 00:51:00.895293 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.895153 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" event={"ID":"8aea417d-60cd-4b17-a8d0-4673748d806e","Type":"ContainerDied","Data":"8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e"} Jul 23 00:51:00.895293 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.895196 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67" event={"ID":"8aea417d-60cd-4b17-a8d0-4673748d806e","Type":"ContainerDied","Data":"7722c55a8b3c89b9ce128c285994785e902edc62b80e279c63993cd6344c1373"} Jul 23 00:51:00.895293 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.895214 2574 scope.go:117] "RemoveContainer" containerID="8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e" Jul 23 00:51:00.904700 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.904679 2574 scope.go:117] "RemoveContainer" containerID="8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e" Jul 23 00:51:00.905025 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:51:00.905004 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e\": container with ID starting with 8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e not found: ID does not exist" containerID="8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e" Jul 23 00:51:00.905081 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.905035 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e"} err="failed to get container status \"8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e\": rpc error: code = NotFound desc = could not find container \"8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e\": container with ID starting with 8e777b81e63278e97c88141d96928fffa5239d40b17c23cdf333d6301505346e not found: ID does not exist" Jul 23 00:51:00.918284 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.918256 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67"] Jul 23 00:51:00.922530 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.922491 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-59a77d/auth-test-model-59a77d-kserve-755b569c9f-vqh67"] Jul 23 00:51:00.947987 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.947961 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-tmp-dir\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:51:00.947987 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.947986 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-dshm\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:51:00.948189 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.947997 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kg7s\" (UniqueName: \"kubernetes.io/projected/8aea417d-60cd-4b17-a8d0-4673748d806e-kube-api-access-9kg7s\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:51:00.948189 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.948006 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8aea417d-60cd-4b17-a8d0-4673748d806e-home\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:51:00.948189 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:00.948016 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8aea417d-60cd-4b17-a8d0-4673748d806e-tls-certs\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:51:02.655329 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:02.655293 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8aea417d-60cd-4b17-a8d0-4673748d806e" path="/var/lib/kubelet/pods/8aea417d-60cd-4b17-a8d0-4673748d806e/volumes" Jul 23 00:51:05.436144 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:05.436099 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:51:11.487776 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:11.487741 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:51:11.547709 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:11.547675 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:51:34.404751 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:34.404701 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:51:34.494819 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:34.494781 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:51:40.300160 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:40.300127 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:51:44.233452 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:51:44.233413 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:52:01.338868 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:01.338827 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:52:19.746287 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:19.746200 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:52:20.419975 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:20.419940 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:52:20.515466 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:20.515433 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:52:26.196125 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:26.196090 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:52:26.982864 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:26.982826 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:52:32.562007 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:32.561971 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:52:32.659552 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:32.659516 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:52:36.932312 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:36.932271 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:52:49.159456 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.159424 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd"] Jul 23 00:52:49.159893 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.159754 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aea417d-60cd-4b17-a8d0-4673748d806e" containerName="main" Jul 23 00:52:49.159893 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.159764 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aea417d-60cd-4b17-a8d0-4673748d806e" containerName="main" Jul 23 00:52:49.159893 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.159827 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aea417d-60cd-4b17-a8d0-4673748d806e" containerName="main" Jul 23 00:52:49.162775 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.162758 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.165226 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.165198 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-59a77d\"/\"rate-test-model-59a77d-kserve-self-signed-certs\"" Jul 23 00:52:49.166087 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.166063 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-59a77d\"/\"openshift-service-ca.crt\"" Jul 23 00:52:49.166222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.166097 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-59a77d\"/\"kube-root-ca.crt\"" Jul 23 00:52:49.166222 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.166179 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-59a77d\"/\"default-dockercfg-lh9xc\"" Jul 23 00:52:49.172823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.172798 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd"] Jul 23 00:52:49.179963 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.179939 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:52:49.207691 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.207648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-model-cache\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.207882 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.207710 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-tmp-dir\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.207882 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.207777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-home\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.207882 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.207831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/738554e2-7667-4dc6-b2a1-c382fcceb3b2-tls-certs\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.208021 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.207902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-dshm\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.208021 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.207925 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct62j\" (UniqueName: \"kubernetes.io/projected/738554e2-7667-4dc6-b2a1-c382fcceb3b2-kube-api-access-ct62j\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.308696 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.308641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-model-cache\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.308888 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.308730 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-tmp-dir\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.308888 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.308752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-home\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.308888 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.308783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/738554e2-7667-4dc6-b2a1-c382fcceb3b2-tls-certs\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.308888 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.308811 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-dshm\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.309097 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.308884 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct62j\" (UniqueName: \"kubernetes.io/projected/738554e2-7667-4dc6-b2a1-c382fcceb3b2-kube-api-access-ct62j\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.309097 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.309069 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-model-cache\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.309212 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.309131 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-tmp-dir\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.309301 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.309278 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-home\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.311086 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.311066 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-dshm\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.311348 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.311332 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/738554e2-7667-4dc6-b2a1-c382fcceb3b2-tls-certs\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.316911 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.316886 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct62j\" (UniqueName: \"kubernetes.io/projected/738554e2-7667-4dc6-b2a1-c382fcceb3b2-kube-api-access-ct62j\") pod \"rate-test-model-59a77d-kserve-864b747979-8d5jd\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.472711 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.472613 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:49.622803 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:49.622769 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd"] Jul 23 00:52:49.628768 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:52:49.628736 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod738554e2_7667_4dc6_b2a1_c382fcceb3b2.slice/crio-4728fbbcad7dc1839c9245ac1bac31b7872c3d76b56caa490fcad58969199203 WatchSource:0}: Error finding container 4728fbbcad7dc1839c9245ac1bac31b7872c3d76b56caa490fcad58969199203: Status 404 returned error can't find the container with id 4728fbbcad7dc1839c9245ac1bac31b7872c3d76b56caa490fcad58969199203 Jul 23 00:52:50.403466 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:50.403427 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" event={"ID":"738554e2-7667-4dc6-b2a1-c382fcceb3b2","Type":"ContainerStarted","Data":"b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890"} Jul 23 00:52:50.403942 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:50.403477 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" event={"ID":"738554e2-7667-4dc6-b2a1-c382fcceb3b2","Type":"ContainerStarted","Data":"4728fbbcad7dc1839c9245ac1bac31b7872c3d76b56caa490fcad58969199203"} Jul 23 00:52:50.419604 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:50.419548 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" podStartSLOduration=1.41953027 podStartE2EDuration="1.41953027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:52:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:52:50.419248662 +0000 UTC m=+2912.283417833" watchObservedRunningTime="2026-07-23 00:52:50.41953027 +0000 UTC m=+2912.283699440" Jul 23 00:52:52.380052 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:52.380016 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:52:59.473806 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:59.473760 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:59.474369 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:59.473820 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:52:59.486436 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:52:59.486405 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:53:00.461231 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:00.461195 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:53:10.085715 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:10.085663 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:53:14.129608 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:14.129567 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:53:24.205187 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:24.205148 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:53:24.305375 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:24.305339 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:53:30.727731 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:30.727696 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:53:30.830677 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:30.830640 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:53:32.626826 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:32.626789 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:53:47.438860 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:47.438784 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:53:54.728070 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:54.728020 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd"] Jul 23 00:53:54.740895 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:54.740852 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:53:55.610997 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:55.610966 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:53:58.170884 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:53:58.170830 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:07.727432 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:07.727375 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:54:09.750033 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:09.749988 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" podUID="738554e2-7667-4dc6-b2a1-c382fcceb3b2" containerName="main" containerID="cri-o://b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890" gracePeriod=45 Jul 23 00:54:10.002590 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.002520 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:54:10.103150 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.103106 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct62j\" (UniqueName: \"kubernetes.io/projected/738554e2-7667-4dc6-b2a1-c382fcceb3b2-kube-api-access-ct62j\") pod \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " Jul 23 00:54:10.103348 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.103167 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-model-cache\") pod \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " Jul 23 00:54:10.103348 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.103194 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-home\") pod \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " Jul 23 00:54:10.103348 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.103241 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/738554e2-7667-4dc6-b2a1-c382fcceb3b2-tls-certs\") pod \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " Jul 23 00:54:10.103348 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.103291 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-tmp-dir\") pod \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " Jul 23 00:54:10.103348 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.103320 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-dshm\") pod \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\" (UID: \"738554e2-7667-4dc6-b2a1-c382fcceb3b2\") " Jul 23 00:54:10.103647 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.103453 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-model-cache" (OuterVolumeSpecName: "model-cache") pod "738554e2-7667-4dc6-b2a1-c382fcceb3b2" (UID: "738554e2-7667-4dc6-b2a1-c382fcceb3b2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:54:10.103647 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.103539 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-home" (OuterVolumeSpecName: "home") pod "738554e2-7667-4dc6-b2a1-c382fcceb3b2" (UID: "738554e2-7667-4dc6-b2a1-c382fcceb3b2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:54:10.103647 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.103608 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "738554e2-7667-4dc6-b2a1-c382fcceb3b2" (UID: "738554e2-7667-4dc6-b2a1-c382fcceb3b2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:54:10.103647 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.103622 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-model-cache\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:54:10.103832 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.103660 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-home\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:54:10.105448 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.105419 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-dshm" (OuterVolumeSpecName: "dshm") pod "738554e2-7667-4dc6-b2a1-c382fcceb3b2" (UID: "738554e2-7667-4dc6-b2a1-c382fcceb3b2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 00:54:10.105559 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.105472 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/738554e2-7667-4dc6-b2a1-c382fcceb3b2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "738554e2-7667-4dc6-b2a1-c382fcceb3b2" (UID: "738554e2-7667-4dc6-b2a1-c382fcceb3b2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 00:54:10.105559 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.105521 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/738554e2-7667-4dc6-b2a1-c382fcceb3b2-kube-api-access-ct62j" (OuterVolumeSpecName: "kube-api-access-ct62j") pod "738554e2-7667-4dc6-b2a1-c382fcceb3b2" (UID: "738554e2-7667-4dc6-b2a1-c382fcceb3b2"). InnerVolumeSpecName "kube-api-access-ct62j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 00:54:10.204068 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.204031 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-dshm\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:54:10.204068 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.204061 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct62j\" (UniqueName: \"kubernetes.io/projected/738554e2-7667-4dc6-b2a1-c382fcceb3b2-kube-api-access-ct62j\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:54:10.204068 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.204072 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/738554e2-7667-4dc6-b2a1-c382fcceb3b2-tls-certs\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:54:10.204312 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.204081 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/738554e2-7667-4dc6-b2a1-c382fcceb3b2-tmp-dir\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\"" Jul 23 00:54:10.770958 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.770921 2574 generic.go:356] "Generic (PLEG): container finished" podID="738554e2-7667-4dc6-b2a1-c382fcceb3b2" containerID="b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890" exitCode=0 Jul 23 00:54:10.771420 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.770961 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" event={"ID":"738554e2-7667-4dc6-b2a1-c382fcceb3b2","Type":"ContainerDied","Data":"b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890"} Jul 23 00:54:10.771420 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.770988 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" Jul 23 00:54:10.771420 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.771022 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd" event={"ID":"738554e2-7667-4dc6-b2a1-c382fcceb3b2","Type":"ContainerDied","Data":"4728fbbcad7dc1839c9245ac1bac31b7872c3d76b56caa490fcad58969199203"} Jul 23 00:54:10.771420 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.771044 2574 scope.go:117] "RemoveContainer" containerID="b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890" Jul 23 00:54:10.779815 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.779795 2574 scope.go:117] "RemoveContainer" containerID="b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890" Jul 23 00:54:10.780135 ip-10-0-137-249 kubenswrapper[2574]: E0723 00:54:10.780117 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890\": container with ID starting with b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890 not found: ID does not exist" containerID="b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890" Jul 23 00:54:10.780184 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.780145 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890"} err="failed to get container status \"b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890\": rpc error: code = NotFound desc = could not find container \"b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890\": container with ID starting with b688aedfcf88450060756b5f5f1c72f7aaca36b88de613b8854d150cbce0a890 not found: ID does not exist" Jul 23 00:54:10.787449 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.787420 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd"] Jul 23 00:54:10.794695 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:10.794669 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-59a77d/rate-test-model-59a77d-kserve-864b747979-8d5jd"] Jul 23 00:54:12.654062 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:12.654026 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="738554e2-7667-4dc6-b2a1-c382fcceb3b2" path="/var/lib/kubelet/pods/738554e2-7667-4dc6-b2a1-c382fcceb3b2/volumes" Jul 23 00:54:15.976094 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:15.976052 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:16.076369 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:16.076329 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:18.783262 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:18.783229 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:54:18.789794 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:18.789769 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:54:26.066672 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:26.066635 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:28.931478 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:28.931441 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:54:30.607750 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:30.607718 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:31.031872 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:31.031838 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:37.124189 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:37.124155 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:37.225541 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:37.225504 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:37.398508 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:37.398414 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:37.633091 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:37.633054 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:38.350000 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:38.349962 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:38.448327 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:38.448287 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:38.550906 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:38.550864 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:48.302973 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:48.302934 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:51.132045 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:51.132001 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tkk65"] Jul 23 00:54:52.825319 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:52.825286 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:53.232120 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:53.232083 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:59.136845 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:59.136804 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:59.239270 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:59.239232 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:59.373745 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:59.373714 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:54:59.616063 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:54:59.616032 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:55:00.057460 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:00.057428 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d9766f9c7-k2n92_3fee2e83-ef5f-4535-bddf-3fec69a5f28f/authorino/0.log" Jul 23 00:55:06.665289 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:06.665262 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b98fc76f-7vsvs_c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb/copy-manifests/0.log" Jul 23 00:55:06.671981 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:06.671959 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b98fc76f-7vsvs_c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb/manager/0.log" Jul 23 00:55:08.915031 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:08.915001 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d9766f9c7-k2n92_3fee2e83-ef5f-4535-bddf-3fec69a5f28f/authorino/0.log" Jul 23 00:55:09.037627 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:09.037591 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-c2gdt_3bc060ea-9129-4dbe-8084-460828d50a69/manager/0.log" Jul 23 00:55:09.676068 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:09.676036 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tkk65_18c00224-e54b-47a4-aab5-7fbcfc68beed/limitador/0.log" Jul 23 00:55:10.448947 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:10.448919 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d98b647-m7hn4_12ebc3d7-bd4e-4428-a1d1-07c8b92be165/kube-auth-proxy/0.log" Jul 23 00:55:11.688341 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:11.688310 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-bgpvm_095546e1-0e33-455d-824b-de4bc6aaa972/main/0.log" Jul 23 00:55:12.058434 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:12.058408 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-g4brv_bb531b79-620b-40bc-acab-5fde4760e0d5/main/0.log" Jul 23 00:55:17.509649 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:17.509612 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:55:17.608591 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:17.608558 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" limit=1024 Jul 23 00:55:20.474950 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:20.474918 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5t84s_20402179-b992-42ea-91a0-0df7d5415521/global-pull-secret-syncer/0.log" Jul 23 00:55:20.632936 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:20.632906 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cbcfq_d720a2e2-82ed-4816-9a16-ce9331dc4c7f/konnectivity-agent/0.log" Jul 23 00:55:20.768107 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:20.768076 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-249.ec2.internal_f9eae42e7d66416d6ea3b4d6c66b2c30/haproxy/0.log" Jul 23 00:55:25.766685 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:25.766644 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d9766f9c7-k2n92_3fee2e83-ef5f-4535-bddf-3fec69a5f28f/authorino/0.log" Jul 23 00:55:25.803243 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:25.803209 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-c2gdt_3bc060ea-9129-4dbe-8084-460828d50a69/manager/0.log" Jul 23 00:55:26.244269 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:26.244237 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tkk65_18c00224-e54b-47a4-aab5-7fbcfc68beed/limitador/0.log" Jul 23 00:55:28.347328 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.347283 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-8xfv5_1dda765f-eee6-4cb8-bac5-21fc9897f185/kube-state-metrics/0.log" Jul 23 00:55:28.381096 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.381069 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-8xfv5_1dda765f-eee6-4cb8-bac5-21fc9897f185/kube-rbac-proxy-main/0.log" Jul 23 00:55:28.402960 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.402929 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-8xfv5_1dda765f-eee6-4cb8-bac5-21fc9897f185/kube-rbac-proxy-self/0.log" Jul 23 00:55:28.583952 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.583925 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l5tbp_669bec30-17d5-407d-9fed-0a7fb74b78bd/node-exporter/0.log" Jul 23 00:55:28.605752 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.605722 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l5tbp_669bec30-17d5-407d-9fed-0a7fb74b78bd/kube-rbac-proxy/0.log" Jul 23 00:55:28.629430 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.629404 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l5tbp_669bec30-17d5-407d-9fed-0a7fb74b78bd/init-textfile/0.log" Jul 23 00:55:28.826286 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.826255 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95be333c-de14-4818-959c-f269404fa477/prometheus/0.log" Jul 23 00:55:28.849707 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.849636 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95be333c-de14-4818-959c-f269404fa477/config-reloader/0.log" Jul 23 00:55:28.871071 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.871047 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95be333c-de14-4818-959c-f269404fa477/thanos-sidecar/0.log" Jul 23 00:55:28.906684 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.906658 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95be333c-de14-4818-959c-f269404fa477/kube-rbac-proxy-web/0.log" Jul 23 00:55:28.928438 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.928418 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95be333c-de14-4818-959c-f269404fa477/kube-rbac-proxy/0.log" Jul 23 00:55:28.949900 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.949877 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95be333c-de14-4818-959c-f269404fa477/kube-rbac-proxy-thanos/0.log" Jul 23 00:55:28.972425 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:28.972402 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95be333c-de14-4818-959c-f269404fa477/init-config-reloader/0.log" Jul 23 00:55:30.186703 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.186666 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl"] Jul 23 00:55:30.187122 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.186996 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="738554e2-7667-4dc6-b2a1-c382fcceb3b2" containerName="main" Jul 23 00:55:30.187122 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.187007 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="738554e2-7667-4dc6-b2a1-c382fcceb3b2" containerName="main" Jul 23 00:55:30.187122 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.187077 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="738554e2-7667-4dc6-b2a1-c382fcceb3b2" containerName="main" Jul 23 00:55:30.189842 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.189819 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.191999 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.191976 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5lwts\"/\"openshift-service-ca.crt\"" Jul 23 00:55:30.192121 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.192005 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5lwts\"/\"default-dockercfg-mrwpc\"" Jul 23 00:55:30.192855 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.192834 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5lwts\"/\"kube-root-ca.crt\"" Jul 23 00:55:30.198735 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.198711 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl"] Jul 23 00:55:30.287476 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.287439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/debe0b2d-6ca0-432c-8150-2973ace0a431-sys\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.287667 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.287482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/debe0b2d-6ca0-432c-8150-2973ace0a431-lib-modules\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.287667 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.287537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq45g\" (UniqueName: \"kubernetes.io/projected/debe0b2d-6ca0-432c-8150-2973ace0a431-kube-api-access-kq45g\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.287667 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.287577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/debe0b2d-6ca0-432c-8150-2973ace0a431-podres\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.287667 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.287628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/debe0b2d-6ca0-432c-8150-2973ace0a431-proc\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.388630 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.388588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/debe0b2d-6ca0-432c-8150-2973ace0a431-sys\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.388630 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.388629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/debe0b2d-6ca0-432c-8150-2973ace0a431-lib-modules\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.388980 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.388659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq45g\" (UniqueName: \"kubernetes.io/projected/debe0b2d-6ca0-432c-8150-2973ace0a431-kube-api-access-kq45g\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.388980 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.388733 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/debe0b2d-6ca0-432c-8150-2973ace0a431-sys\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.388980 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.388783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/debe0b2d-6ca0-432c-8150-2973ace0a431-podres\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.388980 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.388801 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/debe0b2d-6ca0-432c-8150-2973ace0a431-lib-modules\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.388980 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.388847 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/debe0b2d-6ca0-432c-8150-2973ace0a431-proc\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.388980 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.388895 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/debe0b2d-6ca0-432c-8150-2973ace0a431-podres\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.388980 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.388951 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/debe0b2d-6ca0-432c-8150-2973ace0a431-proc\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.396996 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.396966 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq45g\" (UniqueName: \"kubernetes.io/projected/debe0b2d-6ca0-432c-8150-2973ace0a431-kube-api-access-kq45g\") pod \"perf-node-gather-daemonset-2w2wl\" (UID: \"debe0b2d-6ca0-432c-8150-2973ace0a431\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.470413 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.470311 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-xdd6z_c06cb800-fb64-4940-aaee-4b406eebdb5f/networking-console-plugin/0.log" Jul 23 00:55:30.501050 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.501015 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:30.641017 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:30.640990 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl"] Jul 23 00:55:30.644270 ip-10-0-137-249 kubenswrapper[2574]: W0723 00:55:30.644234 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddebe0b2d_6ca0_432c_8150_2973ace0a431.slice/crio-6b2e8b8d1fcc97d030ee847f656347171e48d4a8dd444593d36729a4be2f26cb WatchSource:0}: Error finding container 6b2e8b8d1fcc97d030ee847f656347171e48d4a8dd444593d36729a4be2f26cb: Status 404 returned error can't find the container with id 6b2e8b8d1fcc97d030ee847f656347171e48d4a8dd444593d36729a4be2f26cb Jul 23 00:55:31.110030 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:31.109952 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/2.log" Jul 23 00:55:31.114223 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:31.114202 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8lw8_07ef6baf-4493-4807-9ae5-bd20280a7d9c/console-operator/3.log" Jul 23 00:55:31.132365 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:31.132336 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" event={"ID":"debe0b2d-6ca0-432c-8150-2973ace0a431","Type":"ContainerStarted","Data":"73149fabc7d43cc0dbfdcc299686091a4e93aa4618fac1e6d94985787f04c5aa"} Jul 23 00:55:31.132516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:31.132398 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" event={"ID":"debe0b2d-6ca0-432c-8150-2973ace0a431","Type":"ContainerStarted","Data":"6b2e8b8d1fcc97d030ee847f656347171e48d4a8dd444593d36729a4be2f26cb"} Jul 23 00:55:31.132516 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:31.132435 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:31.149394 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:31.149341 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" podStartSLOduration=1.149324375 podStartE2EDuration="1.149324375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:55:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:55:31.148438194 +0000 UTC m=+3073.012607367" watchObservedRunningTime="2026-07-23 00:55:31.149324375 +0000 UTC m=+3073.013493598" Jul 23 00:55:31.633905 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:31.633876 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-wnx4v_257b995d-6486-42d5-bbda-21f9be1bf292/download-server/0.log" Jul 23 00:55:33.284367 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:33.284337 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-25447_bad05bc4-e611-4e6f-84bc-d41cbe4b09fa/dns/0.log" Jul 23 00:55:33.339378 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:33.339350 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-25447_bad05bc4-e611-4e6f-84bc-d41cbe4b09fa/kube-rbac-proxy/0.log" Jul 23 00:55:33.469867 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:33.469838 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6d6zq_ce321df6-7f11-4d73-a5ee-ecf33cc54d77/dns-node-resolver/0.log" Jul 23 00:55:34.148360 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:34.148330 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c6qqx_807b0073-a7e3-4d00-9589-ae775a84e7ad/node-ca/0.log" Jul 23 00:55:35.280699 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:35.280668 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d98b647-m7hn4_12ebc3d7-bd4e-4428-a1d1-07c8b92be165/kube-auth-proxy/0.log" Jul 23 00:55:36.185762 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:36.185731 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rjr7d_1e53529c-5039-4a5e-8bcd-43569dfe7a18/serve-healthcheck-canary/0.log" Jul 23 00:55:36.747496 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:36.747469 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqz4g_147d2b45-869c-49c8-b5ac-9fe05a1430bc/kube-rbac-proxy/0.log" Jul 23 00:55:36.771625 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:36.771598 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqz4g_147d2b45-869c-49c8-b5ac-9fe05a1430bc/exporter/0.log" Jul 23 00:55:36.796823 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:36.796800 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqz4g_147d2b45-869c-49c8-b5ac-9fe05a1430bc/extractor/0.log" Jul 23 00:55:37.147254 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:37.147184 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-2w2wl" Jul 23 00:55:39.838535 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:39.838501 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b98fc76f-7vsvs_c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb/manager/0.log" Jul 23 00:55:39.868104 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:39.868077 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b98fc76f-7vsvs_c77abcbe-c0fa-43fa-a88b-8abf6be8ceeb/copy-manifests/0.log" Jul 23 00:55:40.795718 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:40.795688 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d98b647-m7hn4_12ebc3d7-bd4e-4428-a1d1-07c8b92be165/kube-auth-proxy/0.log" Jul 23 00:55:41.254813 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:41.254786 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7dcccd7c7c-njnjz_36430ea1-a1fe-4845-99a1-0c8d935f7256/manager/0.log" Jul 23 00:55:42.257858 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:42.257825 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d98b647-m7hn4_12ebc3d7-bd4e-4428-a1d1-07c8b92be165/kube-auth-proxy/0.log" Jul 23 00:55:46.146006 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:46.145929 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-94vgz_6c68d84c-79c3-47d6-9cb4-cb2681970d00/migrator/0.log" Jul 23 00:55:46.169148 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:46.169118 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-94vgz_6c68d84c-79c3-47d6-9cb4-cb2681970d00/graceful-termination/0.log" Jul 23 00:55:46.523726 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:46.523698 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-l29fv_2217124c-eb39-46d0-b860-e13acd5d4d7c/kube-storage-version-migrator-operator/1.log" Jul 23 00:55:46.524477 ip-10-0-137-249 kubenswrapper[2574]: I0723 00:55:46.524457 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-l29fv_2217124c-eb39-46d0-b860-e13acd5d4d7c/kube-storage-version-migrator-operator/0.log"