Jul 28 10:07:18.397328 ip-10-0-136-186 systemd[1]: Starting Kubernetes Kubelet... Jul 28 10:07:18.811161 ip-10-0-136-186 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 10:07:18.811161 ip-10-0-136-186 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 10:07:18.811161 ip-10-0-136-186 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 10:07:18.811161 ip-10-0-136-186 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 10:07:18.811161 ip-10-0-136-186 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 10:07:18.812025 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.811902 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 10:07:18.816344 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816328 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 10:07:18.816344 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816344 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816347 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816350 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816353 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816357 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816359 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816363 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816366 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816368 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816371 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816375 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816387 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816391 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816394 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816397 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816399 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816402 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816405 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816407 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 10:07:18.816405 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816411 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816413 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816416 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816419 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816422 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816424 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816427 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816429 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816432 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816434 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816437 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816439 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816442 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816444 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816447 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816450 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816452 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816455 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816457 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816460 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 10:07:18.817118 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816462 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816465 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816467 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816470 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816472 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816507 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816551 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816554 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816557 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816560 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816563 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816566 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816569 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816573 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816576 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816580 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816583 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816587 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816592 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816595 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 10:07:18.817804 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816599 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 10:07:18.818337 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816602 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 10:07:18.818337 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816604 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 10:07:18.818337 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816607 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 10:07:18.818337 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816610 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 10:07:18.818337 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816613 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 10:07:18.818337 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816615 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 10:07:18.818337 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816618 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 10:07:18.818337 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816620 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 10:07:18.818337 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.816627 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 10:07:18.818337 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818333 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818348 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818352 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818356 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818359 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818460 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818465 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818470 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818475 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818478 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818481 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818485 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818487 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818490 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818493 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818495 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818498 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818504 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818507 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818511 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 10:07:18.818600 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818513 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 10:07:18.819199 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818516 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 10:07:18.819199 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818519 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 10:07:18.819199 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818521 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 10:07:18.819199 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818524 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 10:07:18.819199 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818527 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 10:07:18.819199 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818529 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 10:07:18.819199 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818532 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 10:07:18.819199 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.818534 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819264 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819271 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819274 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819277 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819288 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819292 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819294 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819297 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819299 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819302 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819304 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819307 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819309 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819312 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819314 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819317 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819319 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819321 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819324 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 10:07:18.819391 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819327 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819331 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819335 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819337 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819341 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819346 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819349 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819351 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819355 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819357 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819360 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819363 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819366 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819368 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819372 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819374 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819377 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819380 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819383 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 10:07:18.819900 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819385 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819388 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819390 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819393 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819396 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819398 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819401 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819404 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819407 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819409 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819412 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819414 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819417 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819419 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819422 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819425 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819427 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819432 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819435 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819438 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 10:07:18.820404 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819441 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819444 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819447 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819449 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819453 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819456 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819458 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819462 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819465 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819468 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819470 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819473 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819475 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819478 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819480 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819483 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819485 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819488 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819490 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819493 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 10:07:18.820880 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819495 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819498 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819500 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819502 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819505 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819507 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819511 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819514 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819516 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819518 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819521 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819524 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819526 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819528 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819531 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819533 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819536 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819539 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819541 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 10:07:18.821384 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819551 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819554 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819937 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819941 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819944 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819947 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819950 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819953 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819955 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819958 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819960 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819963 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819966 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819968 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819971 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819973 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819976 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819978 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819981 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819984 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 10:07:18.821841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819986 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819989 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819991 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819994 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.819997 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820000 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820004 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820008 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820013 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820015 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820021 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820024 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820029 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820032 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820035 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820038 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820040 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820043 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820046 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820049 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 10:07:18.822331 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820051 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820053 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820056 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820059 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820061 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820064 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820085 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820089 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820092 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820095 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820097 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820100 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820102 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820105 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820107 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820110 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820112 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820115 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820117 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 10:07:18.822819 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820120 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820123 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820126 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820128 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820131 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820136 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820139 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820142 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820145 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820147 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820150 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820152 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820155 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820157 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820160 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820162 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820165 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820168 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820170 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820173 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 10:07:18.823298 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820175 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820177 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820180 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820183 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820185 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820188 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820191 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820194 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820196 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820199 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820201 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820205 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820210 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820213 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820217 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820221 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820223 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820229 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820232 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 10:07:18.823770 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820234 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820237 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820239 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820309 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820316 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820322 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820327 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820331 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820335 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820339 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820343 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820346 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820349 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820352 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820355 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820358 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820361 2581 flags.go:64] FLAG: --cgroup-root="" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820364 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820368 2581 flags.go:64] FLAG: --client-ca-file="" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820370 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820373 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820378 2581 flags.go:64] FLAG: --cluster-domain="" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820381 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 10:07:18.824235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820384 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820387 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820390 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820393 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820396 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820399 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820402 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820407 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820411 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820414 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820417 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820420 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820424 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820427 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820430 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820433 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820435 2581 flags.go:64] FLAG: --enable-server="true" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820438 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820442 2581 flags.go:64] FLAG: --event-burst="100" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820445 2581 flags.go:64] FLAG: --event-qps="50" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820448 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820451 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820454 2581 flags.go:64] FLAG: --eviction-hard="" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820457 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 10:07:18.824769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820460 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820463 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820466 2581 flags.go:64] FLAG: --eviction-soft="" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820469 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820472 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820475 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820477 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820480 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820483 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820486 2581 flags.go:64] FLAG: --feature-gates="" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820490 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820493 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820496 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820499 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820502 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820507 2581 flags.go:64] FLAG: --help="false" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820509 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-136-186.ec2.internal" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820513 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820516 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820519 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820523 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820526 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820529 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 10:07:18.825352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820532 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820534 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820537 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820540 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820543 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820546 2581 flags.go:64] FLAG: --kube-reserved="" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820549 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820551 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820556 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820558 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820561 2581 flags.go:64] FLAG: --lock-file="" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820564 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820567 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820571 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820576 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820579 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820581 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820584 2581 flags.go:64] FLAG: --logging-format="text" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820587 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820590 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820593 2581 flags.go:64] FLAG: --manifest-url="" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820596 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820600 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820603 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820608 2581 flags.go:64] FLAG: --max-pods="110" Jul 28 10:07:18.825972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820611 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820614 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820618 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820621 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820624 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820627 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820630 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820636 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820639 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820642 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820645 2581 flags.go:64] FLAG: --pod-cidr="" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820648 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820653 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820656 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820659 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820662 2581 flags.go:64] FLAG: --port="10250" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820666 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820669 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-025669e214a1158dc" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820672 2581 flags.go:64] FLAG: --qos-reserved="" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820675 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820678 2581 flags.go:64] FLAG: --register-node="true" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820681 2581 flags.go:64] FLAG: --register-with-taints="" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820685 2581 flags.go:64] FLAG: --registry-burst="10" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820687 2581 flags.go:64] FLAG: --registry-qps="5" Jul 28 10:07:18.826591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820690 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820693 2581 flags.go:64] FLAG: --reserved-memory="" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820697 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820700 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820702 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820705 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820708 2581 flags.go:64] FLAG: --runonce="false" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820712 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820715 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820718 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820735 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820740 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820743 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820747 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820750 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820752 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820756 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820758 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820761 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820765 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820767 2581 flags.go:64] FLAG: --system-cgroups="" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820770 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820775 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820778 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820782 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 10:07:18.827183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820787 2581 flags.go:64] FLAG: --tls-min-version="" Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820789 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820792 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820795 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820799 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820802 2581 flags.go:64] FLAG: --v="2" Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820806 2581 flags.go:64] FLAG: --version="false" Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820810 2581 flags.go:64] FLAG: --vmodule="" Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820813 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.820817 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820929 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820934 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820938 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820941 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820945 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820948 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820951 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820953 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820956 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820959 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820961 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820964 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 10:07:18.827784 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820966 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820969 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820971 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820974 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820976 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820979 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820982 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820984 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820987 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820991 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820994 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820996 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.820999 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821001 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821005 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821007 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821010 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821012 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821015 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821018 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 10:07:18.828341 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821021 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821023 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821026 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821029 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821031 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821034 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821037 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821039 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821042 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821044 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821047 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821050 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821052 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821055 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821057 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821060 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821063 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821077 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821080 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 10:07:18.828841 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821084 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821087 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821092 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821094 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821097 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821100 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821103 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821105 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821108 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821110 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821113 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821116 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821118 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821121 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821125 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821128 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821131 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821135 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821138 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821140 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 10:07:18.829395 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821144 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821146 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821150 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821152 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821155 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821158 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821161 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821164 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821166 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821169 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821171 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821174 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821176 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821179 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821183 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821185 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821188 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821190 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821193 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821196 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 10:07:18.829876 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821199 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821201 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821204 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821206 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821209 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821212 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821214 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.821217 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.821794 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.828361 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.828376 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.828389 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.828395 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828460 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 10:07:18.830366 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828465 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828468 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828472 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828475 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828478 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828481 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828484 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828487 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828490 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828492 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828496 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828500 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828503 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828508 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828511 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828514 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828517 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828520 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828523 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 10:07:18.830712 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828526 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828529 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828532 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828534 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828537 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828540 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828542 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828545 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828548 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828551 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828553 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828556 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828559 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828562 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828564 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828567 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828570 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828572 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828575 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828577 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 10:07:18.831163 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828580 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828582 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828585 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828587 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828590 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828593 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828597 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828600 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828603 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828605 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828608 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828611 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828613 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828616 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828618 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828621 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828624 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828627 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828629 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828632 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 10:07:18.831645 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828635 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828637 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828640 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828643 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828645 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828648 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828651 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828653 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828655 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828659 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828661 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828664 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828666 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828669 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828671 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828674 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828676 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828679 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828681 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828683 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 10:07:18.832136 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828686 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828688 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828691 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828694 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828696 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828699 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828702 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828705 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828707 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828710 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828713 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828715 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828718 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828720 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828723 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828725 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828728 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828731 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 10:07:18.832618 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828733 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.828738 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828848 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828852 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828856 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828859 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828862 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828865 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828867 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828870 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828872 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828874 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828877 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828881 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 10:07:18.833044 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828884 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828887 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828890 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828893 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828896 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828898 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828901 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828904 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828906 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828909 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828911 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828914 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828917 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828920 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828922 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828925 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828927 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828930 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828932 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 10:07:18.833416 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828935 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828938 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828941 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828943 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828946 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828949 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828951 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828954 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828956 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828959 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828962 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828964 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828966 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828969 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828973 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828976 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828978 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828981 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828983 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 10:07:18.833874 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828986 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828990 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828993 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828997 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.828999 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829002 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829005 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829007 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829009 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829012 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829014 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829017 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829019 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829022 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829024 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829027 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829029 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829031 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829034 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 10:07:18.834343 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829037 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829039 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829042 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829044 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829046 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829049 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829052 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829054 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829057 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829059 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829062 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829064 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829084 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829087 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829090 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829093 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829095 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829098 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829100 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829103 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 10:07:18.834792 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829105 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829108 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829110 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829113 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829115 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829117 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829120 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829123 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829125 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:18.829128 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.829132 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.829225 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.831276 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.832414 2581 server.go:1019] "Starting client certificate rotation" Jul 28 10:07:18.835260 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.832515 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 10:07:18.835601 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.832559 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 10:07:18.835601 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.835580 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 10:07:18.837034 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.837018 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 10:07:18.851358 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.850731 2581 log.go:25] "Validated CRI v1 runtime API" Jul 28 10:07:18.855021 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.854991 2581 log.go:25] "Validated CRI v1 image API" Jul 28 10:07:18.856295 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.856281 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 10:07:18.858415 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.858396 2581 fs.go:135] Filesystem UUIDs: map[16a39372-4faf-4917-89b7-6ac7d7adf67e:/dev/nvme0n1p4 32fdd51a-32f7-4464-b7bc-4818b58cb7f7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 28 10:07:18.858475 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.858413 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 10:07:18.863145 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.863032 2581 manager.go:216] Machine: {Timestamp:2026-07-28 10:07:18.86257634 +0000 UTC m=+0.341558126 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099390 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e0a00ef97ff957967e7aee488579 SystemUUID:ec25e0a0-0ef9-7ff9-5796-7e7aee488579 BootID:f7100ac0-a537-4a8c-b2f2-47e9be6f7594 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2a:b9:6d:df:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2a:b9:6d:df:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:71:66:38:10:f8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 10:07:18.863145 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.863139 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 10:07:18.863246 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.863213 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 10:07:18.866482 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.866467 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 10:07:18.867202 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.867179 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 10:07:18.867338 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.867206 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 10:07:18.867905 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.867894 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 10:07:18.867938 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.867907 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 10:07:18.867938 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.867915 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 10:07:18.868545 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.868535 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 10:07:18.869182 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.869171 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 10:07:18.870693 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.870682 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 28 10:07:18.870812 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.870801 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 10:07:18.870841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.870834 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 28 10:07:18.870871 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.870856 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 10:07:18.870901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.870879 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 10:07:18.870901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.870892 2581 kubelet.go:398] "Adding apiserver pod source" Jul 28 10:07:18.870959 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.870904 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 10:07:18.871342 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.871329 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 10:07:18.871385 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.871354 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 10:07:18.873162 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.873145 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 10:07:18.874639 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.874627 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 10:07:18.874690 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.874656 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 10:07:18.878191 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878178 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 10:07:18.878191 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878195 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 10:07:18.878191 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878201 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 10:07:18.878308 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878207 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 10:07:18.878308 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878220 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 10:07:18.878308 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878226 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 10:07:18.878308 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878235 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 10:07:18.878308 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878240 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 10:07:18.878308 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878246 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 10:07:18.878308 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878252 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 10:07:18.878308 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878267 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 10:07:18.878308 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878272 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 10:07:18.878308 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878301 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 10:07:18.878308 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.878309 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 10:07:18.881498 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.881486 2581 server.go:1268] "Started kubelet" Jul 28 10:07:18.881616 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.881588 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 10:07:18.881841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.881604 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 10:07:18.882013 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.881990 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 10:07:18.882343 ip-10-0-136-186 systemd[1]: Started Kubernetes Kubelet. Jul 28 10:07:18.883129 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.882809 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 10:07:18.883129 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:18.882852 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 10:07:18.883129 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:18.882926 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 10:07:18.883624 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.883597 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 10:07:18.883728 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.883716 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 28 10:07:18.887343 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:18.887321 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 10:07:18.889925 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:18.888719 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-186.ec2.internal.18c66c2c14bfe3b1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-186.ec2.internal,UID:ip-10-0-136-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-186.ec2.internal,},FirstTimestamp:2026-07-28 10:07:18.881461169 +0000 UTC m=+0.360442955,LastTimestamp:2026-07-28 10:07:18.881461169 +0000 UTC m=+0.360442955,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-186.ec2.internal,}" Jul 28 10:07:18.891610 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.891598 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 10:07:18.891662 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.891618 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 10:07:18.891756 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:18.891734 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" Jul 28 10:07:18.892435 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.892414 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 10:07:18.892511 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.892438 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 10:07:18.892511 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.892414 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 10:07:18.892625 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.892522 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 10:07:18.892625 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.892536 2581 factory.go:55] Registering systemd factory Jul 28 10:07:18.892625 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.892545 2581 factory.go:223] Registration of the systemd container factory successfully Jul 28 10:07:18.892625 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.892579 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 28 10:07:18.892625 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.892598 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 28 10:07:18.892859 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.892722 2581 factory.go:153] Registering CRI-O factory Jul 28 10:07:18.892859 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.892733 2581 factory.go:223] Registration of the crio container factory successfully Jul 28 10:07:18.892859 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.892750 2581 factory.go:103] Registering Raw factory Jul 28 10:07:18.892859 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.892760 2581 manager.go:1196] Started watching for new ooms in manager Jul 28 10:07:18.893315 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.893301 2581 manager.go:349] Starting recovery of all containers Jul 28 10:07:18.896316 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:18.896287 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 10:07:18.896459 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:18.896438 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 10:07:18.901336 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.901309 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lcl8f" Jul 28 10:07:18.903977 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.903962 2581 manager.go:354] Recovery completed Jul 28 10:07:18.908308 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.908185 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:07:18.909926 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.909912 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:07:18.910012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.909944 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:07:18.910012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.909960 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:07:18.910395 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.910380 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lcl8f" Jul 28 10:07:18.910485 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.910434 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 10:07:18.910485 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.910445 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 10:07:18.910485 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.910463 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 28 10:07:18.910485 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.910447 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:07:18.911141 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.911123 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:07:18.911203 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.911152 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:07:18.911203 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.911163 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:07:18.912309 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:18.912239 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-186.ec2.internal.18c66c2c16723d69 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-186.ec2.internal,UID:ip-10-0-136-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-186.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-186.ec2.internal,},FirstTimestamp:2026-07-28 10:07:18.909926761 +0000 UTC m=+0.388908550,LastTimestamp:2026-07-28 10:07:18.909926761 +0000 UTC m=+0.388908550,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-186.ec2.internal,}" Jul 28 10:07:18.913061 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.913044 2581 policy_none.go:49] "None policy: Start" Jul 28 10:07:18.913144 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.913079 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 10:07:18.913144 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.913111 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 10:07:18.914133 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.914119 2581 policy_none.go:47] "Start" Jul 28 10:07:18.944725 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.944712 2581 manager.go:337] "Starting Device Plugin manager" Jul 28 10:07:18.944814 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:18.944740 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 10:07:18.944814 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.944749 2581 server.go:87] "Starting device plugin registration server" Jul 28 10:07:18.944998 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.944985 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 10:07:18.945059 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.944999 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 10:07:18.945164 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.945117 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 10:07:18.945223 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.945194 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 10:07:18.945223 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:18.945204 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 10:07:18.945712 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:18.945696 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 10:07:18.945785 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:18.945734 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-186.ec2.internal\" not found" Jul 28 10:07:19.045652 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.045310 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:07:19.046782 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.046765 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:07:19.046861 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.046794 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:07:19.046861 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.046805 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:07:19.046861 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.046832 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.059120 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.059100 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.059216 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.059127 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-186.ec2.internal\": node \"ip-10-0-136-186.ec2.internal\" not found" Jul 28 10:07:19.076467 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.076446 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" Jul 28 10:07:19.089098 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.089076 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 10:07:19.090295 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.090276 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 10:07:19.090361 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.090329 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 10:07:19.090361 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.090355 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 10:07:19.090427 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.090395 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 10:07:19.092563 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.092541 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 10:07:19.177540 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.177507 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" Jul 28 10:07:19.190618 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.190595 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal"] Jul 28 10:07:19.190677 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.190671 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:07:19.191518 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.191503 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:07:19.191610 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.191537 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:07:19.191610 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.191554 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:07:19.192810 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.192795 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:07:19.192915 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.192899 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.192964 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.192928 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:07:19.193536 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.193519 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:07:19.193639 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.193534 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:07:19.193639 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.193544 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:07:19.193639 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.193559 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:07:19.193639 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.193560 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:07:19.193790 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.193658 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:07:19.194702 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.194688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.194758 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.194701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/974cc7dfc517ee12891de16f2d92c67b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal\" (UID: \"974cc7dfc517ee12891de16f2d92c67b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.194758 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.194713 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:07:19.194758 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.194722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/974cc7dfc517ee12891de16f2d92c67b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal\" (UID: \"974cc7dfc517ee12891de16f2d92c67b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.195367 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.195351 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:07:19.195451 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.195382 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:07:19.195451 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.195399 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:07:19.218897 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.218874 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-186.ec2.internal\" not found" node="ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.223636 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.223618 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-186.ec2.internal\" not found" node="ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.277892 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.277867 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" Jul 28 10:07:19.295909 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.295889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/974cc7dfc517ee12891de16f2d92c67b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal\" (UID: \"974cc7dfc517ee12891de16f2d92c67b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.295984 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.295915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/974cc7dfc517ee12891de16f2d92c67b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal\" (UID: \"974cc7dfc517ee12891de16f2d92c67b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.295984 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.295937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7ad5f76fc6bb2a29bad07b46c5e652c-config\") pod \"kube-apiserver-proxy-ip-10-0-136-186.ec2.internal\" (UID: \"f7ad5f76fc6bb2a29bad07b46c5e652c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.296068 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.296008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/974cc7dfc517ee12891de16f2d92c67b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal\" (UID: \"974cc7dfc517ee12891de16f2d92c67b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.296068 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.296010 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/974cc7dfc517ee12891de16f2d92c67b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal\" (UID: \"974cc7dfc517ee12891de16f2d92c67b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.378669 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.378601 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" Jul 28 10:07:19.396139 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.396117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7ad5f76fc6bb2a29bad07b46c5e652c-config\") pod \"kube-apiserver-proxy-ip-10-0-136-186.ec2.internal\" (UID: \"f7ad5f76fc6bb2a29bad07b46c5e652c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.396205 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.396173 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7ad5f76fc6bb2a29bad07b46c5e652c-config\") pod \"kube-apiserver-proxy-ip-10-0-136-186.ec2.internal\" (UID: \"f7ad5f76fc6bb2a29bad07b46c5e652c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.485113 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.485060 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" Jul 28 10:07:19.522315 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.522286 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.527141 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.527117 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.585761 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.585731 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" Jul 28 10:07:19.693116 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.693053 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" Jul 28 10:07:19.798762 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.798735 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" Jul 28 10:07:19.816520 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.816497 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 10:07:19.831674 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.831651 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 10:07:19.831779 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.831761 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 10:07:19.831822 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.831807 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 10:07:19.871271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.871247 2581 apiserver.go:52] "Watching apiserver" Jul 28 10:07:19.891799 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.891779 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.891885 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.891779 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 10:07:19.892772 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.892756 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 10:07:19.893160 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.893143 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tv5ff","kube-system/konnectivity-agent-bdxf8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx","openshift-image-registry/node-ca-8p2v9","openshift-multus/multus-td4fh","openshift-network-diagnostics/network-check-target-dp9sg","openshift-network-operator/iptables-alerter-qhb8h","openshift-cluster-node-tuning-operator/tuned-94hhv","openshift-dns/node-resolver-7gbnk","openshift-multus/multus-additional-cni-plugins-tbtpg","openshift-multus/network-metrics-daemon-hl7rm","openshift-ovn-kubernetes/ovnkube-node-jn2ms"] Jul 28 10:07:19.894619 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.894604 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:19.894694 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.894677 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:19.895568 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.895553 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bdxf8" Jul 28 10:07:19.897197 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.897180 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:19.898131 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.898113 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xs55g\"" Jul 28 10:07:19.898217 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.898202 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 10:07:19.898286 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.898272 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 10:07:19.898473 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.898461 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8p2v9" Jul 28 10:07:19.899621 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.899602 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-td4fh" Jul 28 10:07:19.899939 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.899895 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 10:07:19.899939 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.899935 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ld7dr\"" Jul 28 10:07:19.900104 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.900009 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 10:07:19.900456 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.900441 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 10:07:19.901577 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.901089 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:19.901577 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.901176 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:19.901577 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.901331 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 10:07:19.901577 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.901414 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 10:07:19.901577 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.901421 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b4ltr\"" Jul 28 10:07:19.901577 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.901426 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 10:07:19.902461 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.902339 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 10:07:19.902551 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.902495 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 10:07:19.902691 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.902671 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 10:07:19.903053 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.903032 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-njdjf\"" Jul 28 10:07:19.903053 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.903048 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 10:07:19.903527 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.903354 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qhb8h" Jul 28 10:07:19.904310 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.904279 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:19.905424 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.905376 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 10:07:19.905500 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.905465 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" Jul 28 10:07:19.906013 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.905997 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7gbnk" Jul 28 10:07:19.906819 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.906799 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 10:07:19.906819 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.906812 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 10:07:19.906982 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.906837 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 10:07:19.907168 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.907150 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l2vmd\"" Jul 28 10:07:19.907290 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.907274 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:19.907531 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.907442 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 10:07:19.907531 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.907520 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5sf5p\"" Jul 28 10:07:19.908645 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.908111 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 10:07:19.908645 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.908135 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 10:07:19.908645 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.908494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:19.908645 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:19.908566 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:19.908645 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.908634 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 10:07:19.908914 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.908679 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mwrwl\"" Jul 28 10:07:19.908914 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.908898 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 10:07:19.909872 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.909857 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 10:07:19.909987 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.909972 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 10:07:19.910278 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.910258 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal"] Jul 28 10:07:19.910379 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.910366 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:19.910445 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.910399 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hk6g9\"" Jul 28 10:07:19.912832 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.912816 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 10:07:19.913337 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.913322 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vz4cj\"" Jul 28 10:07:19.914304 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.914258 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 10:02:19 +0000 UTC" deadline="2028-03-07 20:19:46.422748565 +0000 UTC" Jul 28 10:07:19.914375 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.914306 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14122h12m26.508445705s" Jul 28 10:07:19.914549 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.914536 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 10:07:19.914607 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.914598 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 10:07:19.914662 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.914610 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 10:07:19.914662 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.914538 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 10:07:19.914662 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.914634 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 10:07:19.916014 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.916000 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal"] Jul 28 10:07:19.916103 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.916078 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 10:07:19.928651 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.928636 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zjnlx" Jul 28 10:07:19.935911 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.935897 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 10:07:19.937524 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.937509 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zjnlx" Jul 28 10:07:19.994225 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.994207 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 10:07:19.999936 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.999911 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-hostroot\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.000056 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.999948 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-modprobe-d\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.000056 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.999973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-systemd\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.000056 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:19.999997 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33984ebc-8151-4863-9248-fa23ffcbfb0b-cnibin\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.000056 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77bc183c-bac2-4e26-8356-039d8839f076-iptables-alerter-script\") pod \"iptables-alerter-qhb8h\" (UID: \"77bc183c-bac2-4e26-8356-039d8839f076\") " pod="openshift-network-operator/iptables-alerter-qhb8h" Jul 28 10:07:20.000056 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:20.000421 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-etc-openvswitch\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.000421 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-node-log\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.000421 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.000421 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-cni-bin\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.000421 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/727eae60-6bdf-4598-ab23-75bec23683bf-ovn-node-metrics-cert\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.000421 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-cnibin\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.000421 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-run-systemd\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.000421 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95b130cc-7b4b-41a0-8143-ccc92ef18bea-konnectivity-ca\") pod \"konnectivity-agent-bdxf8\" (UID: \"95b130cc-7b4b-41a0-8143-ccc92ef18bea\") " pod="kube-system/konnectivity-agent-bdxf8" Jul 28 10:07:20.000421 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-var-lib-cni-bin\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.000421 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000404 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-var-lib-kubelet\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-tmp\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-device-dir\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsjlr\" (UniqueName: \"kubernetes.io/projected/8d8e7605-36e7-486f-9a1f-b95586176254-kube-api-access-hsjlr\") pod \"node-ca-8p2v9\" (UID: \"8d8e7605-36e7-486f-9a1f-b95586176254\") " pod="openshift-image-registry/node-ca-8p2v9" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33984ebc-8151-4863-9248-fa23ffcbfb0b-system-cni-dir\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-systemd-units\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-log-socket\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-var-lib-cni-multus\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d8e7605-36e7-486f-9a1f-b95586176254-serviceca\") pod \"node-ca-8p2v9\" (UID: \"8d8e7605-36e7-486f-9a1f-b95586176254\") " pod="openshift-image-registry/node-ca-8p2v9" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000726 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/488696f4-3639-4b94-abca-a88c17c72588-hosts-file\") pod \"node-resolver-7gbnk\" (UID: \"488696f4-3639-4b94-abca-a88c17c72588\") " pod="openshift-dns/node-resolver-7gbnk" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000749 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-run\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-host\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d8e7605-36e7-486f-9a1f-b95586176254-host\") pod \"node-ca-8p2v9\" (UID: \"8d8e7605-36e7-486f-9a1f-b95586176254\") " pod="openshift-image-registry/node-ca-8p2v9" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/33984ebc-8151-4863-9248-fa23ffcbfb0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-cni-netd\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000922 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-cni-binary-copy\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-etc-kubernetes\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.000973 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvbls\" (UniqueName: \"kubernetes.io/projected/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-kube-api-access-pvbls\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.000989 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-tuned\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-socket-dir\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-sys-fs\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-run-ovn\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-run-multus-certs\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001218 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-sys\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33984ebc-8151-4863-9248-fa23ffcbfb0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33984ebc-8151-4863-9248-fa23ffcbfb0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd4cw\" (UniqueName: \"kubernetes.io/projected/33984ebc-8151-4863-9248-fa23ffcbfb0b-kube-api-access-cd4cw\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/727eae60-6bdf-4598-ab23-75bec23683bf-ovnkube-config\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001346 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-run-k8s-cni-cncf-io\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001369 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-var-lib-kubelet\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw2gt\" (UniqueName: \"kubernetes.io/projected/727eae60-6bdf-4598-ab23-75bec23683bf-kube-api-access-kw2gt\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001432 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77bc183c-bac2-4e26-8356-039d8839f076-host-slash\") pod \"iptables-alerter-qhb8h\" (UID: \"77bc183c-bac2-4e26-8356-039d8839f076\") " pod="openshift-network-operator/iptables-alerter-qhb8h" Jul 28 10:07:20.002007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nvzz\" (UniqueName: \"kubernetes.io/projected/77bc183c-bac2-4e26-8356-039d8839f076-kube-api-access-9nvzz\") pod \"iptables-alerter-qhb8h\" (UID: \"77bc183c-bac2-4e26-8356-039d8839f076\") " pod="openshift-network-operator/iptables-alerter-qhb8h" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-sysctl-conf\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001520 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm4tc\" (UniqueName: \"kubernetes.io/projected/a093719f-cc85-469b-80e8-52c6459c9677-kube-api-access-jm4tc\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001548 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/488696f4-3639-4b94-abca-a88c17c72588-tmp-dir\") pod \"node-resolver-7gbnk\" (UID: \"488696f4-3639-4b94-abca-a88c17c72588\") " pod="openshift-dns/node-resolver-7gbnk" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-kubernetes\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/727eae60-6bdf-4598-ab23-75bec23683bf-env-overrides\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-kubelet-config\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjwp8\" (UniqueName: \"kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8\") pod \"network-check-target-dp9sg\" (UID: \"377ae0ee-6c31-4912-aa8a-4a65119deb04\") " pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-var-lib-openvswitch\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-multus-conf-dir\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-multus-daemon-config\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-etc-selinux\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001780 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33984ebc-8151-4863-9248-fa23ffcbfb0b-os-release\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001802 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-sysconfig\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-sysctl-d\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:20.002901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-slash\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-run-netns\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-run-openvswitch\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95b130cc-7b4b-41a0-8143-ccc92ef18bea-agent-certs\") pod \"konnectivity-agent-bdxf8\" (UID: \"95b130cc-7b4b-41a0-8143-ccc92ef18bea\") " pod="kube-system/konnectivity-agent-bdxf8" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.001998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-system-cni-dir\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-multus-socket-dir-parent\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhds7\" (UniqueName: \"kubernetes.io/projected/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-kube-api-access-bhds7\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-dbus\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-kubelet\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002117 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-os-release\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002139 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-lib-modules\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/33984ebc-8151-4863-9248-fa23ffcbfb0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nz4g\" (UniqueName: \"kubernetes.io/projected/432b3c8f-7b69-4d45-97c3-d317cca6324d-kube-api-access-5nz4g\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002184 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-run-netns\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-multus-cni-dir\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.003841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w49xj\" (UniqueName: \"kubernetes.io/projected/488696f4-3639-4b94-abca-a88c17c72588-kube-api-access-w49xj\") pod \"node-resolver-7gbnk\" (UID: \"488696f4-3639-4b94-abca-a88c17c72588\") " pod="openshift-dns/node-resolver-7gbnk" Jul 28 10:07:20.004820 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/727eae60-6bdf-4598-ab23-75bec23683bf-ovnkube-script-lib\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.004820 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.002348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-registration-dir\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.102539 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-run-netns\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.102696 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.102696 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-multus-cni-dir\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.102696 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w49xj\" (UniqueName: \"kubernetes.io/projected/488696f4-3639-4b94-abca-a88c17c72588-kube-api-access-w49xj\") pod \"node-resolver-7gbnk\" (UID: \"488696f4-3639-4b94-abca-a88c17c72588\") " pod="openshift-dns/node-resolver-7gbnk" Jul 28 10:07:20.102696 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/727eae60-6bdf-4598-ab23-75bec23683bf-ovnkube-script-lib\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.102696 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-registration-dir\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.102696 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-hostroot\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.102696 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102621 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-run-netns\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-modprobe-d\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102745 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102765 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-modprobe-d\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-systemd\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102772 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-hostroot\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33984ebc-8151-4863-9248-fa23ffcbfb0b-cnibin\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102822 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-systemd\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77bc183c-bac2-4e26-8356-039d8839f076-iptables-alerter-script\") pod \"iptables-alerter-qhb8h\" (UID: \"77bc183c-bac2-4e26-8356-039d8839f076\") " pod="openshift-network-operator/iptables-alerter-qhb8h" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102852 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-multus-cni-dir\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102874 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33984ebc-8151-4863-9248-fa23ffcbfb0b-cnibin\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102924 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-registration-dir\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-etc-openvswitch\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.102983 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-etc-openvswitch\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-node-log\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.103024 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.103086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-cni-bin\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103110 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-node-log\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/727eae60-6bdf-4598-ab23-75bec23683bf-ovn-node-metrics-cert\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-cnibin\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-run-systemd\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95b130cc-7b4b-41a0-8143-ccc92ef18bea-konnectivity-ca\") pod \"konnectivity-agent-bdxf8\" (UID: \"95b130cc-7b4b-41a0-8143-ccc92ef18bea\") " pod="kube-system/konnectivity-agent-bdxf8" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-var-lib-cni-bin\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103129 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-var-lib-kubelet\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-tmp\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103319 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-device-dir\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103326 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-cnibin\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103337 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/727eae60-6bdf-4598-ab23-75bec23683bf-ovnkube-script-lib\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103344 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsjlr\" (UniqueName: \"kubernetes.io/projected/8d8e7605-36e7-486f-9a1f-b95586176254-kube-api-access-hsjlr\") pod \"node-ca-8p2v9\" (UID: \"8d8e7605-36e7-486f-9a1f-b95586176254\") " pod="openshift-image-registry/node-ca-8p2v9" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33984ebc-8151-4863-9248-fa23ffcbfb0b-system-cni-dir\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103376 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-cni-bin\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103401 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-run-systemd\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.104012 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.103432 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret podName:a49fdd3c-8942-4b34-a2f5-beb39b296bb9 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:20.603391167 +0000 UTC m=+2.082372949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret") pod "global-pull-secret-syncer-tv5ff" (UID: "a49fdd3c-8942-4b34-a2f5-beb39b296bb9") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103440 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33984ebc-8151-4863-9248-fa23ffcbfb0b-system-cni-dir\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-systemd-units\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103471 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-device-dir\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103482 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-log-socket\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103477 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-var-lib-kubelet\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103511 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-var-lib-cni-multus\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103529 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-systemd-units\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103531 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-var-lib-cni-bin\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d8e7605-36e7-486f-9a1f-b95586176254-serviceca\") pod \"node-ca-8p2v9\" (UID: \"8d8e7605-36e7-486f-9a1f-b95586176254\") " pod="openshift-image-registry/node-ca-8p2v9" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103538 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103584 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-log-socket\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/488696f4-3639-4b94-abca-a88c17c72588-hosts-file\") pod \"node-resolver-7gbnk\" (UID: \"488696f4-3639-4b94-abca-a88c17c72588\") " pod="openshift-dns/node-resolver-7gbnk" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103595 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-var-lib-cni-multus\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103619 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-run\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103628 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/488696f4-3639-4b94-abca-a88c17c72588-hosts-file\") pod \"node-resolver-7gbnk\" (UID: \"488696f4-3639-4b94-abca-a88c17c72588\") " pod="openshift-dns/node-resolver-7gbnk" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103644 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-host\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d8e7605-36e7-486f-9a1f-b95586176254-host\") pod \"node-ca-8p2v9\" (UID: \"8d8e7605-36e7-486f-9a1f-b95586176254\") " pod="openshift-image-registry/node-ca-8p2v9" Jul 28 10:07:20.104806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103696 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-run\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/33984ebc-8151-4863-9248-fa23ffcbfb0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-cni-netd\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-cni-binary-copy\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103805 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d8e7605-36e7-486f-9a1f-b95586176254-host\") pod \"node-ca-8p2v9\" (UID: \"8d8e7605-36e7-486f-9a1f-b95586176254\") " pod="openshift-image-registry/node-ca-8p2v9" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103859 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-host\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-etc-kubernetes\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvbls\" (UniqueName: \"kubernetes.io/projected/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-kube-api-access-pvbls\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103931 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95b130cc-7b4b-41a0-8143-ccc92ef18bea-konnectivity-ca\") pod \"konnectivity-agent-bdxf8\" (UID: \"95b130cc-7b4b-41a0-8143-ccc92ef18bea\") " pod="kube-system/konnectivity-agent-bdxf8" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-tuned\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103965 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-socket-dir\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103973 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77bc183c-bac2-4e26-8356-039d8839f076-iptables-alerter-script\") pod \"iptables-alerter-qhb8h\" (UID: \"77bc183c-bac2-4e26-8356-039d8839f076\") " pod="openshift-network-operator/iptables-alerter-qhb8h" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-sys-fs\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104000 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d8e7605-36e7-486f-9a1f-b95586176254-serviceca\") pod \"node-ca-8p2v9\" (UID: \"8d8e7605-36e7-486f-9a1f-b95586176254\") " pod="openshift-image-registry/node-ca-8p2v9" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104016 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-etc-kubernetes\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-run-ovn\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-run-ovn\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-run-multus-certs\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.105701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104075 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-sys-fs\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-sys\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33984ebc-8151-4863-9248-fa23ffcbfb0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104164 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-socket-dir\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33984ebc-8151-4863-9248-fa23ffcbfb0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd4cw\" (UniqueName: \"kubernetes.io/projected/33984ebc-8151-4863-9248-fa23ffcbfb0b-kube-api-access-cd4cw\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/727eae60-6bdf-4598-ab23-75bec23683bf-ovnkube-config\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.103822 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-cni-netd\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104265 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-sys\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-run-k8s-cni-cncf-io\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104303 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-run-multus-certs\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104316 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-var-lib-kubelet\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104329 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw2gt\" (UniqueName: \"kubernetes.io/projected/727eae60-6bdf-4598-ab23-75bec23683bf-kube-api-access-kw2gt\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104362 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/33984ebc-8151-4863-9248-fa23ffcbfb0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104377 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-run-k8s-cni-cncf-io\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.106327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77bc183c-bac2-4e26-8356-039d8839f076-host-slash\") pod \"iptables-alerter-qhb8h\" (UID: \"77bc183c-bac2-4e26-8356-039d8839f076\") " pod="openshift-network-operator/iptables-alerter-qhb8h" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nvzz\" (UniqueName: \"kubernetes.io/projected/77bc183c-bac2-4e26-8356-039d8839f076-kube-api-access-9nvzz\") pod \"iptables-alerter-qhb8h\" (UID: \"77bc183c-bac2-4e26-8356-039d8839f076\") " pod="openshift-network-operator/iptables-alerter-qhb8h" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104406 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77bc183c-bac2-4e26-8356-039d8839f076-host-slash\") pod \"iptables-alerter-qhb8h\" (UID: \"77bc183c-bac2-4e26-8356-039d8839f076\") " pod="openshift-network-operator/iptables-alerter-qhb8h" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104444 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33984ebc-8151-4863-9248-fa23ffcbfb0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-sysctl-conf\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104481 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-var-lib-kubelet\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm4tc\" (UniqueName: \"kubernetes.io/projected/a093719f-cc85-469b-80e8-52c6459c9677-kube-api-access-jm4tc\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/488696f4-3639-4b94-abca-a88c17c72588-tmp-dir\") pod \"node-resolver-7gbnk\" (UID: \"488696f4-3639-4b94-abca-a88c17c72588\") " pod="openshift-dns/node-resolver-7gbnk" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-kubernetes\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/727eae60-6bdf-4598-ab23-75bec23683bf-env-overrides\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-kubelet-config\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwp8\" (UniqueName: \"kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8\") pod \"network-check-target-dp9sg\" (UID: \"377ae0ee-6c31-4912-aa8a-4a65119deb04\") " pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-var-lib-openvswitch\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104669 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33984ebc-8151-4863-9248-fa23ffcbfb0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-multus-conf-dir\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-multus-daemon-config\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-etc-selinux\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.106862 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33984ebc-8151-4863-9248-fa23ffcbfb0b-os-release\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-sysconfig\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104602 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-sysctl-conf\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104825 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-sysctl-d\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104850 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/727eae60-6bdf-4598-ab23-75bec23683bf-ovnkube-config\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-slash\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104920 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-sysctl-d\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104927 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33984ebc-8151-4863-9248-fa23ffcbfb0b-os-release\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-run-netns\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104966 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-multus-conf-dir\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-run-openvswitch\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95b130cc-7b4b-41a0-8143-ccc92ef18bea-agent-certs\") pod \"konnectivity-agent-bdxf8\" (UID: \"95b130cc-7b4b-41a0-8143-ccc92ef18bea\") " pod="kube-system/konnectivity-agent-bdxf8" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-cni-binary-copy\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105024 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/727eae60-6bdf-4598-ab23-75bec23683bf-env-overrides\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-system-cni-dir\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105050 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a093719f-cc85-469b-80e8-52c6459c9677-etc-selinux\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.104822 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-kubelet-config\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:20.107512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105082 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-system-cni-dir\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105079 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-var-lib-openvswitch\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105128 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-slash\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-multus-socket-dir-parent\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105190 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-sysconfig\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhds7\" (UniqueName: \"kubernetes.io/projected/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-kube-api-access-bhds7\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-dbus\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-kubelet\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-os-release\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105312 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-dbus\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105326 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-lib-modules\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105350 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/33984ebc-8151-4863-9248-fa23ffcbfb0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105353 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-host-run-netns\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105234 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-kubernetes\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.105374 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nz4g\" (UniqueName: \"kubernetes.io/projected/432b3c8f-7b69-4d45-97c3-d317cca6324d-kube-api-access-5nz4g\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105412 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-multus-socket-dir-parent\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.108130 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.105468 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs podName:432b3c8f-7b69-4d45-97c3-d317cca6324d nodeName:}" failed. No retries permitted until 2026-07-28 10:07:20.605422395 +0000 UTC m=+2.084404182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs") pod "network-metrics-daemon-hl7rm" (UID: "432b3c8f-7b69-4d45-97c3-d317cca6324d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:20.108667 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105467 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-os-release\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.108667 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105467 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/488696f4-3639-4b94-abca-a88c17c72588-tmp-dir\") pod \"node-resolver-7gbnk\" (UID: \"488696f4-3639-4b94-abca-a88c17c72588\") " pod="openshift-dns/node-resolver-7gbnk" Jul 28 10:07:20.108667 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-run-openvswitch\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.108667 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105376 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-multus-daemon-config\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.108667 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105647 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/727eae60-6bdf-4598-ab23-75bec23683bf-host-kubelet\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.108667 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.105762 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-lib-modules\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.108667 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.106060 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/33984ebc-8151-4863-9248-fa23ffcbfb0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.108667 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.107592 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-tmp\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.108667 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.107691 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/727eae60-6bdf-4598-ab23-75bec23683bf-ovn-node-metrics-cert\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.108667 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.107815 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-etc-tuned\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.108667 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.107953 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95b130cc-7b4b-41a0-8143-ccc92ef18bea-agent-certs\") pod \"konnectivity-agent-bdxf8\" (UID: \"95b130cc-7b4b-41a0-8143-ccc92ef18bea\") " pod="kube-system/konnectivity-agent-bdxf8" Jul 28 10:07:20.111353 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.111333 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:07:20.111453 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.111356 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:07:20.111453 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.111369 2581 projected.go:196] Error preparing data for projected volume kube-api-access-vjwp8 for pod openshift-network-diagnostics/network-check-target-dp9sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:20.111453 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.111429 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8 podName:377ae0ee-6c31-4912-aa8a-4a65119deb04 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:20.611417756 +0000 UTC m=+2.090399531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vjwp8" (UniqueName: "kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8") pod "network-check-target-dp9sg" (UID: "377ae0ee-6c31-4912-aa8a-4a65119deb04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:20.112564 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.112525 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w49xj\" (UniqueName: \"kubernetes.io/projected/488696f4-3639-4b94-abca-a88c17c72588-kube-api-access-w49xj\") pod \"node-resolver-7gbnk\" (UID: \"488696f4-3639-4b94-abca-a88c17c72588\") " pod="openshift-dns/node-resolver-7gbnk" Jul 28 10:07:20.114044 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.114016 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd4cw\" (UniqueName: \"kubernetes.io/projected/33984ebc-8151-4863-9248-fa23ffcbfb0b-kube-api-access-cd4cw\") pod \"multus-additional-cni-plugins-tbtpg\" (UID: \"33984ebc-8151-4863-9248-fa23ffcbfb0b\") " pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.114883 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.114857 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvbls\" (UniqueName: \"kubernetes.io/projected/b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4-kube-api-access-pvbls\") pod \"multus-td4fh\" (UID: \"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4\") " pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.115817 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.115795 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhds7\" (UniqueName: \"kubernetes.io/projected/7fc3ff78-e93e-496f-9d82-3ec4c9410d93-kube-api-access-bhds7\") pod \"tuned-94hhv\" (UID: \"7fc3ff78-e93e-496f-9d82-3ec4c9410d93\") " pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.115925 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.115848 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsjlr\" (UniqueName: \"kubernetes.io/projected/8d8e7605-36e7-486f-9a1f-b95586176254-kube-api-access-hsjlr\") pod \"node-ca-8p2v9\" (UID: \"8d8e7605-36e7-486f-9a1f-b95586176254\") " pod="openshift-image-registry/node-ca-8p2v9" Jul 28 10:07:20.115925 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.115871 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm4tc\" (UniqueName: \"kubernetes.io/projected/a093719f-cc85-469b-80e8-52c6459c9677-kube-api-access-jm4tc\") pod \"aws-ebs-csi-driver-node-zwlhx\" (UID: \"a093719f-cc85-469b-80e8-52c6459c9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.116220 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:20.116191 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ad5f76fc6bb2a29bad07b46c5e652c.slice/crio-a1db719edbc8dc1aa3a9fbf2c97912b6a75b13e6682d10f121f043e0ead0402e WatchSource:0}: Error finding container a1db719edbc8dc1aa3a9fbf2c97912b6a75b13e6682d10f121f043e0ead0402e: Status 404 returned error can't find the container with id a1db719edbc8dc1aa3a9fbf2c97912b6a75b13e6682d10f121f043e0ead0402e Jul 28 10:07:20.116220 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.116204 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nz4g\" (UniqueName: \"kubernetes.io/projected/432b3c8f-7b69-4d45-97c3-d317cca6324d-kube-api-access-5nz4g\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:20.116374 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.116300 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nvzz\" (UniqueName: \"kubernetes.io/projected/77bc183c-bac2-4e26-8356-039d8839f076-kube-api-access-9nvzz\") pod \"iptables-alerter-qhb8h\" (UID: \"77bc183c-bac2-4e26-8356-039d8839f076\") " pod="openshift-network-operator/iptables-alerter-qhb8h" Jul 28 10:07:20.117529 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.117502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw2gt\" (UniqueName: \"kubernetes.io/projected/727eae60-6bdf-4598-ab23-75bec23683bf-kube-api-access-kw2gt\") pod \"ovnkube-node-jn2ms\" (UID: \"727eae60-6bdf-4598-ab23-75bec23683bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.119846 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.119833 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 10:07:20.225577 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.225491 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bdxf8" Jul 28 10:07:20.232774 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.232751 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" Jul 28 10:07:20.235295 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:20.235269 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b130cc_7b4b_41a0_8143_ccc92ef18bea.slice/crio-e57529b856a296edaa35dcec50859b3e459dfec0253f861866f6613edbfc0778 WatchSource:0}: Error finding container e57529b856a296edaa35dcec50859b3e459dfec0253f861866f6613edbfc0778: Status 404 returned error can't find the container with id e57529b856a296edaa35dcec50859b3e459dfec0253f861866f6613edbfc0778 Jul 28 10:07:20.240498 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:20.240479 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda093719f_cc85_469b_80e8_52c6459c9677.slice/crio-b2e01ab36f5099ae3493cee44399d6a88df64903396d341975fc69b248af4409 WatchSource:0}: Error finding container b2e01ab36f5099ae3493cee44399d6a88df64903396d341975fc69b248af4409: Status 404 returned error can't find the container with id b2e01ab36f5099ae3493cee44399d6a88df64903396d341975fc69b248af4409 Jul 28 10:07:20.250270 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.250251 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8p2v9" Jul 28 10:07:20.258317 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:20.258288 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d8e7605_36e7_486f_9a1f_b95586176254.slice/crio-28c2ac437f5996f237403a439ab9afc88b164bf6052585d17168a5eb11dab306 WatchSource:0}: Error finding container 28c2ac437f5996f237403a439ab9afc88b164bf6052585d17168a5eb11dab306: Status 404 returned error can't find the container with id 28c2ac437f5996f237403a439ab9afc88b164bf6052585d17168a5eb11dab306 Jul 28 10:07:20.262254 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.262238 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-td4fh" Jul 28 10:07:20.270459 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:20.270439 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb53e26e8_d2a5_43e4_acc4_e8f34cff1ee4.slice/crio-938ca0416ab360e2aee3569e7be781a3acaae2b450289d13ee05514592ca659f WatchSource:0}: Error finding container 938ca0416ab360e2aee3569e7be781a3acaae2b450289d13ee05514592ca659f: Status 404 returned error can't find the container with id 938ca0416ab360e2aee3569e7be781a3acaae2b450289d13ee05514592ca659f Jul 28 10:07:20.280662 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.280643 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qhb8h" Jul 28 10:07:20.287549 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:20.287529 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bc183c_bac2_4e26_8356_039d8839f076.slice/crio-30eea284e018a34c0871f32c1bf9b5cec6b01eeab34b1f4cb712520d6980cd93 WatchSource:0}: Error finding container 30eea284e018a34c0871f32c1bf9b5cec6b01eeab34b1f4cb712520d6980cd93: Status 404 returned error can't find the container with id 30eea284e018a34c0871f32c1bf9b5cec6b01eeab34b1f4cb712520d6980cd93 Jul 28 10:07:20.305100 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.305061 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-94hhv" Jul 28 10:07:20.311798 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:20.311748 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc3ff78_e93e_496f_9d82_3ec4c9410d93.slice/crio-95059b4c8c71df0026b48f7a442793149069d4d62938a9b6674c3c24c77eb79e WatchSource:0}: Error finding container 95059b4c8c71df0026b48f7a442793149069d4d62938a9b6674c3c24c77eb79e: Status 404 returned error can't find the container with id 95059b4c8c71df0026b48f7a442793149069d4d62938a9b6674c3c24c77eb79e Jul 28 10:07:20.319611 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.319592 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 10:07:20.331493 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.331470 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7gbnk" Jul 28 10:07:20.338071 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:20.338047 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488696f4_3639_4b94_abca_a88c17c72588.slice/crio-6882e550a14ff2f017237a7399828a931f2480f84e5d2def778f16be75d400a0 WatchSource:0}: Error finding container 6882e550a14ff2f017237a7399828a931f2480f84e5d2def778f16be75d400a0: Status 404 returned error can't find the container with id 6882e550a14ff2f017237a7399828a931f2480f84e5d2def778f16be75d400a0 Jul 28 10:07:20.345485 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.345469 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tbtpg" Jul 28 10:07:20.351234 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.351211 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:20.352002 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:20.351982 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33984ebc_8151_4863_9248_fa23ffcbfb0b.slice/crio-8745e37ca87f5fdfb5ca35888bcdcd7079df350e5ddb4c5db51aae6e6aa4f79a WatchSource:0}: Error finding container 8745e37ca87f5fdfb5ca35888bcdcd7079df350e5ddb4c5db51aae6e6aa4f79a: Status 404 returned error can't find the container with id 8745e37ca87f5fdfb5ca35888bcdcd7079df350e5ddb4c5db51aae6e6aa4f79a Jul 28 10:07:20.358253 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:20.358234 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727eae60_6bdf_4598_ab23_75bec23683bf.slice/crio-97ea793f6269b41c8fe131e6026ef1881ee84bbff02dd19bfdd7125ae69b58fc WatchSource:0}: Error finding container 97ea793f6269b41c8fe131e6026ef1881ee84bbff02dd19bfdd7125ae69b58fc: Status 404 returned error can't find the container with id 97ea793f6269b41c8fe131e6026ef1881ee84bbff02dd19bfdd7125ae69b58fc Jul 28 10:07:20.609447 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.609407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:20.609664 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.609526 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:20.609664 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.609556 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:20.609664 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.609621 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret podName:a49fdd3c-8942-4b34-a2f5-beb39b296bb9 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:21.609599678 +0000 UTC m=+3.088581452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret") pod "global-pull-secret-syncer-tv5ff" (UID: "a49fdd3c-8942-4b34-a2f5-beb39b296bb9") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:20.609664 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.609628 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:20.609856 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.609690 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs podName:432b3c8f-7b69-4d45-97c3-d317cca6324d nodeName:}" failed. No retries permitted until 2026-07-28 10:07:21.609677226 +0000 UTC m=+3.088659008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs") pod "network-metrics-daemon-hl7rm" (UID: "432b3c8f-7b69-4d45-97c3-d317cca6324d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:20.711015 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.710969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwp8\" (UniqueName: \"kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8\") pod \"network-check-target-dp9sg\" (UID: \"377ae0ee-6c31-4912-aa8a-4a65119deb04\") " pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:20.711211 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.711181 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:07:20.711211 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.711202 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:07:20.711339 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.711217 2581 projected.go:196] Error preparing data for projected volume kube-api-access-vjwp8 for pod openshift-network-diagnostics/network-check-target-dp9sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:20.711339 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:20.711278 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8 podName:377ae0ee-6c31-4912-aa8a-4a65119deb04 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:21.711257218 +0000 UTC m=+3.190238997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjwp8" (UniqueName: "kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8") pod "network-check-target-dp9sg" (UID: "377ae0ee-6c31-4912-aa8a-4a65119deb04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:20.768237 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:07:20.768198 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod974cc7dfc517ee12891de16f2d92c67b.slice/crio-0a80437c6ff14e61848eed0fbc6556fc3b4f4108781c226eba4798c4573f4d9d WatchSource:0}: Error finding container 0a80437c6ff14e61848eed0fbc6556fc3b4f4108781c226eba4798c4573f4d9d: Status 404 returned error can't find the container with id 0a80437c6ff14e61848eed0fbc6556fc3b4f4108781c226eba4798c4573f4d9d Jul 28 10:07:20.940492 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.940315 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 10:02:20 +0000 UTC" deadline="2028-05-12 13:47:32.352518202 +0000 UTC" Jul 28 10:07:20.940492 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.940383 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15699h40m11.4121407s" Jul 28 10:07:20.972280 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:20.972052 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 10:07:21.093816 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.091512 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:21.093816 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:21.091656 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:21.093816 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.092076 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:21.093816 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:21.092200 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:21.111791 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.111736 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" event={"ID":"974cc7dfc517ee12891de16f2d92c67b","Type":"ContainerStarted","Data":"0a80437c6ff14e61848eed0fbc6556fc3b4f4108781c226eba4798c4573f4d9d"} Jul 28 10:07:21.119060 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.119029 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbtpg" event={"ID":"33984ebc-8151-4863-9248-fa23ffcbfb0b","Type":"ContainerStarted","Data":"8745e37ca87f5fdfb5ca35888bcdcd7079df350e5ddb4c5db51aae6e6aa4f79a"} Jul 28 10:07:21.123925 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.123896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7gbnk" event={"ID":"488696f4-3639-4b94-abca-a88c17c72588","Type":"ContainerStarted","Data":"6882e550a14ff2f017237a7399828a931f2480f84e5d2def778f16be75d400a0"} Jul 28 10:07:21.125664 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.125638 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-94hhv" event={"ID":"7fc3ff78-e93e-496f-9d82-3ec4c9410d93","Type":"ContainerStarted","Data":"95059b4c8c71df0026b48f7a442793149069d4d62938a9b6674c3c24c77eb79e"} Jul 28 10:07:21.127668 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.127642 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qhb8h" event={"ID":"77bc183c-bac2-4e26-8356-039d8839f076","Type":"ContainerStarted","Data":"30eea284e018a34c0871f32c1bf9b5cec6b01eeab34b1f4cb712520d6980cd93"} Jul 28 10:07:21.129573 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.129549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bdxf8" event={"ID":"95b130cc-7b4b-41a0-8143-ccc92ef18bea","Type":"ContainerStarted","Data":"e57529b856a296edaa35dcec50859b3e459dfec0253f861866f6613edbfc0778"} Jul 28 10:07:21.133185 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.133156 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" event={"ID":"727eae60-6bdf-4598-ab23-75bec23683bf","Type":"ContainerStarted","Data":"97ea793f6269b41c8fe131e6026ef1881ee84bbff02dd19bfdd7125ae69b58fc"} Jul 28 10:07:21.146204 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.146174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-td4fh" event={"ID":"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4","Type":"ContainerStarted","Data":"938ca0416ab360e2aee3569e7be781a3acaae2b450289d13ee05514592ca659f"} Jul 28 10:07:21.158525 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.158495 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8p2v9" event={"ID":"8d8e7605-36e7-486f-9a1f-b95586176254","Type":"ContainerStarted","Data":"28c2ac437f5996f237403a439ab9afc88b164bf6052585d17168a5eb11dab306"} Jul 28 10:07:21.171329 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.171246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" event={"ID":"a093719f-cc85-469b-80e8-52c6459c9677","Type":"ContainerStarted","Data":"b2e01ab36f5099ae3493cee44399d6a88df64903396d341975fc69b248af4409"} Jul 28 10:07:21.179426 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.179369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" event={"ID":"f7ad5f76fc6bb2a29bad07b46c5e652c","Type":"ContainerStarted","Data":"a1db719edbc8dc1aa3a9fbf2c97912b6a75b13e6682d10f121f043e0ead0402e"} Jul 28 10:07:21.617952 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.617783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:21.617952 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.617879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:21.618239 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:21.618016 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:21.618239 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:21.618078 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs podName:432b3c8f-7b69-4d45-97c3-d317cca6324d nodeName:}" failed. No retries permitted until 2026-07-28 10:07:23.618059875 +0000 UTC m=+5.097041655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs") pod "network-metrics-daemon-hl7rm" (UID: "432b3c8f-7b69-4d45-97c3-d317cca6324d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:21.618677 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:21.618498 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:21.618677 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:21.618555 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret podName:a49fdd3c-8942-4b34-a2f5-beb39b296bb9 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:23.618539057 +0000 UTC m=+5.097520850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret") pod "global-pull-secret-syncer-tv5ff" (UID: "a49fdd3c-8942-4b34-a2f5-beb39b296bb9") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:21.719461 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:21.719430 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:07:21.719461 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:21.719467 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:07:21.719691 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:21.719483 2581 projected.go:196] Error preparing data for projected volume kube-api-access-vjwp8 for pod openshift-network-diagnostics/network-check-target-dp9sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:21.719691 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:21.719543 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8 podName:377ae0ee-6c31-4912-aa8a-4a65119deb04 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:23.719523894 +0000 UTC m=+5.198505675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjwp8" (UniqueName: "kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8") pod "network-check-target-dp9sg" (UID: "377ae0ee-6c31-4912-aa8a-4a65119deb04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:21.719900 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.719170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwp8\" (UniqueName: \"kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8\") pod \"network-check-target-dp9sg\" (UID: \"377ae0ee-6c31-4912-aa8a-4a65119deb04\") " pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:21.940995 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.940888 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 10:02:20 +0000 UTC" deadline="2028-03-31 15:20:42.258495997 +0000 UTC" Jul 28 10:07:21.940995 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:21.940932 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14693h13m20.31756866s" Jul 28 10:07:22.095924 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:22.095376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:22.095924 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:22.095526 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:22.103518 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:22.103321 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 10:07:23.092307 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:23.092271 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:23.092958 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:23.092415 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:23.092958 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:23.092871 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:23.093083 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:23.092967 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:23.636095 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:23.636041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:23.636273 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:23.636127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:23.636351 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:23.636277 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:23.636408 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:23.636374 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret podName:a49fdd3c-8942-4b34-a2f5-beb39b296bb9 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:27.636323092 +0000 UTC m=+9.115304871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret") pod "global-pull-secret-syncer-tv5ff" (UID: "a49fdd3c-8942-4b34-a2f5-beb39b296bb9") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:23.636861 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:23.636841 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:23.636969 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:23.636903 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs podName:432b3c8f-7b69-4d45-97c3-d317cca6324d nodeName:}" failed. No retries permitted until 2026-07-28 10:07:27.636884314 +0000 UTC m=+9.115866096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs") pod "network-metrics-daemon-hl7rm" (UID: "432b3c8f-7b69-4d45-97c3-d317cca6324d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:23.737541 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:23.737499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwp8\" (UniqueName: \"kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8\") pod \"network-check-target-dp9sg\" (UID: \"377ae0ee-6c31-4912-aa8a-4a65119deb04\") " pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:23.737771 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:23.737703 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:07:23.737771 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:23.737727 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:07:23.737771 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:23.737742 2581 projected.go:196] Error preparing data for projected volume kube-api-access-vjwp8 for pod openshift-network-diagnostics/network-check-target-dp9sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:23.737954 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:23.737804 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8 podName:377ae0ee-6c31-4912-aa8a-4a65119deb04 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:27.737784989 +0000 UTC m=+9.216766783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjwp8" (UniqueName: "kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8") pod "network-check-target-dp9sg" (UID: "377ae0ee-6c31-4912-aa8a-4a65119deb04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:24.090651 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:24.090600 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:24.090837 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:24.090750 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:25.090934 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:25.090822 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:25.090934 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:25.090884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:25.091604 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:25.090976 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:25.091604 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:25.091422 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:26.091336 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:26.091302 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:26.091772 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:26.091449 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:27.092224 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:27.091617 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:27.092224 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:27.091757 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:27.092224 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:27.091831 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:27.092224 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:27.091943 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:27.667303 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:27.667262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:27.667487 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:27.667333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:27.667487 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:27.667470 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:27.667603 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:27.667534 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret podName:a49fdd3c-8942-4b34-a2f5-beb39b296bb9 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:35.667513701 +0000 UTC m=+17.146495476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret") pod "global-pull-secret-syncer-tv5ff" (UID: "a49fdd3c-8942-4b34-a2f5-beb39b296bb9") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:27.667752 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:27.667730 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:27.667811 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:27.667802 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs podName:432b3c8f-7b69-4d45-97c3-d317cca6324d nodeName:}" failed. No retries permitted until 2026-07-28 10:07:35.667783487 +0000 UTC m=+17.146765275 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs") pod "network-metrics-daemon-hl7rm" (UID: "432b3c8f-7b69-4d45-97c3-d317cca6324d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:27.768396 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:27.768338 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwp8\" (UniqueName: \"kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8\") pod \"network-check-target-dp9sg\" (UID: \"377ae0ee-6c31-4912-aa8a-4a65119deb04\") " pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:27.768558 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:27.768545 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:07:27.768604 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:27.768569 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:07:27.768604 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:27.768583 2581 projected.go:196] Error preparing data for projected volume kube-api-access-vjwp8 for pod openshift-network-diagnostics/network-check-target-dp9sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:27.768726 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:27.768639 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8 podName:377ae0ee-6c31-4912-aa8a-4a65119deb04 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:35.768619512 +0000 UTC m=+17.247601323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjwp8" (UniqueName: "kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8") pod "network-check-target-dp9sg" (UID: "377ae0ee-6c31-4912-aa8a-4a65119deb04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:28.091102 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:28.090813 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:28.091102 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:28.090950 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:29.092425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:29.092217 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:29.092896 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:29.092315 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:29.092896 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:29.092502 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:29.092896 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:29.092617 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:30.090812 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:30.090781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:30.090967 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:30.090918 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:31.090783 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:31.090707 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:31.090783 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:31.090737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:31.091305 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:31.090836 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:31.091305 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:31.091214 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:32.091008 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:32.090979 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:32.091396 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:32.091136 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:33.091481 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:33.091449 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:33.091866 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:33.091449 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:33.091866 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:33.091568 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:33.091866 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:33.091616 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:34.090803 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:34.090770 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:34.090961 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:34.090885 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:35.091558 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:35.091522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:35.091975 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:35.091522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:35.091975 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:35.091642 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:35.091975 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:35.091686 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:35.725351 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:35.725324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:35.725494 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:35.725364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:35.725494 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:35.725471 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:35.725494 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:35.725472 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:35.725604 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:35.725514 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret podName:a49fdd3c-8942-4b34-a2f5-beb39b296bb9 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:51.72550121 +0000 UTC m=+33.204482983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret") pod "global-pull-secret-syncer-tv5ff" (UID: "a49fdd3c-8942-4b34-a2f5-beb39b296bb9") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:35.725604 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:35.725526 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs podName:432b3c8f-7b69-4d45-97c3-d317cca6324d nodeName:}" failed. No retries permitted until 2026-07-28 10:07:51.72551976 +0000 UTC m=+33.204501532 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs") pod "network-metrics-daemon-hl7rm" (UID: "432b3c8f-7b69-4d45-97c3-d317cca6324d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:35.826496 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:35.826462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwp8\" (UniqueName: \"kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8\") pod \"network-check-target-dp9sg\" (UID: \"377ae0ee-6c31-4912-aa8a-4a65119deb04\") " pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:35.826641 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:35.826621 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:07:35.826684 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:35.826651 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:07:35.826684 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:35.826664 2581 projected.go:196] Error preparing data for projected volume kube-api-access-vjwp8 for pod openshift-network-diagnostics/network-check-target-dp9sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:35.826758 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:35.826725 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8 podName:377ae0ee-6c31-4912-aa8a-4a65119deb04 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:51.826706426 +0000 UTC m=+33.305688225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjwp8" (UniqueName: "kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8") pod "network-check-target-dp9sg" (UID: "377ae0ee-6c31-4912-aa8a-4a65119deb04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:36.091373 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:36.091345 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:36.091552 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:36.091469 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:37.090908 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:37.090869 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:37.091589 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:37.091007 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:37.091589 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:37.090869 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:37.091589 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:37.091187 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:38.090700 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:38.090671 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:38.090866 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:38.090783 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:39.091890 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:39.091851 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:39.092369 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:39.091955 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:39.092369 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:39.092081 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:39.092369 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:39.092165 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:40.090658 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:40.090640 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:40.090764 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:40.090747 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:40.217188 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:40.217137 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" event={"ID":"f7ad5f76fc6bb2a29bad07b46c5e652c","Type":"ContainerStarted","Data":"bd38e3538e271c3873948d7ff50c4f760adab36dcb635b5a392e7eb391375129"} Jul 28 10:07:40.235790 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:40.235749 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" podStartSLOduration=20.235736513 podStartE2EDuration="20.235736513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:40.23525964 +0000 UTC m=+21.714241435" watchObservedRunningTime="2026-07-28 10:07:40.235736513 +0000 UTC m=+21.714718308" Jul 28 10:07:41.091478 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.091267 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:41.091621 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.091320 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:41.091621 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:41.091581 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:41.091720 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:41.091642 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:41.220567 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.220536 2581 generic.go:356] "Generic (PLEG): container finished" podID="974cc7dfc517ee12891de16f2d92c67b" containerID="82c2c747c257ef9adcf8f1c133fd73b1d74c33495a46f2e0c5582912f6293fc5" exitCode=0 Jul 28 10:07:41.221297 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.220621 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" event={"ID":"974cc7dfc517ee12891de16f2d92c67b","Type":"ContainerDied","Data":"82c2c747c257ef9adcf8f1c133fd73b1d74c33495a46f2e0c5582912f6293fc5"} Jul 28 10:07:41.222149 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.222125 2581 generic.go:356] "Generic (PLEG): container finished" podID="33984ebc-8151-4863-9248-fa23ffcbfb0b" containerID="2eaf7d1555fcab53bb8402714066a2afcbb4cf15dfdf34ac2d0dc8bed078b6b5" exitCode=0 Jul 28 10:07:41.222265 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.222198 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbtpg" event={"ID":"33984ebc-8151-4863-9248-fa23ffcbfb0b","Type":"ContainerDied","Data":"2eaf7d1555fcab53bb8402714066a2afcbb4cf15dfdf34ac2d0dc8bed078b6b5"} Jul 28 10:07:41.223683 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.223558 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7gbnk" event={"ID":"488696f4-3639-4b94-abca-a88c17c72588","Type":"ContainerStarted","Data":"3115d7109d1771dd4d6ee2661441266132f2f03f0d01b1fa6bd78171a8931bb3"} Jul 28 10:07:41.225117 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.225096 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-94hhv" event={"ID":"7fc3ff78-e93e-496f-9d82-3ec4c9410d93","Type":"ContainerStarted","Data":"175aee64350c678bd62b73623d50ccd717d35c9896c9c851bddfd1b010ee5d62"} Jul 28 10:07:41.226527 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.226509 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bdxf8" event={"ID":"95b130cc-7b4b-41a0-8143-ccc92ef18bea","Type":"ContainerStarted","Data":"770b776881fc7e83e44ace8089df40fca877dc4d18bab3b24d05dfb355782ae9"} Jul 28 10:07:41.229528 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.229512 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:07:41.229836 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.229820 2581 generic.go:356] "Generic (PLEG): container finished" podID="727eae60-6bdf-4598-ab23-75bec23683bf" containerID="98b7f1db770e5275127345667b7be60940c52ebaf52c69694a160c0f566eeec0" exitCode=1 Jul 28 10:07:41.229903 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.229889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" event={"ID":"727eae60-6bdf-4598-ab23-75bec23683bf","Type":"ContainerStarted","Data":"c779041ee3c648656237fc2dd597fc8e553c6b40345bcf0adb389ef00e4e9bfd"} Jul 28 10:07:41.229953 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.229939 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" event={"ID":"727eae60-6bdf-4598-ab23-75bec23683bf","Type":"ContainerStarted","Data":"c83639b802c03a0cef9270f718b9daf92bf02a97903e38400b2146bd633c7fdd"} Jul 28 10:07:41.229989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.229977 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" event={"ID":"727eae60-6bdf-4598-ab23-75bec23683bf","Type":"ContainerStarted","Data":"e50ab831dec9bdcc894bddf51f3475f92f0c632c5afbac1f539cae313c042e99"} Jul 28 10:07:41.230026 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.230007 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" event={"ID":"727eae60-6bdf-4598-ab23-75bec23683bf","Type":"ContainerStarted","Data":"08800ac6cb20b4da5a41d494911acb1f8ecc5422a5e7b63e60d771efb3d14889"} Jul 28 10:07:41.230060 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.230036 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" event={"ID":"727eae60-6bdf-4598-ab23-75bec23683bf","Type":"ContainerDied","Data":"98b7f1db770e5275127345667b7be60940c52ebaf52c69694a160c0f566eeec0"} Jul 28 10:07:41.230120 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.230096 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" event={"ID":"727eae60-6bdf-4598-ab23-75bec23683bf","Type":"ContainerStarted","Data":"2523c83cbc06a1a62d9778df1bce4c308bcb7713fdcf5f7dfa23ee7c39650ed0"} Jul 28 10:07:41.231150 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.231132 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-td4fh" event={"ID":"b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4","Type":"ContainerStarted","Data":"3c4e505edcb23fee4fc363bbc58a8719ef02c27217d657f7b20810c170612c9c"} Jul 28 10:07:41.232226 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.232210 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8p2v9" event={"ID":"8d8e7605-36e7-486f-9a1f-b95586176254","Type":"ContainerStarted","Data":"7034f4140873f8de9b22550039b5826d839ab586b26ab06fea9da9477ddf7199"} Jul 28 10:07:41.233326 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.233309 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" event={"ID":"a093719f-cc85-469b-80e8-52c6459c9677","Type":"ContainerStarted","Data":"9bf8ed65653b6f264f8f8992735c08f10ec00424f49fa77c76fa14d800f459d1"} Jul 28 10:07:41.253710 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.253664 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bdxf8" podStartSLOduration=2.512227502 podStartE2EDuration="22.253648003s" totalImagesPullingTime="19.741420501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:41.252610728 +0000 UTC m=+22.731592522" watchObservedRunningTime="2026-07-28 10:07:41.253648003 +0000 UTC m=+22.732629799" Jul 28 10:07:41.269526 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.269493 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7gbnk" podStartSLOduration=2.629805946 podStartE2EDuration="22.269478833s" totalImagesPullingTime="19.639672887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:41.26901567 +0000 UTC m=+22.747997464" watchObservedRunningTime="2026-07-28 10:07:41.269478833 +0000 UTC m=+22.748460627" Jul 28 10:07:41.288917 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.288883 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-94hhv" podStartSLOduration=2.622253764 podStartE2EDuration="22.288870914s" totalImagesPullingTime="19.66661715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:41.288640187 +0000 UTC m=+22.767621975" watchObservedRunningTime="2026-07-28 10:07:41.288870914 +0000 UTC m=+22.767852708" Jul 28 10:07:41.330097 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.330038 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8p2v9" podStartSLOduration=2.610567757 podStartE2EDuration="22.33002484s" totalImagesPullingTime="19.719457083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:41.329796335 +0000 UTC m=+22.808778129" watchObservedRunningTime="2026-07-28 10:07:41.33002484 +0000 UTC m=+22.809006635" Jul 28 10:07:41.347903 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.347870 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-td4fh" podStartSLOduration=2.172986049 podStartE2EDuration="22.347858609s" totalImagesPullingTime="20.17487256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:41.347823075 +0000 UTC m=+22.826804869" watchObservedRunningTime="2026-07-28 10:07:41.347858609 +0000 UTC m=+22.826840382" Jul 28 10:07:41.404728 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.404696 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:41.473107 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.473029 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:41.530033 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:41.530011 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:42.091312 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:42.091277 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:42.091673 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:42.091413 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:42.237397 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:42.237359 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qhb8h" event={"ID":"77bc183c-bac2-4e26-8356-039d8839f076","Type":"ContainerStarted","Data":"7dfe6f8ca5723facfbde9082f7a331264acf635aaddc49a51f9d1a5ebfaff629"} Jul 28 10:07:42.239487 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:42.239430 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" event={"ID":"974cc7dfc517ee12891de16f2d92c67b","Type":"ContainerStarted","Data":"f67a47d65908494190f56130ed38ae00d79db63f874b5a38bc9f631938cbd8f8"} Jul 28 10:07:42.252557 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:42.252510 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qhb8h" podStartSLOduration=3.563051267 podStartE2EDuration="23.252496005s" totalImagesPullingTime="19.689444738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:42.252304063 +0000 UTC m=+23.731285858" watchObservedRunningTime="2026-07-28 10:07:42.252496005 +0000 UTC m=+23.731477800" Jul 28 10:07:42.267380 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:42.267343 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" podStartSLOduration=22.267330038 podStartE2EDuration="22.267330038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:42.26673096 +0000 UTC m=+23.745712757" watchObservedRunningTime="2026-07-28 10:07:42.267330038 +0000 UTC m=+23.746311834" Jul 28 10:07:42.381482 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:42.381452 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:42.415219 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:42.415197 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 10:07:42.481860 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:42.481834 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:42.955810 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:42.955564 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T10:07:42.415214318Z","UUID":"b75039d4-9a5f-4ce5-9d9f-17d5b271297f","Handler":null,"Name":"","Endpoint":""} Jul 28 10:07:42.958049 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:42.957288 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 10:07:42.958049 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:42.957328 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 10:07:43.091203 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:43.091175 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:43.091351 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:43.091310 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:43.091421 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:43.091369 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:43.091499 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:43.091474 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:43.096221 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:43.096199 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:43.198164 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:43.198130 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:43.246119 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:43.246034 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:07:43.246539 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:43.246512 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" event={"ID":"727eae60-6bdf-4598-ab23-75bec23683bf","Type":"ContainerStarted","Data":"2d88647bce43c11592196fecf7252ebe929040708129244c43b96b97e9a2ffe0"} Jul 28 10:07:43.248689 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:43.248661 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" event={"ID":"a093719f-cc85-469b-80e8-52c6459c9677","Type":"ContainerStarted","Data":"629a24b88bd7383d4b32dc35ec7f4d047f7000fc6ef7528ad85da3cef93f909b"} Jul 28 10:07:43.522336 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:43.522255 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bdxf8" Jul 28 10:07:43.522917 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:43.522898 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bdxf8" Jul 28 10:07:44.090741 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:44.090539 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:44.090898 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:44.090826 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:44.252952 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:44.252917 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" event={"ID":"a093719f-cc85-469b-80e8-52c6459c9677","Type":"ContainerStarted","Data":"f569728d09bd0e393aeb7a9ad1b410ea175c4bbb9d1a4624bf5ca8869b411ec2"} Jul 28 10:07:44.253402 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:44.253211 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bdxf8" Jul 28 10:07:44.253875 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:44.253855 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bdxf8" Jul 28 10:07:44.262273 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:44.262252 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:44.275619 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:44.275575 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwlhx" podStartSLOduration=2.763933716 podStartE2EDuration="25.275561622s" totalImagesPullingTime="22.511627906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:44.274397814 +0000 UTC m=+25.753379622" watchObservedRunningTime="2026-07-28 10:07:44.275561622 +0000 UTC m=+25.754543416" Jul 28 10:07:44.362984 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:44.362917 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:44.426193 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:44.426164 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:44.518996 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:44.518967 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:44.784630 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:44.784543 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:45.091307 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:45.091277 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:45.091493 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:45.091408 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:45.091493 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:45.091465 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:45.091607 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:45.091572 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:46.040043 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:46.039808 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:46.091004 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:46.090982 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:46.091136 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:46.091091 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:46.141091 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:46.141056 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:46.259361 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:46.259342 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:07:46.259745 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:46.259725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" event={"ID":"727eae60-6bdf-4598-ab23-75bec23683bf","Type":"ContainerStarted","Data":"f63ea4e3e7fd6e08c000e5133764f1d484408e23d74c6191b101219d44c87cdb"} Jul 28 10:07:46.260056 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:46.260004 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:46.260183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:46.260167 2581 scope.go:117] "RemoveContainer" containerID="98b7f1db770e5275127345667b7be60940c52ebaf52c69694a160c0f566eeec0" Jul 28 10:07:46.261682 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:46.261659 2581 generic.go:356] "Generic (PLEG): container finished" podID="33984ebc-8151-4863-9248-fa23ffcbfb0b" containerID="56729317137bb621250fa5285fac633e14d9ba9479eb18c6caf8be6abf8d87e5" exitCode=0 Jul 28 10:07:46.261763 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:46.261691 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbtpg" event={"ID":"33984ebc-8151-4863-9248-fa23ffcbfb0b","Type":"ContainerDied","Data":"56729317137bb621250fa5285fac633e14d9ba9479eb18c6caf8be6abf8d87e5"} Jul 28 10:07:46.275622 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:46.275603 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:46.639296 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:46.639261 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:46.739838 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:46.739813 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:47.091120 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.091092 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:47.091495 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.091092 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:47.091495 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:47.091210 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:47.091495 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:47.091253 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:47.267188 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.267164 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:07:47.267506 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.267485 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" event={"ID":"727eae60-6bdf-4598-ab23-75bec23683bf","Type":"ContainerStarted","Data":"30461b67eb8808fa9150ddc73624d655df1a68856ea200a5cdd6efac7fa6fa45"} Jul 28 10:07:47.267585 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.267573 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 10:07:47.267824 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.267808 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:47.282617 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.282595 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:47.306841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.306801 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" podStartSLOduration=8.648883632 podStartE2EDuration="28.306788052s" totalImagesPullingTime="19.65790442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:47.306244965 +0000 UTC m=+28.785226760" watchObservedRunningTime="2026-07-28 10:07:47.306788052 +0000 UTC m=+28.785769847" Jul 28 10:07:47.571846 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.571564 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hl7rm"] Jul 28 10:07:47.571846 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.571764 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:47.572049 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:47.571929 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:47.575519 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.575501 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dp9sg"] Jul 28 10:07:47.575597 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.575587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:47.575694 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:47.575677 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:47.587765 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.587735 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tv5ff"] Jul 28 10:07:47.587859 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:47.587827 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:47.587946 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:47.587927 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:48.271753 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:48.271717 2581 generic.go:356] "Generic (PLEG): container finished" podID="33984ebc-8151-4863-9248-fa23ffcbfb0b" containerID="2691c473f0d88ccf8488bf6dd51ff9829d0b0cc7ca7d86194a19e86319e72a11" exitCode=0 Jul 28 10:07:48.272113 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:48.271798 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbtpg" event={"ID":"33984ebc-8151-4863-9248-fa23ffcbfb0b","Type":"ContainerDied","Data":"2691c473f0d88ccf8488bf6dd51ff9829d0b0cc7ca7d86194a19e86319e72a11"} Jul 28 10:07:48.272113 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:48.271882 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 10:07:49.092356 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:49.092203 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:49.092526 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:49.092280 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:49.092526 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:49.092506 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:49.092526 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:49.092409 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:49.092526 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:49.092301 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:49.092847 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:49.092588 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:49.274557 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:49.274534 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 10:07:50.030381 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.030351 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:50.117761 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.117732 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:50.190872 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.190844 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:07:50.201906 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.201872 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" podUID="727eae60-6bdf-4598-ab23-75bec23683bf" containerName="ovnkube-controller" probeResult="failure" output="" Jul 28 10:07:50.209506 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.209480 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" podUID="727eae60-6bdf-4598-ab23-75bec23683bf" containerName="ovnkube-controller" probeResult="failure" output="" Jul 28 10:07:50.243617 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.243563 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:50.278171 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.278147 2581 generic.go:356] "Generic (PLEG): container finished" podID="33984ebc-8151-4863-9248-fa23ffcbfb0b" containerID="52e228f5a5af4549b3ef3f2ffecaad0bae79427f4129322d0684e0e843a09a45" exitCode=0 Jul 28 10:07:50.278496 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.278233 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbtpg" event={"ID":"33984ebc-8151-4863-9248-fa23ffcbfb0b","Type":"ContainerDied","Data":"52e228f5a5af4549b3ef3f2ffecaad0bae79427f4129322d0684e0e843a09a45"} Jul 28 10:07:50.286913 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.286891 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" podUID="727eae60-6bdf-4598-ab23-75bec23683bf" containerName="ovnkube-controller" probeResult="failure" output="" Jul 28 10:07:50.304496 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.304476 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:50.409371 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.409347 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:50.467318 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.467295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:50.855864 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.855829 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:50.955139 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:50.955105 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:51.091274 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:51.091237 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:51.091442 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:51.091356 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:51.091442 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:51.091419 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:51.091442 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:51.091409 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:51.091598 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:51.091500 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:51.091598 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:51.091587 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:51.280613 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:51.280517 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:51.375649 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:51.375623 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7gbnk_488696f4-3639-4b94-abca-a88c17c72588/dns-node-resolver/0.log" Jul 28 10:07:51.422459 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:51.422435 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:51.745521 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:51.745488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:51.745696 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:51.745559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:51.745696 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:51.745647 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:51.745796 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:51.745717 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret podName:a49fdd3c-8942-4b34-a2f5-beb39b296bb9 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:23.745694719 +0000 UTC m=+65.224676512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret") pod "global-pull-secret-syncer-tv5ff" (UID: "a49fdd3c-8942-4b34-a2f5-beb39b296bb9") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:07:51.745796 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:51.745653 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:51.745796 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:51.745790 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs podName:432b3c8f-7b69-4d45-97c3-d317cca6324d nodeName:}" failed. No retries permitted until 2026-07-28 10:08:23.745776084 +0000 UTC m=+65.224757864 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs") pod "network-metrics-daemon-hl7rm" (UID: "432b3c8f-7b69-4d45-97c3-d317cca6324d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:07:51.846543 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:51.846515 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwp8\" (UniqueName: \"kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8\") pod \"network-check-target-dp9sg\" (UID: \"377ae0ee-6c31-4912-aa8a-4a65119deb04\") " pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:51.846705 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:51.846678 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:07:51.846705 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:51.846698 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:07:51.846705 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:51.846708 2581 projected.go:196] Error preparing data for projected volume kube-api-access-vjwp8 for pod openshift-network-diagnostics/network-check-target-dp9sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:51.846862 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:51.846749 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8 podName:377ae0ee-6c31-4912-aa8a-4a65119deb04 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:23.846736752 +0000 UTC m=+65.325718529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjwp8" (UniqueName: "kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8") pod "network-check-target-dp9sg" (UID: "377ae0ee-6c31-4912-aa8a-4a65119deb04") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:07:52.375661 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:52.375636 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8p2v9_8d8e7605-36e7-486f-9a1f-b95586176254/node-ca/0.log" Jul 28 10:07:52.426303 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:52.426257 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:52.526396 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:52.526363 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:53.090867 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:53.090837 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:53.091049 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:53.090837 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:53.091049 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:53.090971 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hl7rm" podUID="432b3c8f-7b69-4d45-97c3-d317cca6324d" Jul 28 10:07:53.091205 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:53.091055 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:53.091205 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:53.091088 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp9sg" podUID="377ae0ee-6c31-4912-aa8a-4a65119deb04" Jul 28 10:07:53.091205 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:07:53.091168 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv5ff" podUID="a49fdd3c-8942-4b34-a2f5-beb39b296bb9" Jul 28 10:07:53.339577 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:53.339545 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeReady" Jul 28 10:07:53.339734 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:53.339693 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 10:07:53.471716 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:53.471670 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:54.243815 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:54.243788 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:54.289901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:54.289877 2581 generic.go:356] "Generic (PLEG): container finished" podID="33984ebc-8151-4863-9248-fa23ffcbfb0b" containerID="411a256b24e47a8074631744b2fb6a74c24b842b198ac2aec7f2d6cc8cb9ac1d" exitCode=0 Jul 28 10:07:54.289989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:54.289935 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbtpg" event={"ID":"33984ebc-8151-4863-9248-fa23ffcbfb0b","Type":"ContainerDied","Data":"411a256b24e47a8074631744b2fb6a74c24b842b198ac2aec7f2d6cc8cb9ac1d"} Jul 28 10:07:54.340575 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:54.340554 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:54.397161 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:54.397116 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:54.571664 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:54.571634 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:54.674264 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:54.674188 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:54.876424 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:54.876399 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:55.091161 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.091140 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:07:55.091377 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.091145 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:07:55.091377 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.091145 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:07:55.094194 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.094175 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 10:07:55.094312 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.094297 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c76md\"" Jul 28 10:07:55.095442 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.095427 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 10:07:55.095532 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.095430 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 10:07:55.095606 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.095587 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t2q9c\"" Jul 28 10:07:55.095663 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.095608 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 10:07:55.295255 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.295224 2581 generic.go:356] "Generic (PLEG): container finished" podID="33984ebc-8151-4863-9248-fa23ffcbfb0b" containerID="88eee9c7d13a61b80770e82a34ff010d427826e7c2a6b521111fce6e7294c00a" exitCode=0 Jul 28 10:07:55.295366 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.295267 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbtpg" event={"ID":"33984ebc-8151-4863-9248-fa23ffcbfb0b","Type":"ContainerDied","Data":"88eee9c7d13a61b80770e82a34ff010d427826e7c2a6b521111fce6e7294c00a"} Jul 28 10:07:55.441736 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.441580 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:55.665417 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:55.665354 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:56.067208 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:56.067140 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:56.300140 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:56.300106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbtpg" event={"ID":"33984ebc-8151-4863-9248-fa23ffcbfb0b","Type":"ContainerStarted","Data":"fa632e3c8c3adb5223227f9682c3a54c78a1a6d095116d6ff2ff7ef51144c3c9"} Jul 28 10:07:56.479020 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:56.478989 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:56.611811 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:56.611781 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:56.904084 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:56.904043 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:57.070431 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:57.070406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:57.369427 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:57.369402 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:57.466207 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:57.466171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:57.663252 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:57.663161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:57.862260 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:57.862229 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:57.997749 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:57.997674 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:58.096202 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:58.096176 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:58.465517 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:58.465489 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:58.901965 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:58.901932 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:58.998696 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:58.998657 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:59.073623 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:59.073578 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:59.461940 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:59.461913 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:59.563445 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:59.563410 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:07:59.664148 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:07:59.664118 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:00.063167 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:00.063135 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:00.262300 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:00.262272 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:00.538557 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:00.538529 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:00.883277 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:00.883245 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:01.266184 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:01.266104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:01.365751 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:01.365721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:01.464966 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:01.464937 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:01.652060 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:01.652027 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:01.752280 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:01.752235 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:02.066988 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:02.066906 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:02.471170 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:02.471137 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:02.869853 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:02.869819 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:03.266011 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:03.265935 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:03.690202 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:03.690173 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:04.066819 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:04.066746 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:04.464331 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:04.464303 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:04.678086 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:04.678036 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:04.881015 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:04.880988 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:05.135490 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:05.135394 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:13.085708 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.085659 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tbtpg" podStartSLOduration=24.147987373 podStartE2EDuration="54.085643183s" totalImagesPullingTime="29.93765581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:56.326999082 +0000 UTC m=+37.805980878" watchObservedRunningTime="2026-07-28 10:08:13.085643183 +0000 UTC m=+54.564624977" Jul 28 10:08:13.086155 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.085907 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vg5dj"] Jul 28 10:08:13.087473 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.087457 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vg5dj" Jul 28 10:08:13.091011 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.090980 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qspvm\"" Jul 28 10:08:13.091468 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.091447 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 10:08:13.091576 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.091466 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 10:08:13.091837 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.091818 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 10:08:13.094456 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.094416 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67465d648c-m6fwh"] Jul 28 10:08:13.096367 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.096348 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.098568 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.098549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:13.099149 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.099134 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 10:08:13.099627 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.099613 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 10:08:13.099790 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.099769 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wgkjc\"" Jul 28 10:08:13.100332 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.100320 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 10:08:13.103628 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.103606 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vg5dj"] Jul 28 10:08:13.108706 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.108682 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 10:08:13.120802 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.120778 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67465d648c-m6fwh"] Jul 28 10:08:13.178234 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.178206 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p9hm6"] Jul 28 10:08:13.180012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.179997 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6sl84"] Jul 28 10:08:13.180146 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.180130 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.181838 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.181817 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.183311 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.183294 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 10:08:13.183563 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.183548 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tzznz\"" Jul 28 10:08:13.183666 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.183553 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 10:08:13.184369 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.184356 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 10:08:13.184627 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.184612 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 10:08:13.185673 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.185659 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 10:08:13.186164 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.186141 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:13.187440 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.187419 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 10:08:13.187544 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.187424 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g6jd5\"" Jul 28 10:08:13.192124 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.192065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09085ea3-8b04-4a8d-8576-d58729e3c034-registry-certificates\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.192204 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.192130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09085ea3-8b04-4a8d-8576-d58729e3c034-image-registry-private-configuration\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.192204 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.192157 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09085ea3-8b04-4a8d-8576-d58729e3c034-trusted-ca\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.192204 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.192187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09085ea3-8b04-4a8d-8576-d58729e3c034-bound-sa-token\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.192320 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.192213 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzsvj\" (UniqueName: \"kubernetes.io/projected/7eeecf65-f709-42ed-a7c6-ada08c662150-kube-api-access-kzsvj\") pod \"ingress-canary-vg5dj\" (UID: \"7eeecf65-f709-42ed-a7c6-ada08c662150\") " pod="openshift-ingress-canary/ingress-canary-vg5dj" Jul 28 10:08:13.192320 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.192279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09085ea3-8b04-4a8d-8576-d58729e3c034-installation-pull-secrets\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.192390 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.192314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09085ea3-8b04-4a8d-8576-d58729e3c034-registry-tls\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.192390 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.192354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09085ea3-8b04-4a8d-8576-d58729e3c034-ca-trust-extracted\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.192390 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.192377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7eeecf65-f709-42ed-a7c6-ada08c662150-cert\") pod \"ingress-canary-vg5dj\" (UID: \"7eeecf65-f709-42ed-a7c6-ada08c662150\") " pod="openshift-ingress-canary/ingress-canary-vg5dj" Jul 28 10:08:13.192480 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.192413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9hx9\" (UniqueName: \"kubernetes.io/projected/09085ea3-8b04-4a8d-8576-d58729e3c034-kube-api-access-l9hx9\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.201914 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.201893 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6sl84"] Jul 28 10:08:13.202668 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.202649 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p9hm6"] Jul 28 10:08:13.292994 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.292967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09085ea3-8b04-4a8d-8576-d58729e3c034-ca-trust-extracted\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.292994 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.292996 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7eeecf65-f709-42ed-a7c6-ada08c662150-cert\") pod \"ingress-canary-vg5dj\" (UID: \"7eeecf65-f709-42ed-a7c6-ada08c662150\") " pod="openshift-ingress-canary/ingress-canary-vg5dj" Jul 28 10:08:13.293207 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3f4bdab-e366-421f-a0eb-bb498143954c-config-volume\") pod \"dns-default-6sl84\" (UID: \"a3f4bdab-e366-421f-a0eb-bb498143954c\") " pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.293207 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293043 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slmtr\" (UniqueName: \"kubernetes.io/projected/2cd88b08-3aff-4728-b870-5a9c6dd330bf-kube-api-access-slmtr\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.293207 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293098 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd88b08-3aff-4728-b870-5a9c6dd330bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.293207 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd88b08-3aff-4728-b870-5a9c6dd330bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.293207 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c97sl\" (UniqueName: \"kubernetes.io/projected/a3f4bdab-e366-421f-a0eb-bb498143954c-kube-api-access-c97sl\") pod \"dns-default-6sl84\" (UID: \"a3f4bdab-e366-421f-a0eb-bb498143954c\") " pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.293425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9hx9\" (UniqueName: \"kubernetes.io/projected/09085ea3-8b04-4a8d-8576-d58729e3c034-kube-api-access-l9hx9\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.293425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293258 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3f4bdab-e366-421f-a0eb-bb498143954c-metrics-tls\") pod \"dns-default-6sl84\" (UID: \"a3f4bdab-e366-421f-a0eb-bb498143954c\") " pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.293425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09085ea3-8b04-4a8d-8576-d58729e3c034-registry-certificates\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.293425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cd88b08-3aff-4728-b870-5a9c6dd330bf-crio-socket\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.293425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09085ea3-8b04-4a8d-8576-d58729e3c034-image-registry-private-configuration\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.293425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09085ea3-8b04-4a8d-8576-d58729e3c034-trusted-ca\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.293425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293360 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09085ea3-8b04-4a8d-8576-d58729e3c034-ca-trust-extracted\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.293425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09085ea3-8b04-4a8d-8576-d58729e3c034-bound-sa-token\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.293425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzsvj\" (UniqueName: \"kubernetes.io/projected/7eeecf65-f709-42ed-a7c6-ada08c662150-kube-api-access-kzsvj\") pod \"ingress-canary-vg5dj\" (UID: \"7eeecf65-f709-42ed-a7c6-ada08c662150\") " pod="openshift-ingress-canary/ingress-canary-vg5dj" Jul 28 10:08:13.293425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09085ea3-8b04-4a8d-8576-d58729e3c034-installation-pull-secrets\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.293425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3f4bdab-e366-421f-a0eb-bb498143954c-tmp-dir\") pod \"dns-default-6sl84\" (UID: \"a3f4bdab-e366-421f-a0eb-bb498143954c\") " pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.293883 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09085ea3-8b04-4a8d-8576-d58729e3c034-registry-tls\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.293883 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.293469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd88b08-3aff-4728-b870-5a9c6dd330bf-data-volume\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.294111 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.294094 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09085ea3-8b04-4a8d-8576-d58729e3c034-registry-certificates\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.294447 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.294292 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09085ea3-8b04-4a8d-8576-d58729e3c034-trusted-ca\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.297210 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.297191 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7eeecf65-f709-42ed-a7c6-ada08c662150-cert\") pod \"ingress-canary-vg5dj\" (UID: \"7eeecf65-f709-42ed-a7c6-ada08c662150\") " pod="openshift-ingress-canary/ingress-canary-vg5dj" Jul 28 10:08:13.297287 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.297211 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09085ea3-8b04-4a8d-8576-d58729e3c034-installation-pull-secrets\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.297287 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.297224 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09085ea3-8b04-4a8d-8576-d58729e3c034-image-registry-private-configuration\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.297355 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.297337 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09085ea3-8b04-4a8d-8576-d58729e3c034-registry-tls\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.305039 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.305013 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9hx9\" (UniqueName: \"kubernetes.io/projected/09085ea3-8b04-4a8d-8576-d58729e3c034-kube-api-access-l9hx9\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.305402 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.305386 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzsvj\" (UniqueName: \"kubernetes.io/projected/7eeecf65-f709-42ed-a7c6-ada08c662150-kube-api-access-kzsvj\") pod \"ingress-canary-vg5dj\" (UID: \"7eeecf65-f709-42ed-a7c6-ada08c662150\") " pod="openshift-ingress-canary/ingress-canary-vg5dj" Jul 28 10:08:13.305890 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.305875 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09085ea3-8b04-4a8d-8576-d58729e3c034-bound-sa-token\") pod \"image-registry-67465d648c-m6fwh\" (UID: \"09085ea3-8b04-4a8d-8576-d58729e3c034\") " pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.364592 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.364539 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:13.393839 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.393820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3f4bdab-e366-421f-a0eb-bb498143954c-tmp-dir\") pod \"dns-default-6sl84\" (UID: \"a3f4bdab-e366-421f-a0eb-bb498143954c\") " pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.393926 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.393849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd88b08-3aff-4728-b870-5a9c6dd330bf-data-volume\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.393926 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.393884 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3f4bdab-e366-421f-a0eb-bb498143954c-config-volume\") pod \"dns-default-6sl84\" (UID: \"a3f4bdab-e366-421f-a0eb-bb498143954c\") " pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.393926 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.393899 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmtr\" (UniqueName: \"kubernetes.io/projected/2cd88b08-3aff-4728-b870-5a9c6dd330bf-kube-api-access-slmtr\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.393926 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.393922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd88b08-3aff-4728-b870-5a9c6dd330bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.394431 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.393947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd88b08-3aff-4728-b870-5a9c6dd330bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.394431 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.394063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c97sl\" (UniqueName: \"kubernetes.io/projected/a3f4bdab-e366-421f-a0eb-bb498143954c-kube-api-access-c97sl\") pod \"dns-default-6sl84\" (UID: \"a3f4bdab-e366-421f-a0eb-bb498143954c\") " pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.394431 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.394142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3f4bdab-e366-421f-a0eb-bb498143954c-metrics-tls\") pod \"dns-default-6sl84\" (UID: \"a3f4bdab-e366-421f-a0eb-bb498143954c\") " pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.394431 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.394199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cd88b08-3aff-4728-b870-5a9c6dd330bf-crio-socket\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.394431 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.394221 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3f4bdab-e366-421f-a0eb-bb498143954c-tmp-dir\") pod \"dns-default-6sl84\" (UID: \"a3f4bdab-e366-421f-a0eb-bb498143954c\") " pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.394431 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.394238 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd88b08-3aff-4728-b870-5a9c6dd330bf-data-volume\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.394431 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.394363 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cd88b08-3aff-4728-b870-5a9c6dd330bf-crio-socket\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.394696 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.394468 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd88b08-3aff-4728-b870-5a9c6dd330bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.394696 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.394512 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3f4bdab-e366-421f-a0eb-bb498143954c-config-volume\") pod \"dns-default-6sl84\" (UID: \"a3f4bdab-e366-421f-a0eb-bb498143954c\") " pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.396011 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.395994 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd88b08-3aff-4728-b870-5a9c6dd330bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.396224 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.396207 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3f4bdab-e366-421f-a0eb-bb498143954c-metrics-tls\") pod \"dns-default-6sl84\" (UID: \"a3f4bdab-e366-421f-a0eb-bb498143954c\") " pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.396309 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.396297 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vg5dj" Jul 28 10:08:13.402845 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.402825 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slmtr\" (UniqueName: \"kubernetes.io/projected/2cd88b08-3aff-4728-b870-5a9c6dd330bf-kube-api-access-slmtr\") pod \"insights-runtime-extractor-p9hm6\" (UID: \"2cd88b08-3aff-4728-b870-5a9c6dd330bf\") " pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.402997 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.402982 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c97sl\" (UniqueName: \"kubernetes.io/projected/a3f4bdab-e366-421f-a0eb-bb498143954c-kube-api-access-c97sl\") pod \"dns-default-6sl84\" (UID: \"a3f4bdab-e366-421f-a0eb-bb498143954c\") " pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.404924 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.404909 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:13.440031 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.439626 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:13.490699 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.490650 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p9hm6" Jul 28 10:08:13.493845 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.493818 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:13.516343 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.516291 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:13.569716 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.569508 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vg5dj"] Jul 28 10:08:13.571210 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:13.571180 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eeecf65_f709_42ed_a7c6_ada08c662150.slice/crio-dda12de6c7e9a08fe4341672ef774b0b2c00df39e84213263ed10acb5634deaa WatchSource:0}: Error finding container dda12de6c7e9a08fe4341672ef774b0b2c00df39e84213263ed10acb5634deaa: Status 404 returned error can't find the container with id dda12de6c7e9a08fe4341672ef774b0b2c00df39e84213263ed10acb5634deaa Jul 28 10:08:13.585109 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.585080 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67465d648c-m6fwh"] Jul 28 10:08:13.588889 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:13.588806 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09085ea3_8b04_4a8d_8576_d58729e3c034.slice/crio-1f7ae580ce957b47f6039aeaabd35df59e354408bda601d32a1bf529b50815e5 WatchSource:0}: Error finding container 1f7ae580ce957b47f6039aeaabd35df59e354408bda601d32a1bf529b50815e5: Status 404 returned error can't find the container with id 1f7ae580ce957b47f6039aeaabd35df59e354408bda601d32a1bf529b50815e5 Jul 28 10:08:13.592327 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.592298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:13.638944 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.638923 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p9hm6"] Jul 28 10:08:13.640979 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:13.640957 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd88b08_3aff_4728_b870_5a9c6dd330bf.slice/crio-81c196e03c4dd4630c08e75c304dcbb8c1e9fac9f2f93cf7a14cf87243a4d9b5 WatchSource:0}: Error finding container 81c196e03c4dd4630c08e75c304dcbb8c1e9fac9f2f93cf7a14cf87243a4d9b5: Status 404 returned error can't find the container with id 81c196e03c4dd4630c08e75c304dcbb8c1e9fac9f2f93cf7a14cf87243a4d9b5 Jul 28 10:08:13.660968 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.660943 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6sl84"] Jul 28 10:08:13.664237 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:13.664210 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f4bdab_e366_421f_a0eb_bb498143954c.slice/crio-e6545248d08fdced79f4031d6ddb6654d5a937489bdf7b6e323c3aa4bc1140b0 WatchSource:0}: Error finding container e6545248d08fdced79f4031d6ddb6654d5a937489bdf7b6e323c3aa4bc1140b0: Status 404 returned error can't find the container with id e6545248d08fdced79f4031d6ddb6654d5a937489bdf7b6e323c3aa4bc1140b0 Jul 28 10:08:13.671407 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:13.671384 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:14.079648 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.079615 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:14.136799 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.136687 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:14.350734 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.350652 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6sl84" event={"ID":"a3f4bdab-e366-421f-a0eb-bb498143954c","Type":"ContainerStarted","Data":"e6545248d08fdced79f4031d6ddb6654d5a937489bdf7b6e323c3aa4bc1140b0"} Jul 28 10:08:14.352529 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.352499 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p9hm6" event={"ID":"2cd88b08-3aff-4728-b870-5a9c6dd330bf","Type":"ContainerStarted","Data":"81c196e03c4dd4630c08e75c304dcbb8c1e9fac9f2f93cf7a14cf87243a4d9b5"} Jul 28 10:08:14.355699 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.355165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67465d648c-m6fwh" event={"ID":"09085ea3-8b04-4a8d-8576-d58729e3c034","Type":"ContainerStarted","Data":"a74f4e7ff44ddf1a6ba7fcccb3340bc3d79490af1489d7327091e31d56a46027"} Jul 28 10:08:14.355699 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.355212 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67465d648c-m6fwh" event={"ID":"09085ea3-8b04-4a8d-8576-d58729e3c034","Type":"ContainerStarted","Data":"1f7ae580ce957b47f6039aeaabd35df59e354408bda601d32a1bf529b50815e5"} Jul 28 10:08:14.355699 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.355438 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:14.357100 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.357053 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vg5dj" event={"ID":"7eeecf65-f709-42ed-a7c6-ada08c662150","Type":"ContainerStarted","Data":"dda12de6c7e9a08fe4341672ef774b0b2c00df39e84213263ed10acb5634deaa"} Jul 28 10:08:14.398350 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.398010 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67465d648c-m6fwh" podStartSLOduration=1.39798902 podStartE2EDuration="1.39798902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:14.396905399 +0000 UTC m=+55.875887196" watchObservedRunningTime="2026-07-28 10:08:14.39798902 +0000 UTC m=+55.876970799" Jul 28 10:08:14.519501 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.519469 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:14.594852 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.594819 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:14.731428 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.731320 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:14.800603 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:14.800569 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:16.367654 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:16.367615 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6sl84" event={"ID":"a3f4bdab-e366-421f-a0eb-bb498143954c","Type":"ContainerStarted","Data":"d3f248c32e6500eb2b8a45491066d9b241390e9e5fc5b06e3a6d829f47424c79"} Jul 28 10:08:16.368140 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:16.367680 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6sl84" event={"ID":"a3f4bdab-e366-421f-a0eb-bb498143954c","Type":"ContainerStarted","Data":"644f39b8ff5ba0083955592ca1640f840ec1e1db60c8b50af97e6128d3700c0a"} Jul 28 10:08:16.368140 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:16.367786 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:16.389169 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:16.389116 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6sl84" podStartSLOduration=1.16844627 podStartE2EDuration="3.389098962s" totalImagesPullingTime="2.220652692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:16.387326081 +0000 UTC m=+57.866307879" watchObservedRunningTime="2026-07-28 10:08:16.389098962 +0000 UTC m=+57.868080754" Jul 28 10:08:16.639623 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:16.639546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:16.698355 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:16.698318 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:20.288518 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:20.288490 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jn2ms" Jul 28 10:08:20.379064 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:20.379025 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p9hm6" event={"ID":"2cd88b08-3aff-4728-b870-5a9c6dd330bf","Type":"ContainerStarted","Data":"c866f191e8513a9e56c4558beb767cfd3959de77ef0f2037755e62707a9ca9ac"} Jul 28 10:08:20.380404 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:20.380380 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vg5dj" event={"ID":"7eeecf65-f709-42ed-a7c6-ada08c662150","Type":"ContainerStarted","Data":"4ae6c4c5a4ffb7630d4c62ace3c8a3031d86714a19e326ae64f9dfb148aff501"} Jul 28 10:08:20.403814 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:20.403776 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vg5dj" podStartSLOduration=0.895973824 podStartE2EDuration="7.403761989s" totalImagesPullingTime="6.507788165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:20.403015642 +0000 UTC m=+61.881997436" watchObservedRunningTime="2026-07-28 10:08:20.403761989 +0000 UTC m=+61.882743783" Jul 28 10:08:20.422857 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:20.422837 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:20.488785 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:20.488708 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:20.550895 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:20.550838 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:22.985517 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:22.985477 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:23.117052 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.117018 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:23.199768 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.199722 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:23.301598 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.301516 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:23.369869 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.369847 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:23.756672 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.756636 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:23.784317 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.784290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:08:23.784449 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.784335 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:08:23.787407 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.787384 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 10:08:23.788681 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.788663 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 10:08:23.797522 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.797498 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a49fdd3c-8942-4b34-a2f5-beb39b296bb9-original-pull-secret\") pod \"global-pull-secret-syncer-tv5ff\" (UID: \"a49fdd3c-8942-4b34-a2f5-beb39b296bb9\") " pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:08:23.797881 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.797864 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432b3c8f-7b69-4d45-97c3-d317cca6324d-metrics-certs\") pod \"network-metrics-daemon-hl7rm\" (UID: \"432b3c8f-7b69-4d45-97c3-d317cca6324d\") " pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:08:23.818729 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.818701 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:23.885497 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.885466 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwp8\" (UniqueName: \"kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8\") pod \"network-check-target-dp9sg\" (UID: \"377ae0ee-6c31-4912-aa8a-4a65119deb04\") " pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:08:23.888749 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.888722 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 10:08:23.899339 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.899316 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 10:08:23.903997 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.903976 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c76md\"" Jul 28 10:08:23.906738 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.906719 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv5ff" Jul 28 10:08:23.909518 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.909499 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjwp8\" (UniqueName: \"kubernetes.io/projected/377ae0ee-6c31-4912-aa8a-4a65119deb04-kube-api-access-vjwp8\") pod \"network-check-target-dp9sg\" (UID: \"377ae0ee-6c31-4912-aa8a-4a65119deb04\") " pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:08:23.912135 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.912114 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hl7rm" Jul 28 10:08:23.914922 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.914730 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t2q9c\"" Jul 28 10:08:23.921131 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:23.921113 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:08:24.090512 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:24.090481 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hl7rm"] Jul 28 10:08:24.093510 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:24.093482 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432b3c8f_7b69_4d45_97c3_d317cca6324d.slice/crio-078685f40f32c8d63f365a31b6067d4b2b745b53805501152e24eb007772583a WatchSource:0}: Error finding container 078685f40f32c8d63f365a31b6067d4b2b745b53805501152e24eb007772583a: Status 404 returned error can't find the container with id 078685f40f32c8d63f365a31b6067d4b2b745b53805501152e24eb007772583a Jul 28 10:08:24.192064 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:24.192027 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:24.296594 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:24.296474 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tv5ff"] Jul 28 10:08:24.298679 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:24.298654 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49fdd3c_8942_4b34_a2f5_beb39b296bb9.slice/crio-f54d20c02e357df7ff6e4042cfc32b7861b1b514644af78b24f965d56f3ca953 WatchSource:0}: Error finding container f54d20c02e357df7ff6e4042cfc32b7861b1b514644af78b24f965d56f3ca953: Status 404 returned error can't find the container with id f54d20c02e357df7ff6e4042cfc32b7861b1b514644af78b24f965d56f3ca953 Jul 28 10:08:24.303435 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:24.303389 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:24.303555 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:24.303530 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dp9sg"] Jul 28 10:08:24.306688 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:24.306668 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377ae0ee_6c31_4912_aa8a_4a65119deb04.slice/crio-bd4659bbe313e8fa93972637e30502758a01f9f4b5ce789ca0eb819b6e4837dc WatchSource:0}: Error finding container bd4659bbe313e8fa93972637e30502758a01f9f4b5ce789ca0eb819b6e4837dc: Status 404 returned error can't find the container with id bd4659bbe313e8fa93972637e30502758a01f9f4b5ce789ca0eb819b6e4837dc Jul 28 10:08:24.394413 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:24.394376 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hl7rm" event={"ID":"432b3c8f-7b69-4d45-97c3-d317cca6324d","Type":"ContainerStarted","Data":"078685f40f32c8d63f365a31b6067d4b2b745b53805501152e24eb007772583a"} Jul 28 10:08:24.396309 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:24.396280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p9hm6" event={"ID":"2cd88b08-3aff-4728-b870-5a9c6dd330bf","Type":"ContainerStarted","Data":"76f1574dc13a98441253d6bbacb88282e67799dcf0a74b056f321aeda2fa2de0"} Jul 28 10:08:24.397616 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:24.397593 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dp9sg" event={"ID":"377ae0ee-6c31-4912-aa8a-4a65119deb04","Type":"ContainerStarted","Data":"bd4659bbe313e8fa93972637e30502758a01f9f4b5ce789ca0eb819b6e4837dc"} Jul 28 10:08:24.398672 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:24.398649 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tv5ff" event={"ID":"a49fdd3c-8942-4b34-a2f5-beb39b296bb9","Type":"ContainerStarted","Data":"f54d20c02e357df7ff6e4042cfc32b7861b1b514644af78b24f965d56f3ca953"} Jul 28 10:08:25.310142 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:25.310105 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:25.419674 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:25.419608 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:26.045299 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:26.045265 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:26.150283 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:26.150254 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:26.374488 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:26.373598 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6sl84" Jul 28 10:08:30.425799 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.425767 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tv5ff" event={"ID":"a49fdd3c-8942-4b34-a2f5-beb39b296bb9","Type":"ContainerStarted","Data":"76f7cebdf66eeff24fadb8c5c8164483a86ecad257baf3e599d690a1b70d6b0f"} Jul 28 10:08:30.427640 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.427616 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hl7rm" event={"ID":"432b3c8f-7b69-4d45-97c3-d317cca6324d","Type":"ContainerStarted","Data":"2e41e23ef37e899cf0b010e1fe0d21cdcb1dff410ce44b389dd4db1839c35dba"} Jul 28 10:08:30.427774 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.427657 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hl7rm" event={"ID":"432b3c8f-7b69-4d45-97c3-d317cca6324d","Type":"ContainerStarted","Data":"b2817b3e48851f3e7fc3ee9f44b835b8f73093ad06900519a40998819ea86023"} Jul 28 10:08:30.429554 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.429526 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p9hm6" event={"ID":"2cd88b08-3aff-4728-b870-5a9c6dd330bf","Type":"ContainerStarted","Data":"c7ad39f3776ce83d48c568d8e53eb89842678cb3bc738afea6eff6fb19af624e"} Jul 28 10:08:30.430919 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.430896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dp9sg" event={"ID":"377ae0ee-6c31-4912-aa8a-4a65119deb04","Type":"ContainerStarted","Data":"7c5d90fab9813f119099a61ed389a41c45fbbf653c103213dff5fb8b2dedb128"} Jul 28 10:08:30.431037 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.431020 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:08:30.442869 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.442825 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tv5ff" podStartSLOduration=65.756503191 podStartE2EDuration="1m11.442808901s" totalImagesPullingTime="5.68630571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:30.441531957 +0000 UTC m=+71.920513768" watchObservedRunningTime="2026-07-28 10:08:30.442808901 +0000 UTC m=+71.921790699" Jul 28 10:08:30.458013 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.457978 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dp9sg" podStartSLOduration=65.778996483 podStartE2EDuration="1m11.457966056s" totalImagesPullingTime="5.678969573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:30.457628132 +0000 UTC m=+71.936609927" watchObservedRunningTime="2026-07-28 10:08:30.457966056 +0000 UTC m=+71.936947850" Jul 28 10:08:30.475335 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.475288 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p9hm6" podStartSLOduration=1.247754373 podStartE2EDuration="17.47527599s" totalImagesPullingTime="16.227521617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:30.474264585 +0000 UTC m=+71.953246380" watchObservedRunningTime="2026-07-28 10:08:30.47527599 +0000 UTC m=+71.954257766" Jul 28 10:08:30.495507 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.495471 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hl7rm" podStartSLOduration=65.617037116 podStartE2EDuration="1m11.495463782s" totalImagesPullingTime="5.878426666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:30.495229629 +0000 UTC m=+71.974211423" watchObservedRunningTime="2026-07-28 10:08:30.495463782 +0000 UTC m=+71.974445577" Jul 28 10:08:30.573981 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.573954 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:30.655277 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.655248 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:30.714414 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:30.714340 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:31.009290 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:31.009209 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:31.066963 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:31.066934 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:31.641359 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:31.641331 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:31.741354 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:31.741323 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:33.410735 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:33.410701 2581 patch_prober.go:28] interesting pod/image-registry-67465d648c-m6fwh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 28 10:08:33.411193 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:33.410756 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67465d648c-m6fwh" podUID="09085ea3-8b04-4a8d-8576-d58729e3c034" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 10:08:34.270336 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:34.270306 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:35.366484 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:35.366461 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67465d648c-m6fwh" Jul 28 10:08:35.378010 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:35.377984 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:35.462407 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:35.462378 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:35.528822 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:35.528792 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:35.590249 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:35.590221 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:35.811929 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:35.811851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:35.899908 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:35.899864 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:36.088266 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:36.088236 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:36.460256 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:36.460179 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:36.557315 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:36.557284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:36.740170 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:36.740086 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:36.858236 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:36.858206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:36.959118 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:36.959089 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:37.019326 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.019261 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489"] Jul 28 10:08:37.022375 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.022361 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.025348 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.025330 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 10:08:37.026936 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.026917 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-grhwb\"" Jul 28 10:08:37.027049 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.026959 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 10:08:37.027049 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.026977 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 10:08:37.027049 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.027035 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 10:08:37.027247 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.027098 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 10:08:37.037734 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.037712 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489"] Jul 28 10:08:37.061668 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.061643 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gbjnn"] Jul 28 10:08:37.064730 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.064712 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq"] Jul 28 10:08:37.064861 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.064840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.067409 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.067385 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 10:08:37.067566 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.067483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc7jc\" (UniqueName: \"kubernetes.io/projected/cf6529b1-8178-49a4-8417-6c069e3b0ae8-kube-api-access-dc7jc\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.067566 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.067530 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6529b1-8178-49a4-8417-6c069e3b0ae8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.067713 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.067596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf6529b1-8178-49a4-8417-6c069e3b0ae8-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.067713 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.067606 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r255l\"" Jul 28 10:08:37.067713 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.067638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf6529b1-8178-49a4-8417-6c069e3b0ae8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.067713 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.067635 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 10:08:37.067859 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.067725 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 10:08:37.067859 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.067783 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.071201 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.071061 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 10:08:37.072297 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.072281 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 10:08:37.072412 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.072300 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 10:08:37.072412 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.072301 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tpc6t\"" Jul 28 10:08:37.083442 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.083425 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq"] Jul 28 10:08:37.120925 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.120898 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:37.168178 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.168273 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-root\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.168273 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-sys\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.168337 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-wtmp\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.168374 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b7fd4d10-960c-470d-8ae0-52a07718b393-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.168407 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168373 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-textfile\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.168407 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf6529b1-8178-49a4-8417-6c069e3b0ae8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.168466 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.168466 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168457 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.168528 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.168528 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168504 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-metrics-client-ca\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.168528 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzlr5\" (UniqueName: \"kubernetes.io/projected/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-api-access-vzlr5\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.168646 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168555 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6529b1-8178-49a4-8417-6c069e3b0ae8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.168646 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7fd4d10-960c-470d-8ae0-52a07718b393-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.168646 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf6529b1-8178-49a4-8417-6c069e3b0ae8-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.168646 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168621 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-tls\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.168646 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc7jc\" (UniqueName: \"kubernetes.io/projected/cf6529b1-8178-49a4-8417-6c069e3b0ae8-kube-api-access-dc7jc\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.168860 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:08:37.168650 2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 28 10:08:37.168860 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvpcv\" (UniqueName: \"kubernetes.io/projected/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-kube-api-access-tvpcv\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.168860 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.168679 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.168860 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:08:37.168692 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6529b1-8178-49a4-8417-6c069e3b0ae8-openshift-state-metrics-tls podName:cf6529b1-8178-49a4-8417-6c069e3b0ae8 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:37.668677385 +0000 UTC m=+79.147659158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/cf6529b1-8178-49a4-8417-6c069e3b0ae8-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-nq489" (UID: "cf6529b1-8178-49a4-8417-6c069e3b0ae8") : secret "openshift-state-metrics-tls" not found Jul 28 10:08:37.169237 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.169221 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf6529b1-8178-49a4-8417-6c069e3b0ae8-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.170671 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.170652 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf6529b1-8178-49a4-8417-6c069e3b0ae8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.182237 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.182218 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc7jc\" (UniqueName: \"kubernetes.io/projected/cf6529b1-8178-49a4-8417-6c069e3b0ae8-kube-api-access-dc7jc\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.224892 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.224873 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:37.268975 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.268954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.269080 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.268983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.269080 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269000 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.269080 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-metrics-client-ca\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzlr5\" (UniqueName: \"kubernetes.io/projected/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-api-access-vzlr5\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7fd4d10-960c-470d-8ae0-52a07718b393-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-tls\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvpcv\" (UniqueName: \"kubernetes.io/projected/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-kube-api-access-tvpcv\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-root\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-sys\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269610 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-wtmp\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269629 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-metrics-client-ca\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b7fd4d10-960c-470d-8ae0-52a07718b393-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269674 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-textfile\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:08:37.269692 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:08:37.269763 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-state-metrics-tls podName:b7fd4d10-960c-470d-8ae0-52a07718b393 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:37.769744216 +0000 UTC m=+79.248725992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-m8tpq" (UID: "b7fd4d10-960c-470d-8ae0-52a07718b393") : secret "kube-state-metrics-tls" not found Jul 28 10:08:37.270271 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269913 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-sys\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270912 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269961 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-textfile\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270912 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269962 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b7fd4d10-960c-470d-8ae0-52a07718b393-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.270912 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.269974 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-root\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270912 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.270090 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-wtmp\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.270912 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.270490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.270912 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.270530 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7fd4d10-960c-470d-8ae0-52a07718b393-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.271775 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.271749 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.272041 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.272022 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-node-exporter-tls\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.272154 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.272137 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.280208 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.280184 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvpcv\" (UniqueName: \"kubernetes.io/projected/7e67cea0-f5af-4417-bb50-b556d9bdf9e7-kube-api-access-tvpcv\") pod \"node-exporter-gbjnn\" (UID: \"7e67cea0-f5af-4417-bb50-b556d9bdf9e7\") " pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.280410 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.280388 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzlr5\" (UniqueName: \"kubernetes.io/projected/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-api-access-vzlr5\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.330098 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.330057 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:37.374638 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.374614 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gbjnn" Jul 28 10:08:37.385300 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:37.385278 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e67cea0_f5af_4417_bb50_b556d9bdf9e7.slice/crio-2c4c2fc232d838bf3561369262e358c0485d70044f72a8681e5f1b7356fe6e03 WatchSource:0}: Error finding container 2c4c2fc232d838bf3561369262e358c0485d70044f72a8681e5f1b7356fe6e03: Status 404 returned error can't find the container with id 2c4c2fc232d838bf3561369262e358c0485d70044f72a8681e5f1b7356fe6e03 Jul 28 10:08:37.422878 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.422860 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:37.451986 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.451952 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gbjnn" event={"ID":"7e67cea0-f5af-4417-bb50-b556d9bdf9e7","Type":"ContainerStarted","Data":"2c4c2fc232d838bf3561369262e358c0485d70044f72a8681e5f1b7356fe6e03"} Jul 28 10:08:37.522853 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.522778 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:37.623815 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.623791 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:37.673715 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.673690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6529b1-8178-49a4-8417-6c069e3b0ae8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.675908 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.675892 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6529b1-8178-49a4-8417-6c069e3b0ae8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nq489\" (UID: \"cf6529b1-8178-49a4-8417-6c069e3b0ae8\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.724759 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.724741 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:37.775005 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.774953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.777111 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.777095 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7fd4d10-960c-470d-8ae0-52a07718b393-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-m8tpq\" (UID: \"b7fd4d10-960c-470d-8ae0-52a07718b393\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:37.824994 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.824960 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:37.931865 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.931841 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" Jul 28 10:08:37.958541 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.958507 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:37.979621 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:37.979598 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" Jul 28 10:08:38.050704 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.050671 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:38.056572 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.056547 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 10:08:38.061565 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.061542 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.064412 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.064391 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 10:08:38.064591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.064547 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 10:08:38.064591 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.064578 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 10:08:38.064912 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.064809 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 10:08:38.065849 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.065663 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 10:08:38.065849 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.065719 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 10:08:38.066004 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.065915 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 10:08:38.066304 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.066189 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 10:08:38.066304 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.066201 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 10:08:38.066304 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.066222 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-76hkz\"" Jul 28 10:08:38.078593 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.078158 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 10:08:38.078871 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.078793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.079502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.078850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c644d70-d771-4739-b518-429e2baf6748-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.079502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.079033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.079502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.079119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.079502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.079147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.079502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.079175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-web-config\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.079502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.079214 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c644d70-d771-4739-b518-429e2baf6748-config-out\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.079502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.079245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.079502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.079273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.079502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.079297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6trj\" (UniqueName: \"kubernetes.io/projected/9c644d70-d771-4739-b518-429e2baf6748-kube-api-access-v6trj\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.079502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.079322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.079502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.079365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.079502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.079388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.080142 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.079752 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489"] Jul 28 10:08:38.084252 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:38.084223 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6529b1_8178_49a4_8417_6c069e3b0ae8.slice/crio-75902c46651d602b0ac4201a6301cb22830749f9db7bbe44fc05b79560514a9d WatchSource:0}: Error finding container 75902c46651d602b0ac4201a6301cb22830749f9db7bbe44fc05b79560514a9d: Status 404 returned error can't find the container with id 75902c46651d602b0ac4201a6301cb22830749f9db7bbe44fc05b79560514a9d Jul 28 10:08:38.146943 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.146920 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq"] Jul 28 10:08:38.149664 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:38.149641 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fd4d10_960c_470d_8ae0_52a07718b393.slice/crio-1c52cdddcebfa4cb7fbd3b0fe0c6ba2a7643561b299c6620c33083c53acf591c WatchSource:0}: Error finding container 1c52cdddcebfa4cb7fbd3b0fe0c6ba2a7643561b299c6620c33083c53acf591c: Status 404 returned error can't find the container with id 1c52cdddcebfa4cb7fbd3b0fe0c6ba2a7643561b299c6620c33083c53acf591c Jul 28 10:08:38.162254 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.162227 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:38.180126 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180100 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c644d70-d771-4739-b518-429e2baf6748-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180176 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180209 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180264 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-web-config\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180303 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c644d70-d771-4739-b518-429e2baf6748-config-out\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6trj\" (UniqueName: \"kubernetes.io/projected/9c644d70-d771-4739-b518-429e2baf6748-kube-api-access-v6trj\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180490 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180723 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.180989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.180803 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.183283 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:08:38.183039 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-trusted-ca-bundle podName:9c644d70-d771-4739-b518-429e2baf6748 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:38.683020074 +0000 UTC m=+80.162001863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "9c644d70-d771-4739-b518-429e2baf6748") : configmap references non-existent config key: ca-bundle.crt Jul 28 10:08:38.184429 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.184404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-web-config\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.184957 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.184930 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.184957 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.184951 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.185514 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.185474 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.185514 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.185504 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.185805 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.185740 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.185805 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.185745 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c644d70-d771-4739-b518-429e2baf6748-config-out\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.185926 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.185856 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c644d70-d771-4739-b518-429e2baf6748-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.187731 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.187707 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.193454 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.193424 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6trj\" (UniqueName: \"kubernetes.io/projected/9c644d70-d771-4739-b518-429e2baf6748-kube-api-access-v6trj\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.377447 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.377416 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:38.456265 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.456230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" event={"ID":"b7fd4d10-960c-470d-8ae0-52a07718b393","Type":"ContainerStarted","Data":"1c52cdddcebfa4cb7fbd3b0fe0c6ba2a7643561b299c6620c33083c53acf591c"} Jul 28 10:08:38.457791 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.457772 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" event={"ID":"cf6529b1-8178-49a4-8417-6c069e3b0ae8","Type":"ContainerStarted","Data":"2c5684c27a76ba5fa8ac94e629a2236299ba00ddc5889868328bc9fa3e8badf5"} Jul 28 10:08:38.457880 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.457817 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" event={"ID":"cf6529b1-8178-49a4-8417-6c069e3b0ae8","Type":"ContainerStarted","Data":"48b2d17ce7a5f1efd96fdef12c284ff8ccab67b677221f7272cb5095dd361772"} Jul 28 10:08:38.457880 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.457835 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" event={"ID":"cf6529b1-8178-49a4-8417-6c069e3b0ae8","Type":"ContainerStarted","Data":"75902c46651d602b0ac4201a6301cb22830749f9db7bbe44fc05b79560514a9d"} Jul 28 10:08:38.593146 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.593118 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:38.685548 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.685487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.686225 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.686207 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:38.946146 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.945994 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:38.972809 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:38.972782 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:08:39.045911 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:39.045488 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:39.155571 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:39.155533 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 10:08:39.456358 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:39.456325 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c644d70_d771_4739_b518_429e2baf6748.slice/crio-b0253e0052ac47b350d1c613254449ab0d363b2f83821cc9591ba5b35aedcf28 WatchSource:0}: Error finding container b0253e0052ac47b350d1c613254449ab0d363b2f83821cc9591ba5b35aedcf28: Status 404 returned error can't find the container with id b0253e0052ac47b350d1c613254449ab0d363b2f83821cc9591ba5b35aedcf28 Jul 28 10:08:39.462798 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:39.462768 2581 generic.go:356] "Generic (PLEG): container finished" podID="7e67cea0-f5af-4417-bb50-b556d9bdf9e7" containerID="bb7aab14f48f84c8aafceb2a3bf417309a018022ed0935139f6c5f7a87a5c8af" exitCode=0 Jul 28 10:08:39.462927 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:39.462843 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gbjnn" event={"ID":"7e67cea0-f5af-4417-bb50-b556d9bdf9e7","Type":"ContainerDied","Data":"bb7aab14f48f84c8aafceb2a3bf417309a018022ed0935139f6c5f7a87a5c8af"} Jul 28 10:08:39.464274 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:39.464245 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerStarted","Data":"b0253e0052ac47b350d1c613254449ab0d363b2f83821cc9591ba5b35aedcf28"} Jul 28 10:08:39.985198 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:39.985117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:40.039424 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:40.039336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:40.301447 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:40.301355 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:40.471334 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:40.471298 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" event={"ID":"b7fd4d10-960c-470d-8ae0-52a07718b393","Type":"ContainerStarted","Data":"add2ad08ee65e65a1d0f5b7b9ba15a7eb82009f2339beed10d05e9299141a272"} Jul 28 10:08:40.471504 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:40.471403 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" event={"ID":"b7fd4d10-960c-470d-8ae0-52a07718b393","Type":"ContainerStarted","Data":"683e2d0b3ff1da5ea686daf3f170b46b89f305469019372795a7812e681e798c"} Jul 28 10:08:40.471504 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:40.471434 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" event={"ID":"b7fd4d10-960c-470d-8ae0-52a07718b393","Type":"ContainerStarted","Data":"5aa0667cb13ed32f0c8f18baa607aa1991fb61bcbe4d5cfd73aca0053963b992"} Jul 28 10:08:40.473760 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:40.473700 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" event={"ID":"cf6529b1-8178-49a4-8417-6c069e3b0ae8","Type":"ContainerStarted","Data":"f7266a010dd0e134b6d2135a2a937337c4066a3bd244b3ed64c759f191b32d74"} Jul 28 10:08:40.476235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:40.476213 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gbjnn" event={"ID":"7e67cea0-f5af-4417-bb50-b556d9bdf9e7","Type":"ContainerStarted","Data":"03347957e3a23825bf1795daa95151d400be4bd3d399bd9ae8b38264efda8930"} Jul 28 10:08:40.476363 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:40.476255 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gbjnn" event={"ID":"7e67cea0-f5af-4417-bb50-b556d9bdf9e7","Type":"ContainerStarted","Data":"b5e5932a6829ac4b357b12b6c11b01e49e14054846e260e8d5a203fe15077242"} Jul 28 10:08:40.490530 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:40.490482 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m8tpq" podStartSLOduration=1.9329170869999999 podStartE2EDuration="3.490465432s" totalImagesPullingTime="1.557548345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:40.489302362 +0000 UTC m=+81.968284158" watchObservedRunningTime="2026-07-28 10:08:40.490465432 +0000 UTC m=+81.969447229" Jul 28 10:08:40.494396 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:40.494368 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:40.507256 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:40.507213 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nq489" podStartSLOduration=3.044906936 podStartE2EDuration="4.507176314s" totalImagesPullingTime="1.462269378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:40.506374318 +0000 UTC m=+81.985356114" watchObservedRunningTime="2026-07-28 10:08:40.507176314 +0000 UTC m=+81.986158109" Jul 28 10:08:40.528712 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:40.528671 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gbjnn" podStartSLOduration=2.420074939 podStartE2EDuration="3.528658306s" totalImagesPullingTime="1.04696352s" totalInitContainerRuntime="61.619847ms" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:40.527778065 +0000 UTC m=+82.006759862" watchObservedRunningTime="2026-07-28 10:08:40.528658306 +0000 UTC m=+82.007640100" Jul 28 10:08:41.482431 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.482313 2581 generic.go:356] "Generic (PLEG): container finished" podID="9c644d70-d771-4739-b518-429e2baf6748" containerID="0d618de0f33908c60245968b11d7a97a0cb35643200909ede97ef634f5ef2de2" exitCode=0 Jul 28 10:08:41.482846 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.482432 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerDied","Data":"0d618de0f33908c60245968b11d7a97a0cb35643200909ede97ef634f5ef2de2"} Jul 28 10:08:41.493733 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.493709 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-845586f9ff-h5625"] Jul 28 10:08:41.496733 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.496715 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.499601 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.499581 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 10:08:41.499689 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.499635 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 10:08:41.499689 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.499585 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 10:08:41.499806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.499691 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 10:08:41.499806 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.499797 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 10:08:41.499911 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.499859 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5psnb\"" Jul 28 10:08:41.499957 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.499915 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 10:08:41.499957 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.499797 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 10:08:41.513049 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.513028 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845586f9ff-h5625"] Jul 28 10:08:41.608986 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.608963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-serving-cert\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.609136 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.608995 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-oauth-serving-cert\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.609136 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.609014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-service-ca\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.609136 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.609029 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-config\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.609241 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.609161 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8nms\" (UniqueName: \"kubernetes.io/projected/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-kube-api-access-p8nms\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.609241 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.609216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-oauth-config\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.710432 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.710401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8nms\" (UniqueName: \"kubernetes.io/projected/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-kube-api-access-p8nms\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.710585 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.710457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-oauth-config\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.710585 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.710484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-serving-cert\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.710585 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.710506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-oauth-serving-cert\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.710585 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.710522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-service-ca\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.710585 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.710545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-config\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.711315 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.711267 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-service-ca\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.711467 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.711444 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-config\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.711534 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.711474 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-oauth-serving-cert\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.712943 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.712925 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-serving-cert\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.713018 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.712983 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-oauth-config\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.725432 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.725410 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8nms\" (UniqueName: \"kubernetes.io/projected/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-kube-api-access-p8nms\") pod \"console-845586f9ff-h5625\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.727942 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.727919 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:41.805237 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.805176 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:41.841408 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.834475 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:41.962856 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:41.962806 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845586f9ff-h5625"] Jul 28 10:08:41.969729 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:41.969705 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fedac38_5bca_42b2_a2ef_191b0e00cfb0.slice/crio-29572ee40a0efd0d13e2482210a73c06b5693547d80325fbe338063492f13e7b WatchSource:0}: Error finding container 29572ee40a0efd0d13e2482210a73c06b5693547d80325fbe338063492f13e7b: Status 404 returned error can't find the container with id 29572ee40a0efd0d13e2482210a73c06b5693547d80325fbe338063492f13e7b Jul 28 10:08:42.046307 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:42.046265 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:42.134064 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:42.134031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:42.489480 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:42.489399 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845586f9ff-h5625" event={"ID":"4fedac38-5bca-42b2-a2ef-191b0e00cfb0","Type":"ContainerStarted","Data":"29572ee40a0efd0d13e2482210a73c06b5693547d80325fbe338063492f13e7b"} Jul 28 10:08:43.315203 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:43.315161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:43.496507 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:43.496474 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerStarted","Data":"0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd"} Jul 28 10:08:43.496842 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:43.496539 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerStarted","Data":"b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826"} Jul 28 10:08:43.496842 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:43.496565 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerStarted","Data":"d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488"} Jul 28 10:08:43.496842 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:43.496595 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerStarted","Data":"2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce"} Jul 28 10:08:43.496842 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:43.496618 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerStarted","Data":"b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95"} Jul 28 10:08:44.161894 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:44.161857 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:44.222317 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:44.222284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:44.532455 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:44.532370 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:44.592118 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:44.592060 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:46.510036 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:46.510003 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845586f9ff-h5625" event={"ID":"4fedac38-5bca-42b2-a2ef-191b0e00cfb0","Type":"ContainerStarted","Data":"d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5"} Jul 28 10:08:46.513106 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:46.513084 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerStarted","Data":"371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9"} Jul 28 10:08:46.597525 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:46.597477 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-845586f9ff-h5625" podStartSLOduration=2.054437599 podStartE2EDuration="5.597462621s" totalImagesPullingTime="3.543025022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:46.551953893 +0000 UTC m=+88.030935689" watchObservedRunningTime="2026-07-28 10:08:46.597462621 +0000 UTC m=+88.076444415" Jul 28 10:08:46.764277 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:46.764193 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:46.877962 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:46.877931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:51.295334 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.295298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:51.404692 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.404663 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:51.704451 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.704396 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.893635435 podStartE2EDuration="13.70437916s" totalImagesPullingTime="4.791581758s" totalInitContainerRuntime="19.161967ms" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:46.598559404 +0000 UTC m=+88.077541199" watchObservedRunningTime="2026-07-28 10:08:51.70437916 +0000 UTC m=+93.183360954" Jul 28 10:08:51.704799 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.704782 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6945c64977-dshrk"] Jul 28 10:08:51.876445 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.876414 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:51.876445 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.876447 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6945c64977-dshrk"] Jul 28 10:08:51.876630 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.876469 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:51.876630 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.876521 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:51.876797 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.876780 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:51.880624 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.880602 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:08:51.885870 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.885854 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 10:08:51.988270 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.988219 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-service-ca\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:51.988270 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.988265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-console-config\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:51.988428 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.988300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-trusted-ca-bundle\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:51.988428 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.988356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tsbw\" (UniqueName: \"kubernetes.io/projected/24304f2f-4458-44ae-be9e-dc52d10576d6-kube-api-access-7tsbw\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:51.988428 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.988388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24304f2f-4458-44ae-be9e-dc52d10576d6-console-serving-cert\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:51.988428 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.988412 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-oauth-serving-cert\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:51.988650 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:51.988490 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24304f2f-4458-44ae-be9e-dc52d10576d6-console-oauth-config\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.088846 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.088816 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsbw\" (UniqueName: \"kubernetes.io/projected/24304f2f-4458-44ae-be9e-dc52d10576d6-kube-api-access-7tsbw\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.088846 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.088854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24304f2f-4458-44ae-be9e-dc52d10576d6-console-serving-cert\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.089054 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.088870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-oauth-serving-cert\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.089054 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.088961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24304f2f-4458-44ae-be9e-dc52d10576d6-console-oauth-config\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.089187 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.089058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-service-ca\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.089187 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.089121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-console-config\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.089187 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.089158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-trusted-ca-bundle\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.089803 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.089778 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-console-config\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.089937 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.089778 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-oauth-serving-cert\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.089937 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.089879 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-service-ca\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.090091 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.090051 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-trusted-ca-bundle\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.091317 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.091297 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24304f2f-4458-44ae-be9e-dc52d10576d6-console-oauth-config\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.091514 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.091497 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24304f2f-4458-44ae-be9e-dc52d10576d6-console-serving-cert\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.098100 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.098055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tsbw\" (UniqueName: \"kubernetes.io/projected/24304f2f-4458-44ae-be9e-dc52d10576d6-kube-api-access-7tsbw\") pod \"console-6945c64977-dshrk\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.186010 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.185989 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:08:52.322840 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.322819 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6945c64977-dshrk"] Jul 28 10:08:52.324741 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:08:52.324717 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24304f2f_4458_44ae_be9e_dc52d10576d6.slice/crio-2b2a9f9155fc117a475ffb85e341c5aa00b1f769c84f1b1c834736e274310d94 WatchSource:0}: Error finding container 2b2a9f9155fc117a475ffb85e341c5aa00b1f769c84f1b1c834736e274310d94: Status 404 returned error can't find the container with id 2b2a9f9155fc117a475ffb85e341c5aa00b1f769c84f1b1c834736e274310d94 Jul 28 10:08:52.536750 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.536667 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6945c64977-dshrk" event={"ID":"24304f2f-4458-44ae-be9e-dc52d10576d6","Type":"ContainerStarted","Data":"ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676"} Jul 28 10:08:52.536750 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.536720 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6945c64977-dshrk" event={"ID":"24304f2f-4458-44ae-be9e-dc52d10576d6","Type":"ContainerStarted","Data":"2b2a9f9155fc117a475ffb85e341c5aa00b1f769c84f1b1c834736e274310d94"} Jul 28 10:08:52.556051 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:52.556000 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6945c64977-dshrk" podStartSLOduration=1.555983004 podStartE2EDuration="1.555983004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:52.555597584 +0000 UTC m=+94.034579379" watchObservedRunningTime="2026-07-28 10:08:52.555983004 +0000 UTC m=+94.034964798" Jul 28 10:08:54.000939 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:54.000908 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:55.348598 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:55.348569 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:55.406188 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:08:55.406158 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:00.123144 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:00.123099 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:01.436510 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:01.436485 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dp9sg" Jul 28 10:09:01.522676 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:01.522641 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:01.593634 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:01.593607 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:01.660942 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:01.660914 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:01.725937 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:01.725877 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:02.186788 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:02.186757 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:09:02.186969 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:02.186833 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:09:02.191524 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:02.191503 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:09:02.576259 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:02.576229 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:09:02.642682 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:02.642652 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-845586f9ff-h5625"] Jul 28 10:09:03.763365 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:03.763331 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:03.866344 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:03.866314 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:04.725251 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:04.725217 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:04.803027 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:04.803000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:16.389658 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:16.389615 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:16.465224 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:16.465194 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:16.638051 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:16.638019 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:16.698351 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:16.698283 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:27.226992 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:27.226964 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:27.661315 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:27.661261 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-845586f9ff-h5625" podUID="4fedac38-5bca-42b2-a2ef-191b0e00cfb0" containerName="console" containerID="cri-o://d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5" gracePeriod=15 Jul 28 10:09:27.895882 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:27.895860 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:09:28.060127 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.060039 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-oauth-serving-cert\") pod \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " Jul 28 10:09:28.060127 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.060108 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-config\") pod \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " Jul 28 10:09:28.060127 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.060127 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-oauth-config\") pod \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " Jul 28 10:09:28.060358 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.060147 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-service-ca\") pod \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " Jul 28 10:09:28.060358 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.060178 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8nms\" (UniqueName: \"kubernetes.io/projected/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-kube-api-access-p8nms\") pod \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " Jul 28 10:09:28.060358 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.060230 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-serving-cert\") pod \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\" (UID: \"4fedac38-5bca-42b2-a2ef-191b0e00cfb0\") " Jul 28 10:09:28.060516 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.060480 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4fedac38-5bca-42b2-a2ef-191b0e00cfb0" (UID: "4fedac38-5bca-42b2-a2ef-191b0e00cfb0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:09:28.060573 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.060533 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-service-ca" (OuterVolumeSpecName: "service-ca") pod "4fedac38-5bca-42b2-a2ef-191b0e00cfb0" (UID: "4fedac38-5bca-42b2-a2ef-191b0e00cfb0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:09:28.060573 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.060550 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-config" (OuterVolumeSpecName: "console-config") pod "4fedac38-5bca-42b2-a2ef-191b0e00cfb0" (UID: "4fedac38-5bca-42b2-a2ef-191b0e00cfb0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:09:28.062437 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.062412 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4fedac38-5bca-42b2-a2ef-191b0e00cfb0" (UID: "4fedac38-5bca-42b2-a2ef-191b0e00cfb0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:09:28.062540 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.062473 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4fedac38-5bca-42b2-a2ef-191b0e00cfb0" (UID: "4fedac38-5bca-42b2-a2ef-191b0e00cfb0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:09:28.062540 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.062479 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-kube-api-access-p8nms" (OuterVolumeSpecName: "kube-api-access-p8nms") pod "4fedac38-5bca-42b2-a2ef-191b0e00cfb0" (UID: "4fedac38-5bca-42b2-a2ef-191b0e00cfb0"). InnerVolumeSpecName "kube-api-access-p8nms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:09:28.160936 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.160906 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-oauth-serving-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:28.160936 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.160933 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:28.161105 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.160947 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-oauth-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:28.161105 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.160959 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-service-ca\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:28.161105 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.160970 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8nms\" (UniqueName: \"kubernetes.io/projected/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-kube-api-access-p8nms\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:28.161105 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.160983 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fedac38-5bca-42b2-a2ef-191b0e00cfb0-console-serving-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:28.665157 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.665117 2581 generic.go:356] "Generic (PLEG): container finished" podID="4fedac38-5bca-42b2-a2ef-191b0e00cfb0" containerID="d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5" exitCode=0 Jul 28 10:09:28.665568 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.665170 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845586f9ff-h5625" Jul 28 10:09:28.665568 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.665206 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845586f9ff-h5625" event={"ID":"4fedac38-5bca-42b2-a2ef-191b0e00cfb0","Type":"ContainerDied","Data":"d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5"} Jul 28 10:09:28.665568 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.665254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845586f9ff-h5625" event={"ID":"4fedac38-5bca-42b2-a2ef-191b0e00cfb0","Type":"ContainerDied","Data":"29572ee40a0efd0d13e2482210a73c06b5693547d80325fbe338063492f13e7b"} Jul 28 10:09:28.665568 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.665274 2581 scope.go:117] "RemoveContainer" containerID="d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5" Jul 28 10:09:28.677048 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.677030 2581 scope.go:117] "RemoveContainer" containerID="d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5" Jul 28 10:09:28.677354 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:09:28.677333 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5\": container with ID starting with d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5 not found: ID does not exist" containerID="d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5" Jul 28 10:09:28.677427 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.677362 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5"} err="failed to get container status \"d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5\": rpc error: code = NotFound desc = could not find container \"d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5\": container with ID starting with d9bb12181058ee92c7cacb72dcb17842d545c0ef69bcb7c91aaf383863db49d5 not found: ID does not exist" Jul 28 10:09:28.688253 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.688231 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-845586f9ff-h5625"] Jul 28 10:09:28.690262 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:28.690238 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-845586f9ff-h5625"] Jul 28 10:09:29.095506 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:29.095478 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fedac38-5bca-42b2-a2ef-191b0e00cfb0" path="/var/lib/kubelet/pods/4fedac38-5bca-42b2-a2ef-191b0e00cfb0/volumes" Jul 28 10:09:45.584187 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:45.584145 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:56.285451 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:56.285425 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:56.486941 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:56.486910 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:57.348701 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.348668 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 10:09:57.349059 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.348957 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="alertmanager" containerID="cri-o://b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95" gracePeriod=120 Jul 28 10:09:57.349059 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.349041 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="kube-rbac-proxy-metric" containerID="cri-o://0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd" gracePeriod=120 Jul 28 10:09:57.349205 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.349043 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="kube-rbac-proxy-web" containerID="cri-o://d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488" gracePeriod=120 Jul 28 10:09:57.349205 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.349099 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="prom-label-proxy" containerID="cri-o://371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9" gracePeriod=120 Jul 28 10:09:57.349205 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.349113 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="config-reloader" containerID="cri-o://2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce" gracePeriod=120 Jul 28 10:09:57.349205 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.349158 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="kube-rbac-proxy" containerID="cri-o://b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826" gracePeriod=120 Jul 28 10:09:57.772588 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.772493 2581 generic.go:356] "Generic (PLEG): container finished" podID="9c644d70-d771-4739-b518-429e2baf6748" containerID="371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9" exitCode=0 Jul 28 10:09:57.772588 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.772518 2581 generic.go:356] "Generic (PLEG): container finished" podID="9c644d70-d771-4739-b518-429e2baf6748" containerID="b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826" exitCode=0 Jul 28 10:09:57.772588 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.772524 2581 generic.go:356] "Generic (PLEG): container finished" podID="9c644d70-d771-4739-b518-429e2baf6748" containerID="d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488" exitCode=0 Jul 28 10:09:57.772588 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.772530 2581 generic.go:356] "Generic (PLEG): container finished" podID="9c644d70-d771-4739-b518-429e2baf6748" containerID="2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce" exitCode=0 Jul 28 10:09:57.772588 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.772535 2581 generic.go:356] "Generic (PLEG): container finished" podID="9c644d70-d771-4739-b518-429e2baf6748" containerID="b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95" exitCode=0 Jul 28 10:09:57.772588 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.772571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerDied","Data":"371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9"} Jul 28 10:09:57.772931 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.772656 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerDied","Data":"b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826"} Jul 28 10:09:57.772931 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.772696 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerDied","Data":"d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488"} Jul 28 10:09:57.772931 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.772731 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerDied","Data":"2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce"} Jul 28 10:09:57.772931 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:57.772767 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerDied","Data":"b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95"} Jul 28 10:09:58.588478 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.588453 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.655277 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655195 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c644d70-d771-4739-b518-429e2baf6748-tls-assets\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655277 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655246 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-metrics-client-ca\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655277 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655275 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-web-config\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655536 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655307 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-cluster-tls-config\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655536 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655344 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy-web\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655536 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655379 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6trj\" (UniqueName: \"kubernetes.io/projected/9c644d70-d771-4739-b518-429e2baf6748-kube-api-access-v6trj\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655536 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655413 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-main-db\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655536 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655442 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-trusted-ca-bundle\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655536 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655468 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c644d70-d771-4739-b518-429e2baf6748-config-out\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655536 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655492 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-config-volume\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655536 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655518 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655945 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655549 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655945 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655608 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-main-tls\") pod \"9c644d70-d771-4739-b518-429e2baf6748\" (UID: \"9c644d70-d771-4739-b518-429e2baf6748\") " Jul 28 10:09:58.655945 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.655898 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:09:58.656470 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.656193 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:09:58.656953 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.656925 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:09:58.658833 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.658715 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:09:58.658833 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.659195 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c644d70-d771-4739-b518-429e2baf6748-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:09:58.659996 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.659962 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c644d70-d771-4739-b518-429e2baf6748-config-out" (OuterVolumeSpecName: "config-out") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:09:58.660515 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.660487 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:09:58.660604 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.660521 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:09:58.660895 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.660869 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-config-volume" (OuterVolumeSpecName: "config-volume") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:09:58.661024 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.660988 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:09:58.661024 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.660988 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c644d70-d771-4739-b518-429e2baf6748-kube-api-access-v6trj" (OuterVolumeSpecName: "kube-api-access-v6trj") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "kube-api-access-v6trj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:09:58.662771 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.662699 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:09:58.668304 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.668281 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-web-config" (OuterVolumeSpecName: "web-config") pod "9c644d70-d771-4739-b518-429e2baf6748" (UID: "9c644d70-d771-4739-b518-429e2baf6748"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:09:58.756107 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756081 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.756107 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756103 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-main-tls\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.756250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756114 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c644d70-d771-4739-b518-429e2baf6748-tls-assets\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.756250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756124 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-metrics-client-ca\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.756250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756132 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-web-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.756250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756141 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-cluster-tls-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.756250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756149 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.756250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756158 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6trj\" (UniqueName: \"kubernetes.io/projected/9c644d70-d771-4739-b518-429e2baf6748-kube-api-access-v6trj\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.756250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756166 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-main-db\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.756250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756174 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c644d70-d771-4739-b518-429e2baf6748-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.756250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756183 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c644d70-d771-4739-b518-429e2baf6748-config-out\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.756250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756191 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-config-volume\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.756250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.756200 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c644d70-d771-4739-b518-429e2baf6748-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:09:58.778786 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.778756 2581 generic.go:356] "Generic (PLEG): container finished" podID="9c644d70-d771-4739-b518-429e2baf6748" containerID="0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd" exitCode=0 Jul 28 10:09:58.778868 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.778808 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerDied","Data":"0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd"} Jul 28 10:09:58.778922 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.778864 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.778922 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.778910 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c644d70-d771-4739-b518-429e2baf6748","Type":"ContainerDied","Data":"b0253e0052ac47b350d1c613254449ab0d363b2f83821cc9591ba5b35aedcf28"} Jul 28 10:09:58.778978 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.778957 2581 scope.go:117] "RemoveContainer" containerID="371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9" Jul 28 10:09:58.787292 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.787277 2581 scope.go:117] "RemoveContainer" containerID="0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd" Jul 28 10:09:58.793755 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.793738 2581 scope.go:117] "RemoveContainer" containerID="b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826" Jul 28 10:09:58.800329 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.800315 2581 scope.go:117] "RemoveContainer" containerID="d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488" Jul 28 10:09:58.804751 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.804733 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 10:09:58.806825 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.806809 2581 scope.go:117] "RemoveContainer" containerID="2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce" Jul 28 10:09:58.811815 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.811793 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 10:09:58.813653 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.813640 2581 scope.go:117] "RemoveContainer" containerID="b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95" Jul 28 10:09:58.819902 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.819888 2581 scope.go:117] "RemoveContainer" containerID="0d618de0f33908c60245968b11d7a97a0cb35643200909ede97ef634f5ef2de2" Jul 28 10:09:58.825971 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.825954 2581 scope.go:117] "RemoveContainer" containerID="371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9" Jul 28 10:09:58.826224 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:09:58.826206 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9\": container with ID starting with 371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9 not found: ID does not exist" containerID="371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9" Jul 28 10:09:58.826285 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.826233 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9"} err="failed to get container status \"371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9\": rpc error: code = NotFound desc = could not find container \"371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9\": container with ID starting with 371a02d0a696efdb5a5ad18c4a58257cf130cb2a82de19022408e4bdc48999d9 not found: ID does not exist" Jul 28 10:09:58.826285 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.826249 2581 scope.go:117] "RemoveContainer" containerID="0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd" Jul 28 10:09:58.826518 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:09:58.826500 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd\": container with ID starting with 0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd not found: ID does not exist" containerID="0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd" Jul 28 10:09:58.826564 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.826524 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd"} err="failed to get container status \"0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd\": rpc error: code = NotFound desc = could not find container \"0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd\": container with ID starting with 0ed6bcff0a021f75099527c03bdc260af08e04df9242dca97cc25085fbd0c6dd not found: ID does not exist" Jul 28 10:09:58.826564 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.826546 2581 scope.go:117] "RemoveContainer" containerID="b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826" Jul 28 10:09:58.826805 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:09:58.826782 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826\": container with ID starting with b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826 not found: ID does not exist" containerID="b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826" Jul 28 10:09:58.826879 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.826806 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826"} err="failed to get container status \"b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826\": rpc error: code = NotFound desc = could not find container \"b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826\": container with ID starting with b82f73c770828ccd4d8c363ba5ab25bb73a5a216afb2e26400f30a696aee5826 not found: ID does not exist" Jul 28 10:09:58.826879 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.826827 2581 scope.go:117] "RemoveContainer" containerID="d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488" Jul 28 10:09:58.827100 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:09:58.827079 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488\": container with ID starting with d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488 not found: ID does not exist" containerID="d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488" Jul 28 10:09:58.827148 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.827107 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488"} err="failed to get container status \"d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488\": rpc error: code = NotFound desc = could not find container \"d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488\": container with ID starting with d61515efc736588c52cfc906e83ef6cc177eccc041cc9aa818ed58f397e33488 not found: ID does not exist" Jul 28 10:09:58.827148 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.827128 2581 scope.go:117] "RemoveContainer" containerID="2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce" Jul 28 10:09:58.827363 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:09:58.827348 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce\": container with ID starting with 2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce not found: ID does not exist" containerID="2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce" Jul 28 10:09:58.827405 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.827368 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce"} err="failed to get container status \"2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce\": rpc error: code = NotFound desc = could not find container \"2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce\": container with ID starting with 2800137783ba8cd1f14905740d0feb5fd5aa487e0071acfacfc0d0f9a81ee1ce not found: ID does not exist" Jul 28 10:09:58.827405 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.827381 2581 scope.go:117] "RemoveContainer" containerID="b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95" Jul 28 10:09:58.827572 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:09:58.827555 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95\": container with ID starting with b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95 not found: ID does not exist" containerID="b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95" Jul 28 10:09:58.827628 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.827579 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95"} err="failed to get container status \"b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95\": rpc error: code = NotFound desc = could not find container \"b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95\": container with ID starting with b13b59a72779178d68c670abe67b1535da3f7674655e5805b78d7d8a6905ed95 not found: ID does not exist" Jul 28 10:09:58.827628 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.827599 2581 scope.go:117] "RemoveContainer" containerID="0d618de0f33908c60245968b11d7a97a0cb35643200909ede97ef634f5ef2de2" Jul 28 10:09:58.827802 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:09:58.827786 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d618de0f33908c60245968b11d7a97a0cb35643200909ede97ef634f5ef2de2\": container with ID starting with 0d618de0f33908c60245968b11d7a97a0cb35643200909ede97ef634f5ef2de2 not found: ID does not exist" containerID="0d618de0f33908c60245968b11d7a97a0cb35643200909ede97ef634f5ef2de2" Jul 28 10:09:58.827860 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.827807 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d618de0f33908c60245968b11d7a97a0cb35643200909ede97ef634f5ef2de2"} err="failed to get container status \"0d618de0f33908c60245968b11d7a97a0cb35643200909ede97ef634f5ef2de2\": rpc error: code = NotFound desc = could not find container \"0d618de0f33908c60245968b11d7a97a0cb35643200909ede97ef634f5ef2de2\": container with ID starting with 0d618de0f33908c60245968b11d7a97a0cb35643200909ede97ef634f5ef2de2 not found: ID does not exist" Jul 28 10:09:58.840401 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840380 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 10:09:58.840609 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840598 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="config-reloader" Jul 28 10:09:58.840657 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840610 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="config-reloader" Jul 28 10:09:58.840657 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840617 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="kube-rbac-proxy-metric" Jul 28 10:09:58.840657 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840623 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="kube-rbac-proxy-metric" Jul 28 10:09:58.840657 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840634 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="kube-rbac-proxy" Jul 28 10:09:58.840657 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840639 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="kube-rbac-proxy" Jul 28 10:09:58.840657 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840648 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="prom-label-proxy" Jul 28 10:09:58.840657 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840653 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="prom-label-proxy" Jul 28 10:09:58.840657 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840660 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fedac38-5bca-42b2-a2ef-191b0e00cfb0" containerName="console" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840665 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fedac38-5bca-42b2-a2ef-191b0e00cfb0" containerName="console" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840671 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="alertmanager" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840677 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="alertmanager" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840688 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="kube-rbac-proxy-web" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840692 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="kube-rbac-proxy-web" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840699 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="init-config-reloader" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840704 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="init-config-reloader" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840757 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fedac38-5bca-42b2-a2ef-191b0e00cfb0" containerName="console" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840764 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="kube-rbac-proxy-metric" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840769 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="prom-label-proxy" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840775 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="kube-rbac-proxy" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840780 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="config-reloader" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840785 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="alertmanager" Jul 28 10:09:58.840901 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.840791 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c644d70-d771-4739-b518-429e2baf6748" containerName="kube-rbac-proxy-web" Jul 28 10:09:58.845246 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.845229 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.848164 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.848143 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 10:09:58.848257 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.848144 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 10:09:58.849144 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.849130 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 10:09:58.849144 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.849139 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 10:09:58.849276 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.849160 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-76hkz\"" Jul 28 10:09:58.849426 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.849406 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 10:09:58.849873 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.849856 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 10:09:58.850200 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.850154 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 10:09:58.850285 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.850239 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 10:09:58.854998 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.854981 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 10:09:58.857046 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.857134 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857058 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7122bb6e-7960-4aac-9619-97ed8caa21fc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.857134 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.857205 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-config-volume\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.857205 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857192 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7122bb6e-7960-4aac-9619-97ed8caa21fc-config-out\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.857272 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7122bb6e-7960-4aac-9619-97ed8caa21fc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.857272 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.857361 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857274 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.857361 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.857361 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7122bb6e-7960-4aac-9619-97ed8caa21fc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.857508 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfmcl\" (UniqueName: \"kubernetes.io/projected/7122bb6e-7960-4aac-9619-97ed8caa21fc-kube-api-access-pfmcl\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.857508 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7122bb6e-7960-4aac-9619-97ed8caa21fc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.857508 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.857463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-web-config\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.860035 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.860016 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 10:09:58.958299 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmcl\" (UniqueName: \"kubernetes.io/projected/7122bb6e-7960-4aac-9619-97ed8caa21fc-kube-api-access-pfmcl\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.958299 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958265 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7122bb6e-7960-4aac-9619-97ed8caa21fc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.958299 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958283 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-web-config\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.958521 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.958521 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7122bb6e-7960-4aac-9619-97ed8caa21fc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.958521 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.958521 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-config-volume\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.958718 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7122bb6e-7960-4aac-9619-97ed8caa21fc-config-out\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.958718 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7122bb6e-7960-4aac-9619-97ed8caa21fc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.958718 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.958718 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.958718 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.958718 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.958679 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7122bb6e-7960-4aac-9619-97ed8caa21fc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.959214 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.959189 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7122bb6e-7960-4aac-9619-97ed8caa21fc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.959387 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.959367 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7122bb6e-7960-4aac-9619-97ed8caa21fc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.959516 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.959467 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7122bb6e-7960-4aac-9619-97ed8caa21fc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.961479 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.961455 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.961567 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.961488 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7122bb6e-7960-4aac-9619-97ed8caa21fc-config-out\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.961567 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.961549 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-web-config\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.961695 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.961650 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.961695 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.961653 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.962007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.961987 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-config-volume\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.962048 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.962018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7122bb6e-7960-4aac-9619-97ed8caa21fc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.962198 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.962183 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.962948 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.962933 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7122bb6e-7960-4aac-9619-97ed8caa21fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:58.967032 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:58.967016 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfmcl\" (UniqueName: \"kubernetes.io/projected/7122bb6e-7960-4aac-9619-97ed8caa21fc-kube-api-access-pfmcl\") pod \"alertmanager-main-0\" (UID: \"7122bb6e-7960-4aac-9619-97ed8caa21fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:59.095063 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:59.095030 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c644d70-d771-4739-b518-429e2baf6748" path="/var/lib/kubelet/pods/9c644d70-d771-4739-b518-429e2baf6748/volumes" Jul 28 10:09:59.154306 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:59.154281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 10:09:59.285490 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:59.285454 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 10:09:59.288272 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:09:59.288245 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7122bb6e_7960_4aac_9619_97ed8caa21fc.slice/crio-991856562c905dd32956d5620c5a505cd696cd494f3d3f429625bd5fe5efed3c WatchSource:0}: Error finding container 991856562c905dd32956d5620c5a505cd696cd494f3d3f429625bd5fe5efed3c: Status 404 returned error can't find the container with id 991856562c905dd32956d5620c5a505cd696cd494f3d3f429625bd5fe5efed3c Jul 28 10:09:59.786348 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:59.786315 2581 generic.go:356] "Generic (PLEG): container finished" podID="7122bb6e-7960-4aac-9619-97ed8caa21fc" containerID="e0f4a2a909dfcbe967074b88e57bbfeddf936e829c4940bcd52558e2f1016b01" exitCode=0 Jul 28 10:09:59.786765 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:59.786401 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7122bb6e-7960-4aac-9619-97ed8caa21fc","Type":"ContainerDied","Data":"e0f4a2a909dfcbe967074b88e57bbfeddf936e829c4940bcd52558e2f1016b01"} Jul 28 10:09:59.786765 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:09:59.786509 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7122bb6e-7960-4aac-9619-97ed8caa21fc","Type":"ContainerStarted","Data":"991856562c905dd32956d5620c5a505cd696cd494f3d3f429625bd5fe5efed3c"} Jul 28 10:10:00.794188 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:00.794146 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7122bb6e-7960-4aac-9619-97ed8caa21fc","Type":"ContainerStarted","Data":"c56756ad55812f3b6999d2f772e63488a67bc5b50269b1710243315890b46015"} Jul 28 10:10:00.794551 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:00.794244 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7122bb6e-7960-4aac-9619-97ed8caa21fc","Type":"ContainerStarted","Data":"82bee488560fcd89afee0bf54ed423c8ba0b7fb9ae7787c8c3ea6c7f36cba7fe"} Jul 28 10:10:00.794551 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:00.794273 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7122bb6e-7960-4aac-9619-97ed8caa21fc","Type":"ContainerStarted","Data":"1ff6035486219a84261c7d74caa0aa3008f603922c4a3319579610033c720896"} Jul 28 10:10:00.794551 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:00.794298 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7122bb6e-7960-4aac-9619-97ed8caa21fc","Type":"ContainerStarted","Data":"c9856cdea3d0b2aee22ccb2345fa7895b84cb99ab5e17de9adf2d95163834e32"} Jul 28 10:10:00.794551 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:00.794321 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7122bb6e-7960-4aac-9619-97ed8caa21fc","Type":"ContainerStarted","Data":"60a4aeeb927f8687b4fd95dfc847a56c254e09c7f1ae4722b5e3b178ebb90a21"} Jul 28 10:10:00.794551 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:00.794343 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7122bb6e-7960-4aac-9619-97ed8caa21fc","Type":"ContainerStarted","Data":"7abc3eb38842c183222fda7d5063c38cefa2085a33b1d265d9636af837a47ad5"} Jul 28 10:10:00.824965 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:00.824731 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.809040645 podStartE2EDuration="2.824711624s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.670979ms" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:10:00.822625221 +0000 UTC m=+162.301607007" watchObservedRunningTime="2026-07-28 10:10:00.824711624 +0000 UTC m=+162.303693420" Jul 28 10:10:01.381767 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.381736 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d4f958555-g2mhk"] Jul 28 10:10:01.384874 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.384853 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.388481 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.388457 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 10:10:01.388602 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.388464 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 10:10:01.388602 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.388511 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 10:10:01.388602 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.388519 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4n8tg\"" Jul 28 10:10:01.388602 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.388571 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 10:10:01.388805 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.388748 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 10:10:01.393778 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.393762 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 10:10:01.401230 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.401207 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d4f958555-g2mhk"] Jul 28 10:10:01.479880 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.479851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c734dab6-52f0-4caf-915e-1522cb4c9a27-secret-telemeter-client\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.480013 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.479888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdhz9\" (UniqueName: \"kubernetes.io/projected/c734dab6-52f0-4caf-915e-1522cb4c9a27-kube-api-access-bdhz9\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.480013 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.479914 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c734dab6-52f0-4caf-915e-1522cb4c9a27-serving-certs-ca-bundle\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.480168 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.480018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c734dab6-52f0-4caf-915e-1522cb4c9a27-federate-client-tls\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.480168 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.480082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c734dab6-52f0-4caf-915e-1522cb4c9a27-telemeter-client-tls\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.480168 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.480106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c734dab6-52f0-4caf-915e-1522cb4c9a27-metrics-client-ca\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.480168 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.480136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c734dab6-52f0-4caf-915e-1522cb4c9a27-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.480321 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.480183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c734dab6-52f0-4caf-915e-1522cb4c9a27-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.580630 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.580583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c734dab6-52f0-4caf-915e-1522cb4c9a27-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.580800 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.580649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c734dab6-52f0-4caf-915e-1522cb4c9a27-secret-telemeter-client\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.580800 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.580692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdhz9\" (UniqueName: \"kubernetes.io/projected/c734dab6-52f0-4caf-915e-1522cb4c9a27-kube-api-access-bdhz9\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.580800 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.580728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c734dab6-52f0-4caf-915e-1522cb4c9a27-serving-certs-ca-bundle\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.580800 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.580765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c734dab6-52f0-4caf-915e-1522cb4c9a27-federate-client-tls\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.580800 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.580799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c734dab6-52f0-4caf-915e-1522cb4c9a27-telemeter-client-tls\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.581055 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.580823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c734dab6-52f0-4caf-915e-1522cb4c9a27-metrics-client-ca\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.581055 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.580848 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c734dab6-52f0-4caf-915e-1522cb4c9a27-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.581668 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.581636 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c734dab6-52f0-4caf-915e-1522cb4c9a27-serving-certs-ca-bundle\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.581776 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.581691 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c734dab6-52f0-4caf-915e-1522cb4c9a27-metrics-client-ca\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.581836 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.581786 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c734dab6-52f0-4caf-915e-1522cb4c9a27-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.583294 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.583266 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c734dab6-52f0-4caf-915e-1522cb4c9a27-telemeter-client-tls\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.583384 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.583357 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c734dab6-52f0-4caf-915e-1522cb4c9a27-federate-client-tls\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.583636 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.583612 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c734dab6-52f0-4caf-915e-1522cb4c9a27-secret-telemeter-client\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.583672 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.583644 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c734dab6-52f0-4caf-915e-1522cb4c9a27-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.588831 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.588808 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdhz9\" (UniqueName: \"kubernetes.io/projected/c734dab6-52f0-4caf-915e-1522cb4c9a27-kube-api-access-bdhz9\") pod \"telemeter-client-d4f958555-g2mhk\" (UID: \"c734dab6-52f0-4caf-915e-1522cb4c9a27\") " pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.695035 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.694967 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" Jul 28 10:10:01.844803 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:01.844780 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d4f958555-g2mhk"] Jul 28 10:10:01.846699 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:10:01.846673 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc734dab6_52f0_4caf_915e_1522cb4c9a27.slice/crio-2d7660092772686294e17893d4d71a08214465300f621f277f48712f6509cdeb WatchSource:0}: Error finding container 2d7660092772686294e17893d4d71a08214465300f621f277f48712f6509cdeb: Status 404 returned error can't find the container with id 2d7660092772686294e17893d4d71a08214465300f621f277f48712f6509cdeb Jul 28 10:10:02.802903 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:02.802862 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" event={"ID":"c734dab6-52f0-4caf-915e-1522cb4c9a27","Type":"ContainerStarted","Data":"2d7660092772686294e17893d4d71a08214465300f621f277f48712f6509cdeb"} Jul 28 10:10:04.813865 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:04.813828 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" event={"ID":"c734dab6-52f0-4caf-915e-1522cb4c9a27","Type":"ContainerStarted","Data":"01d58e29456be4cb43213424715052f3aa6941991c096f0e009fbdde2de093ed"} Jul 28 10:10:04.814266 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:04.813881 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" event={"ID":"c734dab6-52f0-4caf-915e-1522cb4c9a27","Type":"ContainerStarted","Data":"cb762bd50c54fc2fa4b7bbf3ca52c34e3634ce505050d41db123e077b8f93247"} Jul 28 10:10:04.814266 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:04.813902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" event={"ID":"c734dab6-52f0-4caf-915e-1522cb4c9a27","Type":"ContainerStarted","Data":"576cf2a85aa1016e4e4317e458f127564ca86051b1c57be62e795e83935a0171"} Jul 28 10:10:04.839921 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:04.839877 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d4f958555-g2mhk" podStartSLOduration=1.620663293 podStartE2EDuration="3.8398622s" totalImagesPullingTime="2.219198907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:10:04.838441124 +0000 UTC m=+166.317422921" watchObservedRunningTime="2026-07-28 10:10:04.8398622 +0000 UTC m=+166.318843977" Jul 28 10:10:05.515157 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.515127 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-88787dc4-j42kt"] Jul 28 10:10:05.518514 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.518491 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.530513 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.530492 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88787dc4-j42kt"] Jul 28 10:10:05.610636 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.610613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-oauth-serving-cert\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.610759 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.610642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54gf5\" (UniqueName: \"kubernetes.io/projected/2d1e0fa5-0ce6-4fca-9234-09a24699b408-kube-api-access-54gf5\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.610759 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.610673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-serving-cert\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.610759 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.610689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-oauth-config\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.610759 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.610735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-service-ca\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.610884 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.610761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-config\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.610884 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.610793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-trusted-ca-bundle\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.711415 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.711389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-oauth-config\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.711528 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.711419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-service-ca\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.711528 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.711445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-config\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.711528 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.711473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-trusted-ca-bundle\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.711528 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.711517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-oauth-serving-cert\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.711721 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.711541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54gf5\" (UniqueName: \"kubernetes.io/projected/2d1e0fa5-0ce6-4fca-9234-09a24699b408-kube-api-access-54gf5\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.711721 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.711590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-serving-cert\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.712326 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.712302 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-config\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.712447 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.712302 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-service-ca\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.712447 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.712302 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-oauth-serving-cert\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.712614 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.712586 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-trusted-ca-bundle\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.713984 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.713957 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-oauth-config\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.714052 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.713999 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-serving-cert\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.719157 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.719133 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54gf5\" (UniqueName: \"kubernetes.io/projected/2d1e0fa5-0ce6-4fca-9234-09a24699b408-kube-api-access-54gf5\") pod \"console-88787dc4-j42kt\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.827343 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.827315 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:05.948088 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:05.948048 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88787dc4-j42kt"] Jul 28 10:10:05.950627 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:10:05.950594 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1e0fa5_0ce6_4fca_9234_09a24699b408.slice/crio-044592dd84e992453a0bcb24a9698d66c5228b3b8cfd7767ce3887e2dbc6ef8c WatchSource:0}: Error finding container 044592dd84e992453a0bcb24a9698d66c5228b3b8cfd7767ce3887e2dbc6ef8c: Status 404 returned error can't find the container with id 044592dd84e992453a0bcb24a9698d66c5228b3b8cfd7767ce3887e2dbc6ef8c Jul 28 10:10:06.822364 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:06.822330 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88787dc4-j42kt" event={"ID":"2d1e0fa5-0ce6-4fca-9234-09a24699b408","Type":"ContainerStarted","Data":"c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63"} Jul 28 10:10:06.822526 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:06.822377 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88787dc4-j42kt" event={"ID":"2d1e0fa5-0ce6-4fca-9234-09a24699b408","Type":"ContainerStarted","Data":"044592dd84e992453a0bcb24a9698d66c5228b3b8cfd7767ce3887e2dbc6ef8c"} Jul 28 10:10:06.868561 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:06.868531 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:06.969556 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:06.969530 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:15.828357 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:15.828270 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:15.828357 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:15.828329 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:15.832929 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:15.832905 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:15.851235 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:15.851189 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-88787dc4-j42kt" podStartSLOduration=10.851175982 podStartE2EDuration="10.851175982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:10:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:10:06.840776726 +0000 UTC m=+168.319758522" watchObservedRunningTime="2026-07-28 10:10:15.851175982 +0000 UTC m=+177.330157846" Jul 28 10:10:15.858716 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:15.858696 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:10:15.902360 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:15.902336 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6945c64977-dshrk"] Jul 28 10:10:17.075703 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:17.075670 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:17.145700 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:17.145666 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:40.921475 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:40.921411 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6945c64977-dshrk" podUID="24304f2f-4458-44ae-be9e-dc52d10576d6" containerName="console" containerID="cri-o://ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676" gracePeriod=15 Jul 28 10:10:41.169080 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.169046 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:10:41.282442 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.282370 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-console-config\") pod \"24304f2f-4458-44ae-be9e-dc52d10576d6\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " Jul 28 10:10:41.282442 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.282401 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24304f2f-4458-44ae-be9e-dc52d10576d6-console-serving-cert\") pod \"24304f2f-4458-44ae-be9e-dc52d10576d6\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " Jul 28 10:10:41.282442 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.282442 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-trusted-ca-bundle\") pod \"24304f2f-4458-44ae-be9e-dc52d10576d6\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " Jul 28 10:10:41.282699 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.282487 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tsbw\" (UniqueName: \"kubernetes.io/projected/24304f2f-4458-44ae-be9e-dc52d10576d6-kube-api-access-7tsbw\") pod \"24304f2f-4458-44ae-be9e-dc52d10576d6\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " Jul 28 10:10:41.282699 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.282510 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-oauth-serving-cert\") pod \"24304f2f-4458-44ae-be9e-dc52d10576d6\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " Jul 28 10:10:41.282699 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.282529 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24304f2f-4458-44ae-be9e-dc52d10576d6-console-oauth-config\") pod \"24304f2f-4458-44ae-be9e-dc52d10576d6\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " Jul 28 10:10:41.282699 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.282571 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-service-ca\") pod \"24304f2f-4458-44ae-be9e-dc52d10576d6\" (UID: \"24304f2f-4458-44ae-be9e-dc52d10576d6\") " Jul 28 10:10:41.282898 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.282864 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-console-config" (OuterVolumeSpecName: "console-config") pod "24304f2f-4458-44ae-be9e-dc52d10576d6" (UID: "24304f2f-4458-44ae-be9e-dc52d10576d6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:10:41.283028 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.283002 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "24304f2f-4458-44ae-be9e-dc52d10576d6" (UID: "24304f2f-4458-44ae-be9e-dc52d10576d6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:10:41.283113 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.283016 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "24304f2f-4458-44ae-be9e-dc52d10576d6" (UID: "24304f2f-4458-44ae-be9e-dc52d10576d6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:10:41.283168 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.283135 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-service-ca" (OuterVolumeSpecName: "service-ca") pod "24304f2f-4458-44ae-be9e-dc52d10576d6" (UID: "24304f2f-4458-44ae-be9e-dc52d10576d6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:10:41.284482 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.284457 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24304f2f-4458-44ae-be9e-dc52d10576d6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "24304f2f-4458-44ae-be9e-dc52d10576d6" (UID: "24304f2f-4458-44ae-be9e-dc52d10576d6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:10:41.284630 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.284603 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24304f2f-4458-44ae-be9e-dc52d10576d6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "24304f2f-4458-44ae-be9e-dc52d10576d6" (UID: "24304f2f-4458-44ae-be9e-dc52d10576d6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:10:41.284690 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.284628 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24304f2f-4458-44ae-be9e-dc52d10576d6-kube-api-access-7tsbw" (OuterVolumeSpecName: "kube-api-access-7tsbw") pod "24304f2f-4458-44ae-be9e-dc52d10576d6" (UID: "24304f2f-4458-44ae-be9e-dc52d10576d6"). InnerVolumeSpecName "kube-api-access-7tsbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:10:41.383019 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.382995 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-oauth-serving-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:10:41.383019 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.383016 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24304f2f-4458-44ae-be9e-dc52d10576d6-console-oauth-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:10:41.383165 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.383026 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-service-ca\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:10:41.383165 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.383035 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-console-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:10:41.383165 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.383043 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24304f2f-4458-44ae-be9e-dc52d10576d6-console-serving-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:10:41.383165 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.383051 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24304f2f-4458-44ae-be9e-dc52d10576d6-trusted-ca-bundle\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:10:41.383165 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.383059 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tsbw\" (UniqueName: \"kubernetes.io/projected/24304f2f-4458-44ae-be9e-dc52d10576d6-kube-api-access-7tsbw\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:10:41.948341 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.948303 2581 generic.go:356] "Generic (PLEG): container finished" podID="24304f2f-4458-44ae-be9e-dc52d10576d6" containerID="ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676" exitCode=0 Jul 28 10:10:41.948807 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.948344 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6945c64977-dshrk" Jul 28 10:10:41.948807 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.948374 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6945c64977-dshrk" event={"ID":"24304f2f-4458-44ae-be9e-dc52d10576d6","Type":"ContainerDied","Data":"ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676"} Jul 28 10:10:41.948807 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.948417 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6945c64977-dshrk" event={"ID":"24304f2f-4458-44ae-be9e-dc52d10576d6","Type":"ContainerDied","Data":"2b2a9f9155fc117a475ffb85e341c5aa00b1f769c84f1b1c834736e274310d94"} Jul 28 10:10:41.948807 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.948437 2581 scope.go:117] "RemoveContainer" containerID="ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676" Jul 28 10:10:41.957008 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.956987 2581 scope.go:117] "RemoveContainer" containerID="ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676" Jul 28 10:10:41.957291 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:10:41.957269 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676\": container with ID starting with ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676 not found: ID does not exist" containerID="ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676" Jul 28 10:10:41.957370 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.957304 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676"} err="failed to get container status \"ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676\": rpc error: code = NotFound desc = could not find container \"ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676\": container with ID starting with ab3812254dd89bab1acda8e234d58d68f18ff10eb99a55e78fc06e86f8356676 not found: ID does not exist" Jul 28 10:10:41.969884 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.969863 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6945c64977-dshrk"] Jul 28 10:10:41.975955 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:41.975933 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6945c64977-dshrk"] Jul 28 10:10:43.095705 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:10:43.095674 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24304f2f-4458-44ae-be9e-dc52d10576d6" path="/var/lib/kubelet/pods/24304f2f-4458-44ae-be9e-dc52d10576d6/volumes" Jul 28 10:11:03.544685 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:03.544652 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:11.521749 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:11.521708 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:11.585430 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:11.585404 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:23.531332 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:23.531301 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:23.591493 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:23.591463 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:31.645313 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:31.645282 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:31.746183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:31.746150 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:33.805117 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.805082 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-667858cbfb-5z9jm"] Jul 28 10:11:33.805494 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.805335 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24304f2f-4458-44ae-be9e-dc52d10576d6" containerName="console" Jul 28 10:11:33.805494 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.805346 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="24304f2f-4458-44ae-be9e-dc52d10576d6" containerName="console" Jul 28 10:11:33.805494 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.805397 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="24304f2f-4458-44ae-be9e-dc52d10576d6" containerName="console" Jul 28 10:11:33.814843 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.814816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.820680 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.820653 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-667858cbfb-5z9jm"] Jul 28 10:11:33.843965 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.843937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-oauth-serving-cert\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.844142 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.843976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-oauth-config\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.844142 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.844001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2j7r\" (UniqueName: \"kubernetes.io/projected/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-kube-api-access-b2j7r\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.844142 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.844085 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-serving-cert\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.844142 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.844134 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-trusted-ca-bundle\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.844303 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.844198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-service-ca\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.844303 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.844228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-config\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.868851 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.868812 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:33.936714 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.936685 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:33.944838 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.944811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-config\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.944967 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.944851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-oauth-serving-cert\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.944967 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.944878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-oauth-config\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.944967 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.944903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2j7r\" (UniqueName: \"kubernetes.io/projected/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-kube-api-access-b2j7r\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.944967 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.944921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-serving-cert\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.944967 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.944949 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-trusted-ca-bundle\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.945244 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.944971 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-service-ca\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.945604 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.945584 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-oauth-serving-cert\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.945706 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.945635 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-config\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.945748 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.945733 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-service-ca\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.945858 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.945840 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-trusted-ca-bundle\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.947467 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.947432 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-oauth-config\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.947563 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.947487 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-serving-cert\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:33.955258 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:33.955237 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2j7r\" (UniqueName: \"kubernetes.io/projected/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-kube-api-access-b2j7r\") pod \"console-667858cbfb-5z9jm\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:34.124916 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:34.124882 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:34.251503 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:34.251475 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-667858cbfb-5z9jm"] Jul 28 10:11:34.254671 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:11:34.254644 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb41e18a_2fec_490f_abb0_65cb3bcdd3e8.slice/crio-eed8ec8de256c1474e8d4acb30c917f5c3dc70fde9bcaaee797a4d3ed5be2f8c WatchSource:0}: Error finding container eed8ec8de256c1474e8d4acb30c917f5c3dc70fde9bcaaee797a4d3ed5be2f8c: Status 404 returned error can't find the container with id eed8ec8de256c1474e8d4acb30c917f5c3dc70fde9bcaaee797a4d3ed5be2f8c Jul 28 10:11:35.127775 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:35.127739 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667858cbfb-5z9jm" event={"ID":"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8","Type":"ContainerStarted","Data":"43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74"} Jul 28 10:11:35.128183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:35.127796 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667858cbfb-5z9jm" event={"ID":"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8","Type":"ContainerStarted","Data":"eed8ec8de256c1474e8d4acb30c917f5c3dc70fde9bcaaee797a4d3ed5be2f8c"} Jul 28 10:11:35.146498 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:35.146436 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-667858cbfb-5z9jm" podStartSLOduration=2.146420568 podStartE2EDuration="2.146420568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:11:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:11:35.14543005 +0000 UTC m=+256.624411849" watchObservedRunningTime="2026-07-28 10:11:35.146420568 +0000 UTC m=+256.625402364" Jul 28 10:11:44.126005 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:44.125926 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:44.126005 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:44.125985 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:44.130553 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:44.130534 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:44.163489 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:44.163466 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:11:44.209675 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:44.209653 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88787dc4-j42kt"] Jul 28 10:11:44.330599 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:44.330557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:44.441589 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:11:44.441524 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:09.228334 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.228295 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-88787dc4-j42kt" podUID="2d1e0fa5-0ce6-4fca-9234-09a24699b408" containerName="console" containerID="cri-o://c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63" gracePeriod=15 Jul 28 10:12:09.464652 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.464629 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:12:09.598766 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.598738 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-config\") pod \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " Jul 28 10:12:09.598911 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.598790 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-serving-cert\") pod \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " Jul 28 10:12:09.598911 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.598825 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-oauth-serving-cert\") pod \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " Jul 28 10:12:09.598911 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.598863 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-service-ca\") pod \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " Jul 28 10:12:09.598911 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.598897 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54gf5\" (UniqueName: \"kubernetes.io/projected/2d1e0fa5-0ce6-4fca-9234-09a24699b408-kube-api-access-54gf5\") pod \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " Jul 28 10:12:09.599151 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.598923 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-trusted-ca-bundle\") pod \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " Jul 28 10:12:09.599151 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.598952 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-oauth-config\") pod \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\" (UID: \"2d1e0fa5-0ce6-4fca-9234-09a24699b408\") " Jul 28 10:12:09.599268 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.599236 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-config" (OuterVolumeSpecName: "console-config") pod "2d1e0fa5-0ce6-4fca-9234-09a24699b408" (UID: "2d1e0fa5-0ce6-4fca-9234-09a24699b408"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:12:09.599371 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.599342 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2d1e0fa5-0ce6-4fca-9234-09a24699b408" (UID: "2d1e0fa5-0ce6-4fca-9234-09a24699b408"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:12:09.599428 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.599351 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2d1e0fa5-0ce6-4fca-9234-09a24699b408" (UID: "2d1e0fa5-0ce6-4fca-9234-09a24699b408"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:12:09.599627 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.599596 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-service-ca" (OuterVolumeSpecName: "service-ca") pod "2d1e0fa5-0ce6-4fca-9234-09a24699b408" (UID: "2d1e0fa5-0ce6-4fca-9234-09a24699b408"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:12:09.600979 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.600949 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2d1e0fa5-0ce6-4fca-9234-09a24699b408" (UID: "2d1e0fa5-0ce6-4fca-9234-09a24699b408"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:12:09.601131 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.601010 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d1e0fa5-0ce6-4fca-9234-09a24699b408-kube-api-access-54gf5" (OuterVolumeSpecName: "kube-api-access-54gf5") pod "2d1e0fa5-0ce6-4fca-9234-09a24699b408" (UID: "2d1e0fa5-0ce6-4fca-9234-09a24699b408"). InnerVolumeSpecName "kube-api-access-54gf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:12:09.601131 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.601017 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2d1e0fa5-0ce6-4fca-9234-09a24699b408" (UID: "2d1e0fa5-0ce6-4fca-9234-09a24699b408"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:12:09.699785 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.699755 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:12:09.699785 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.699779 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-serving-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:12:09.699785 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.699789 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-oauth-serving-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:12:09.699996 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.699797 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-service-ca\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:12:09.699996 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.699805 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54gf5\" (UniqueName: \"kubernetes.io/projected/2d1e0fa5-0ce6-4fca-9234-09a24699b408-kube-api-access-54gf5\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:12:09.699996 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.699813 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e0fa5-0ce6-4fca-9234-09a24699b408-trusted-ca-bundle\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:12:09.699996 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:09.699821 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d1e0fa5-0ce6-4fca-9234-09a24699b408-console-oauth-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:12:10.251905 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:10.251871 2581 generic.go:356] "Generic (PLEG): container finished" podID="2d1e0fa5-0ce6-4fca-9234-09a24699b408" containerID="c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63" exitCode=0 Jul 28 10:12:10.252297 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:10.251912 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88787dc4-j42kt" Jul 28 10:12:10.252297 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:10.251958 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88787dc4-j42kt" event={"ID":"2d1e0fa5-0ce6-4fca-9234-09a24699b408","Type":"ContainerDied","Data":"c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63"} Jul 28 10:12:10.252297 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:10.252008 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88787dc4-j42kt" event={"ID":"2d1e0fa5-0ce6-4fca-9234-09a24699b408","Type":"ContainerDied","Data":"044592dd84e992453a0bcb24a9698d66c5228b3b8cfd7767ce3887e2dbc6ef8c"} Jul 28 10:12:10.252297 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:10.252031 2581 scope.go:117] "RemoveContainer" containerID="c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63" Jul 28 10:12:10.260281 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:10.260265 2581 scope.go:117] "RemoveContainer" containerID="c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63" Jul 28 10:12:10.260531 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:12:10.260513 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63\": container with ID starting with c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63 not found: ID does not exist" containerID="c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63" Jul 28 10:12:10.260573 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:10.260541 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63"} err="failed to get container status \"c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63\": rpc error: code = NotFound desc = could not find container \"c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63\": container with ID starting with c2feafcdd0b44c3d8730ad5e6adb565d449fe6a4d54561ecd827282da208fe63 not found: ID does not exist" Jul 28 10:12:10.272539 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:10.272516 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88787dc4-j42kt"] Jul 28 10:12:10.276036 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:10.276016 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-88787dc4-j42kt"] Jul 28 10:12:11.095913 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:11.095878 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d1e0fa5-0ce6-4fca-9234-09a24699b408" path="/var/lib/kubelet/pods/2d1e0fa5-0ce6-4fca-9234-09a24699b408/volumes" Jul 28 10:12:18.903510 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:18.903481 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:12:18.909576 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:18.909549 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:12:18.909706 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:18.909668 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 10:12:55.567216 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:55.567181 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:56.886488 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:56.886453 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:57.127412 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.127384 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj"] Jul 28 10:12:57.127661 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.127649 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1e0fa5-0ce6-4fca-9234-09a24699b408" containerName="console" Jul 28 10:12:57.127705 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.127663 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1e0fa5-0ce6-4fca-9234-09a24699b408" containerName="console" Jul 28 10:12:57.127738 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.127713 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d1e0fa5-0ce6-4fca-9234-09a24699b408" containerName="console" Jul 28 10:12:57.130657 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.130641 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:12:57.136248 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.136228 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 10:12:57.137161 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.137112 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c4xf4\"" Jul 28 10:12:57.137161 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.137148 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 10:12:57.142516 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.142487 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj"] Jul 28 10:12:57.233808 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.233782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f79f038f-565b-4894-91af-d98b3bef8012-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj\" (UID: \"f79f038f-565b-4894-91af-d98b3bef8012\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:12:57.233929 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.233829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2r52\" (UniqueName: \"kubernetes.io/projected/f79f038f-565b-4894-91af-d98b3bef8012-kube-api-access-p2r52\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj\" (UID: \"f79f038f-565b-4894-91af-d98b3bef8012\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:12:57.233929 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.233874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f79f038f-565b-4894-91af-d98b3bef8012-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj\" (UID: \"f79f038f-565b-4894-91af-d98b3bef8012\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:12:57.335203 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.335172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f79f038f-565b-4894-91af-d98b3bef8012-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj\" (UID: \"f79f038f-565b-4894-91af-d98b3bef8012\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:12:57.335325 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.335222 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f79f038f-565b-4894-91af-d98b3bef8012-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj\" (UID: \"f79f038f-565b-4894-91af-d98b3bef8012\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:12:57.335325 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.335269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2r52\" (UniqueName: \"kubernetes.io/projected/f79f038f-565b-4894-91af-d98b3bef8012-kube-api-access-p2r52\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj\" (UID: \"f79f038f-565b-4894-91af-d98b3bef8012\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:12:57.335539 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.335521 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f79f038f-565b-4894-91af-d98b3bef8012-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj\" (UID: \"f79f038f-565b-4894-91af-d98b3bef8012\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:12:57.335574 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.335554 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f79f038f-565b-4894-91af-d98b3bef8012-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj\" (UID: \"f79f038f-565b-4894-91af-d98b3bef8012\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:12:57.346666 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.346643 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2r52\" (UniqueName: \"kubernetes.io/projected/f79f038f-565b-4894-91af-d98b3bef8012-kube-api-access-p2r52\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj\" (UID: \"f79f038f-565b-4894-91af-d98b3bef8012\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:12:57.438643 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.438588 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:12:57.558714 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.558688 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj"] Jul 28 10:12:57.560350 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:12:57.560324 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf79f038f_565b_4894_91af_d98b3bef8012.slice/crio-466cb13d099587d7a697c08eede18f1060f739335c2111b05e914c2bc18c0716 WatchSource:0}: Error finding container 466cb13d099587d7a697c08eede18f1060f739335c2111b05e914c2bc18c0716: Status 404 returned error can't find the container with id 466cb13d099587d7a697c08eede18f1060f739335c2111b05e914c2bc18c0716 Jul 28 10:12:57.562403 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:57.562385 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 10:12:58.422489 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:12:58.422448 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" event={"ID":"f79f038f-565b-4894-91af-d98b3bef8012","Type":"ContainerStarted","Data":"466cb13d099587d7a697c08eede18f1060f739335c2111b05e914c2bc18c0716"} Jul 28 10:13:04.448134 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:04.448101 2581 generic.go:356] "Generic (PLEG): container finished" podID="f79f038f-565b-4894-91af-d98b3bef8012" containerID="554627f54d242d2186502b2939ae0851d9661e5d92c2c46f25d436709a3a7985" exitCode=0 Jul 28 10:13:04.448451 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:04.448181 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" event={"ID":"f79f038f-565b-4894-91af-d98b3bef8012","Type":"ContainerDied","Data":"554627f54d242d2186502b2939ae0851d9661e5d92c2c46f25d436709a3a7985"} Jul 28 10:13:07.460592 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:07.460538 2581 generic.go:356] "Generic (PLEG): container finished" podID="f79f038f-565b-4894-91af-d98b3bef8012" containerID="734b2626a0e7203682855cf7a02eef3e26c943c1b09fbb1195f500af9cfedfa8" exitCode=0 Jul 28 10:13:07.460961 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:07.460620 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" event={"ID":"f79f038f-565b-4894-91af-d98b3bef8012","Type":"ContainerDied","Data":"734b2626a0e7203682855cf7a02eef3e26c943c1b09fbb1195f500af9cfedfa8"} Jul 28 10:13:15.495752 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:15.495714 2581 generic.go:356] "Generic (PLEG): container finished" podID="f79f038f-565b-4894-91af-d98b3bef8012" containerID="f1618084efea6f5a4336667d01e624a765e3f32c0010a2027ccf55ebeb665c83" exitCode=0 Jul 28 10:13:15.496144 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:15.495801 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" event={"ID":"f79f038f-565b-4894-91af-d98b3bef8012","Type":"ContainerDied","Data":"f1618084efea6f5a4336667d01e624a765e3f32c0010a2027ccf55ebeb665c83"} Jul 28 10:13:16.626312 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:16.626289 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:13:16.692001 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:16.691978 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f79f038f-565b-4894-91af-d98b3bef8012-util\") pod \"f79f038f-565b-4894-91af-d98b3bef8012\" (UID: \"f79f038f-565b-4894-91af-d98b3bef8012\") " Jul 28 10:13:16.692157 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:16.692014 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2r52\" (UniqueName: \"kubernetes.io/projected/f79f038f-565b-4894-91af-d98b3bef8012-kube-api-access-p2r52\") pod \"f79f038f-565b-4894-91af-d98b3bef8012\" (UID: \"f79f038f-565b-4894-91af-d98b3bef8012\") " Jul 28 10:13:16.692157 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:16.692052 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f79f038f-565b-4894-91af-d98b3bef8012-bundle\") pod \"f79f038f-565b-4894-91af-d98b3bef8012\" (UID: \"f79f038f-565b-4894-91af-d98b3bef8012\") " Jul 28 10:13:16.692639 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:16.692611 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f79f038f-565b-4894-91af-d98b3bef8012-bundle" (OuterVolumeSpecName: "bundle") pod "f79f038f-565b-4894-91af-d98b3bef8012" (UID: "f79f038f-565b-4894-91af-d98b3bef8012"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:13:16.694051 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:16.694031 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f79f038f-565b-4894-91af-d98b3bef8012-kube-api-access-p2r52" (OuterVolumeSpecName: "kube-api-access-p2r52") pod "f79f038f-565b-4894-91af-d98b3bef8012" (UID: "f79f038f-565b-4894-91af-d98b3bef8012"). InnerVolumeSpecName "kube-api-access-p2r52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:13:16.696180 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:16.696160 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f79f038f-565b-4894-91af-d98b3bef8012-util" (OuterVolumeSpecName: "util") pod "f79f038f-565b-4894-91af-d98b3bef8012" (UID: "f79f038f-565b-4894-91af-d98b3bef8012"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:13:16.793564 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:16.793512 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f79f038f-565b-4894-91af-d98b3bef8012-bundle\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:13:16.793564 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:16.793534 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f79f038f-565b-4894-91af-d98b3bef8012-util\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:13:16.793564 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:16.793545 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2r52\" (UniqueName: \"kubernetes.io/projected/f79f038f-565b-4894-91af-d98b3bef8012-kube-api-access-p2r52\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:13:17.504434 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:17.504363 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" Jul 28 10:13:17.504567 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:17.504359 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5k4hbj" event={"ID":"f79f038f-565b-4894-91af-d98b3bef8012","Type":"ContainerDied","Data":"466cb13d099587d7a697c08eede18f1060f739335c2111b05e914c2bc18c0716"} Jul 28 10:13:17.504567 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:17.504476 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="466cb13d099587d7a697c08eede18f1060f739335c2111b05e914c2bc18c0716" Jul 28 10:13:18.242653 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:18.242617 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:18.336404 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:18.336381 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:19.953361 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.953328 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277"] Jul 28 10:13:19.953725 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.953618 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f79f038f-565b-4894-91af-d98b3bef8012" containerName="pull" Jul 28 10:13:19.953725 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.953631 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f79f038f-565b-4894-91af-d98b3bef8012" containerName="pull" Jul 28 10:13:19.953725 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.953644 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f79f038f-565b-4894-91af-d98b3bef8012" containerName="util" Jul 28 10:13:19.953725 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.953649 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f79f038f-565b-4894-91af-d98b3bef8012" containerName="util" Jul 28 10:13:19.953725 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.953667 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f79f038f-565b-4894-91af-d98b3bef8012" containerName="extract" Jul 28 10:13:19.953725 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.953673 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f79f038f-565b-4894-91af-d98b3bef8012" containerName="extract" Jul 28 10:13:19.953725 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.953714 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f79f038f-565b-4894-91af-d98b3bef8012" containerName="extract" Jul 28 10:13:19.991574 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.991542 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277"] Jul 28 10:13:19.991725 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.991649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" Jul 28 10:13:19.994962 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.994941 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 28 10:13:19.994962 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.994954 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-98gkp\"" Jul 28 10:13:19.995139 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.995043 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 28 10:13:19.995139 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:19.995048 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 28 10:13:20.119241 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:20.119210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/cd114c8b-5fc3-4bab-84d1-6d35dbff8a42-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-5c277\" (UID: \"cd114c8b-5fc3-4bab-84d1-6d35dbff8a42\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" Jul 28 10:13:20.119439 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:20.119299 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfmh2\" (UniqueName: \"kubernetes.io/projected/cd114c8b-5fc3-4bab-84d1-6d35dbff8a42-kube-api-access-qfmh2\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-5c277\" (UID: \"cd114c8b-5fc3-4bab-84d1-6d35dbff8a42\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" Jul 28 10:13:20.219946 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:20.219883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmh2\" (UniqueName: \"kubernetes.io/projected/cd114c8b-5fc3-4bab-84d1-6d35dbff8a42-kube-api-access-qfmh2\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-5c277\" (UID: \"cd114c8b-5fc3-4bab-84d1-6d35dbff8a42\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" Jul 28 10:13:20.219946 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:20.219922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/cd114c8b-5fc3-4bab-84d1-6d35dbff8a42-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-5c277\" (UID: \"cd114c8b-5fc3-4bab-84d1-6d35dbff8a42\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" Jul 28 10:13:20.222203 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:20.222180 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/cd114c8b-5fc3-4bab-84d1-6d35dbff8a42-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-5c277\" (UID: \"cd114c8b-5fc3-4bab-84d1-6d35dbff8a42\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" Jul 28 10:13:20.228526 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:20.228502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfmh2\" (UniqueName: \"kubernetes.io/projected/cd114c8b-5fc3-4bab-84d1-6d35dbff8a42-kube-api-access-qfmh2\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-5c277\" (UID: \"cd114c8b-5fc3-4bab-84d1-6d35dbff8a42\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" Jul 28 10:13:20.301948 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:20.301925 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" Jul 28 10:13:20.449030 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:20.449001 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277"] Jul 28 10:13:20.451699 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:13:20.451671 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd114c8b_5fc3_4bab_84d1_6d35dbff8a42.slice/crio-42c00736b7b67265b310217651ebb63d903f21ddabacd0062e2eb1c985dc45f6 WatchSource:0}: Error finding container 42c00736b7b67265b310217651ebb63d903f21ddabacd0062e2eb1c985dc45f6: Status 404 returned error can't find the container with id 42c00736b7b67265b310217651ebb63d903f21ddabacd0062e2eb1c985dc45f6 Jul 28 10:13:20.516501 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:20.516436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" event={"ID":"cd114c8b-5fc3-4bab-84d1-6d35dbff8a42","Type":"ContainerStarted","Data":"42c00736b7b67265b310217651ebb63d903f21ddabacd0062e2eb1c985dc45f6"} Jul 28 10:13:24.160942 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.160907 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:24.463887 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.463801 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:24.473119 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.473097 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-b2b8n"] Jul 28 10:13:24.475424 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.475407 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:24.477939 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.477918 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 28 10:13:24.478012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.477945 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-lkj74\"" Jul 28 10:13:24.478012 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.477918 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 28 10:13:24.486858 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.486837 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-b2b8n"] Jul 28 10:13:24.534195 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.534168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" event={"ID":"cd114c8b-5fc3-4bab-84d1-6d35dbff8a42","Type":"ContainerStarted","Data":"61579d78a9cfbe9ca643c6526f887f00e397961abfbdae581b9a7afdfdae02df"} Jul 28 10:13:24.534391 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.534371 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" Jul 28 10:13:24.554052 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.554008 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" podStartSLOduration=2.290117962 podStartE2EDuration="5.553993846s" totalImagesPullingTime="3.263875884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:13:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:13:24.551899546 +0000 UTC m=+366.030881341" watchObservedRunningTime="2026-07-28 10:13:24.553993846 +0000 UTC m=+366.032975640" Jul 28 10:13:24.556959 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.556934 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krc8v\" (UniqueName: \"kubernetes.io/projected/7baa1604-0b4a-40cd-ba2c-083731e17ec2-kube-api-access-krc8v\") pod \"keda-operator-77f648d694-b2b8n\" (UID: \"7baa1604-0b4a-40cd-ba2c-083731e17ec2\") " pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:24.557034 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.556977 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/7baa1604-0b4a-40cd-ba2c-083731e17ec2-cabundle0\") pod \"keda-operator-77f648d694-b2b8n\" (UID: \"7baa1604-0b4a-40cd-ba2c-083731e17ec2\") " pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:24.557034 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.557017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7baa1604-0b4a-40cd-ba2c-083731e17ec2-certificates\") pod \"keda-operator-77f648d694-b2b8n\" (UID: \"7baa1604-0b4a-40cd-ba2c-083731e17ec2\") " pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:24.610369 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.610341 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:24.657538 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.657517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krc8v\" (UniqueName: \"kubernetes.io/projected/7baa1604-0b4a-40cd-ba2c-083731e17ec2-kube-api-access-krc8v\") pod \"keda-operator-77f648d694-b2b8n\" (UID: \"7baa1604-0b4a-40cd-ba2c-083731e17ec2\") " pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:24.657639 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.657546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/7baa1604-0b4a-40cd-ba2c-083731e17ec2-cabundle0\") pod \"keda-operator-77f648d694-b2b8n\" (UID: \"7baa1604-0b4a-40cd-ba2c-083731e17ec2\") " pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:24.657722 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.657693 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7baa1604-0b4a-40cd-ba2c-083731e17ec2-certificates\") pod \"keda-operator-77f648d694-b2b8n\" (UID: \"7baa1604-0b4a-40cd-ba2c-083731e17ec2\") " pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:24.657880 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:13:24.657866 2581 secret.go:281] references non-existent secret key: ca.crt Jul 28 10:13:24.657930 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:13:24.657886 2581 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 28 10:13:24.657930 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:13:24.657897 2581 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-b2b8n: references non-existent secret key: ca.crt Jul 28 10:13:24.658026 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:13:24.657953 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7baa1604-0b4a-40cd-ba2c-083731e17ec2-certificates podName:7baa1604-0b4a-40cd-ba2c-083731e17ec2 nodeName:}" failed. No retries permitted until 2026-07-28 10:13:25.157935607 +0000 UTC m=+366.636917385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/7baa1604-0b4a-40cd-ba2c-083731e17ec2-certificates") pod "keda-operator-77f648d694-b2b8n" (UID: "7baa1604-0b4a-40cd-ba2c-083731e17ec2") : references non-existent secret key: ca.crt Jul 28 10:13:24.658306 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.658285 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/7baa1604-0b4a-40cd-ba2c-083731e17ec2-cabundle0\") pod \"keda-operator-77f648d694-b2b8n\" (UID: \"7baa1604-0b4a-40cd-ba2c-083731e17ec2\") " pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:24.668215 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.668195 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krc8v\" (UniqueName: \"kubernetes.io/projected/7baa1604-0b4a-40cd-ba2c-083731e17ec2-kube-api-access-krc8v\") pod \"keda-operator-77f648d694-b2b8n\" (UID: \"7baa1604-0b4a-40cd-ba2c-083731e17ec2\") " pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:24.894852 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.894822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:24.998652 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:24.998622 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx"] Jul 28 10:13:25.000698 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.000681 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:25.004129 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.004111 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 28 10:13:25.013865 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.013842 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx"] Jul 28 10:13:25.057140 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.057112 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:25.161507 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.161437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/99621873-d9bf-4ebb-aeac-66d446332f3b-certificates\") pod \"keda-metrics-apiserver-55557df8c-zt9zx\" (UID: \"99621873-d9bf-4ebb-aeac-66d446332f3b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:25.161507 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.161465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/99621873-d9bf-4ebb-aeac-66d446332f3b-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-zt9zx\" (UID: \"99621873-d9bf-4ebb-aeac-66d446332f3b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:25.161507 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.161508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7baa1604-0b4a-40cd-ba2c-083731e17ec2-certificates\") pod \"keda-operator-77f648d694-b2b8n\" (UID: \"7baa1604-0b4a-40cd-ba2c-083731e17ec2\") " pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:25.161932 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.161600 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbjx2\" (UniqueName: \"kubernetes.io/projected/99621873-d9bf-4ebb-aeac-66d446332f3b-kube-api-access-xbjx2\") pod \"keda-metrics-apiserver-55557df8c-zt9zx\" (UID: \"99621873-d9bf-4ebb-aeac-66d446332f3b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:25.164196 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.164175 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7baa1604-0b4a-40cd-ba2c-083731e17ec2-certificates\") pod \"keda-operator-77f648d694-b2b8n\" (UID: \"7baa1604-0b4a-40cd-ba2c-083731e17ec2\") " pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:25.214100 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.214058 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:25.221301 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.221269 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-w5mrj"] Jul 28 10:13:25.223457 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.223440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" Jul 28 10:13:25.226174 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.226154 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 28 10:13:25.236123 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.236095 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-w5mrj"] Jul 28 10:13:25.262927 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.262902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbjx2\" (UniqueName: \"kubernetes.io/projected/99621873-d9bf-4ebb-aeac-66d446332f3b-kube-api-access-xbjx2\") pod \"keda-metrics-apiserver-55557df8c-zt9zx\" (UID: \"99621873-d9bf-4ebb-aeac-66d446332f3b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:25.263039 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.262938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/99621873-d9bf-4ebb-aeac-66d446332f3b-certificates\") pod \"keda-metrics-apiserver-55557df8c-zt9zx\" (UID: \"99621873-d9bf-4ebb-aeac-66d446332f3b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:25.263039 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.262955 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/99621873-d9bf-4ebb-aeac-66d446332f3b-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-zt9zx\" (UID: \"99621873-d9bf-4ebb-aeac-66d446332f3b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:25.263278 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.263260 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/99621873-d9bf-4ebb-aeac-66d446332f3b-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-zt9zx\" (UID: \"99621873-d9bf-4ebb-aeac-66d446332f3b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:25.265411 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.265383 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/99621873-d9bf-4ebb-aeac-66d446332f3b-certificates\") pod \"keda-metrics-apiserver-55557df8c-zt9zx\" (UID: \"99621873-d9bf-4ebb-aeac-66d446332f3b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:25.272707 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.272683 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbjx2\" (UniqueName: \"kubernetes.io/projected/99621873-d9bf-4ebb-aeac-66d446332f3b-kube-api-access-xbjx2\") pod \"keda-metrics-apiserver-55557df8c-zt9zx\" (UID: \"99621873-d9bf-4ebb-aeac-66d446332f3b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:25.305895 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.305868 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:25.310851 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.310831 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:25.363544 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.363515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a131f0e7-abff-4603-a751-b72de15cb37a-certificates\") pod \"keda-admission-56f9798bb4-w5mrj\" (UID: \"a131f0e7-abff-4603-a751-b72de15cb37a\") " pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" Jul 28 10:13:25.363647 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.363566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx65t\" (UniqueName: \"kubernetes.io/projected/a131f0e7-abff-4603-a751-b72de15cb37a-kube-api-access-wx65t\") pod \"keda-admission-56f9798bb4-w5mrj\" (UID: \"a131f0e7-abff-4603-a751-b72de15cb37a\") " pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" Jul 28 10:13:25.385864 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.385837 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:25.407434 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.407404 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:25.439619 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.439592 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx"] Jul 28 10:13:25.441086 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:13:25.441029 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99621873_d9bf_4ebb_aeac_66d446332f3b.slice/crio-fa2aadc09960829bf7fbb47d18aa2f0164b6d3c5b108687bde53ad9bd95b018b WatchSource:0}: Error finding container fa2aadc09960829bf7fbb47d18aa2f0164b6d3c5b108687bde53ad9bd95b018b: Status 404 returned error can't find the container with id fa2aadc09960829bf7fbb47d18aa2f0164b6d3c5b108687bde53ad9bd95b018b Jul 28 10:13:25.464561 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.464531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a131f0e7-abff-4603-a751-b72de15cb37a-certificates\") pod \"keda-admission-56f9798bb4-w5mrj\" (UID: \"a131f0e7-abff-4603-a751-b72de15cb37a\") " pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" Jul 28 10:13:25.464694 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.464584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx65t\" (UniqueName: \"kubernetes.io/projected/a131f0e7-abff-4603-a751-b72de15cb37a-kube-api-access-wx65t\") pod \"keda-admission-56f9798bb4-w5mrj\" (UID: \"a131f0e7-abff-4603-a751-b72de15cb37a\") " pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" Jul 28 10:13:25.467192 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.467165 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a131f0e7-abff-4603-a751-b72de15cb37a-certificates\") pod \"keda-admission-56f9798bb4-w5mrj\" (UID: \"a131f0e7-abff-4603-a751-b72de15cb37a\") " pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" Jul 28 10:13:25.473238 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.473208 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx65t\" (UniqueName: \"kubernetes.io/projected/a131f0e7-abff-4603-a751-b72de15cb37a-kube-api-access-wx65t\") pod \"keda-admission-56f9798bb4-w5mrj\" (UID: \"a131f0e7-abff-4603-a751-b72de15cb37a\") " pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" Jul 28 10:13:25.508027 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.507991 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:25.516616 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.516579 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-b2b8n"] Jul 28 10:13:25.518389 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:13:25.518369 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7baa1604_0b4a_40cd_ba2c_083731e17ec2.slice/crio-7cd93b5ed622395b131860625810962e503d639ade59d4c6a5f451a2750968f4 WatchSource:0}: Error finding container 7cd93b5ed622395b131860625810962e503d639ade59d4c6a5f451a2750968f4: Status 404 returned error can't find the container with id 7cd93b5ed622395b131860625810962e503d639ade59d4c6a5f451a2750968f4 Jul 28 10:13:25.533215 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.533196 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" Jul 28 10:13:25.538937 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.538916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-b2b8n" event={"ID":"7baa1604-0b4a-40cd-ba2c-083731e17ec2","Type":"ContainerStarted","Data":"7cd93b5ed622395b131860625810962e503d639ade59d4c6a5f451a2750968f4"} Jul 28 10:13:25.540007 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.539983 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" event={"ID":"99621873-d9bf-4ebb-aeac-66d446332f3b","Type":"ContainerStarted","Data":"fa2aadc09960829bf7fbb47d18aa2f0164b6d3c5b108687bde53ad9bd95b018b"} Jul 28 10:13:25.654161 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.654126 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-w5mrj"] Jul 28 10:13:25.656245 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:13:25.656222 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda131f0e7_abff_4603_a751_b72de15cb37a.slice/crio-b1cb4f3fee1ba81e468e96da3be483821e1d8cc18f259affd41893b6f8d44879 WatchSource:0}: Error finding container b1cb4f3fee1ba81e468e96da3be483821e1d8cc18f259affd41893b6f8d44879: Status 404 returned error can't find the container with id b1cb4f3fee1ba81e468e96da3be483821e1d8cc18f259affd41893b6f8d44879 Jul 28 10:13:25.706289 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.706229 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:25.915676 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:25.915644 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:26.010946 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:26.010873 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:26.548483 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:26.548401 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" event={"ID":"a131f0e7-abff-4603-a751-b72de15cb37a","Type":"ContainerStarted","Data":"b1cb4f3fee1ba81e468e96da3be483821e1d8cc18f259affd41893b6f8d44879"} Jul 28 10:13:27.554934 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:27.554865 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" event={"ID":"a131f0e7-abff-4603-a751-b72de15cb37a","Type":"ContainerStarted","Data":"6c70a2aeaafec34cece311729f9f8df749f8c1a481a2cbb769fc27705d9faa0d"} Jul 28 10:13:27.555376 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:27.554991 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" Jul 28 10:13:27.571890 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:27.571827 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" podStartSLOduration=1.049900573 podStartE2EDuration="2.571806585s" totalImagesPullingTime="1.521906012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:13:27.57022651 +0000 UTC m=+369.049208307" watchObservedRunningTime="2026-07-28 10:13:27.571806585 +0000 UTC m=+369.050788387" Jul 28 10:13:29.566925 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:29.566825 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-b2b8n" event={"ID":"7baa1604-0b4a-40cd-ba2c-083731e17ec2","Type":"ContainerStarted","Data":"621632666be9b17c74f3ccc2182597f79cc1fd8222294ce05c25a519b4d4d68f"} Jul 28 10:13:29.567515 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:29.566989 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:13:29.568323 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:29.568290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" event={"ID":"99621873-d9bf-4ebb-aeac-66d446332f3b","Type":"ContainerStarted","Data":"4aa87e509cfef8f1a3897309b257e85f1ad50f8950efe42b7dfa3e94e8704970"} Jul 28 10:13:29.568418 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:29.568409 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:29.585080 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:29.585029 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-b2b8n" podStartSLOduration=1.919440581 podStartE2EDuration="5.585015929s" totalImagesPullingTime="3.665575348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:13:29.583800633 +0000 UTC m=+371.062782427" watchObservedRunningTime="2026-07-28 10:13:29.585015929 +0000 UTC m=+371.063997723" Jul 28 10:13:29.602379 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:29.602342 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" podStartSLOduration=1.864059634 podStartE2EDuration="5.602329543s" totalImagesPullingTime="3.738269909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:13:29.601845812 +0000 UTC m=+371.080827608" watchObservedRunningTime="2026-07-28 10:13:29.602329543 +0000 UTC m=+371.081311338" Jul 28 10:13:40.577618 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:40.577582 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-zt9zx" Jul 28 10:13:45.542419 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:45.542389 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-5c277" Jul 28 10:13:48.563827 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:48.563798 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-w5mrj" Jul 28 10:13:50.576082 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:13:50.576041 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-b2b8n" Jul 28 10:14:59.433910 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.433838 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:14:59.454430 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.454405 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6968749498-smdm4"] Jul 28 10:14:59.456736 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.456703 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6968749498-smdm4" Jul 28 10:14:59.460155 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.460130 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-d9lxr"] Jul 28 10:14:59.460815 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.460794 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 28 10:14:59.462516 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.461208 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-rm97b\"" Jul 28 10:14:59.462516 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.461724 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 28 10:14:59.462516 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.462007 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 28 10:14:59.464056 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.464039 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" Jul 28 10:14:59.466450 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.466431 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-xbn75\"" Jul 28 10:14:59.466450 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.466444 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 28 10:14:59.467559 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.467541 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7fzl\" (UniqueName: \"kubernetes.io/projected/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f-kube-api-access-v7fzl\") pod \"kserve-controller-manager-6968749498-smdm4\" (UID: \"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f\") " pod="kserve/kserve-controller-manager-6968749498-smdm4" Jul 28 10:14:59.467631 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.467596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f-cert\") pod \"kserve-controller-manager-6968749498-smdm4\" (UID: \"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f\") " pod="kserve/kserve-controller-manager-6968749498-smdm4" Jul 28 10:14:59.471185 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.471164 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6968749498-smdm4"] Jul 28 10:14:59.473148 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.473108 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-d9lxr"] Jul 28 10:14:59.528557 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.528532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:14:59.568555 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.568531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ktmm\" (UniqueName: \"kubernetes.io/projected/45608ce3-8940-40e6-8253-eaf58049deb8-kube-api-access-8ktmm\") pod \"llmisvc-controller-manager-654c557856-d9lxr\" (UID: \"45608ce3-8940-40e6-8253-eaf58049deb8\") " pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" Jul 28 10:14:59.568642 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.568566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45608ce3-8940-40e6-8253-eaf58049deb8-cert\") pod \"llmisvc-controller-manager-654c557856-d9lxr\" (UID: \"45608ce3-8940-40e6-8253-eaf58049deb8\") " pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" Jul 28 10:14:59.568642 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.568607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f-cert\") pod \"kserve-controller-manager-6968749498-smdm4\" (UID: \"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f\") " pod="kserve/kserve-controller-manager-6968749498-smdm4" Jul 28 10:14:59.568715 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.568640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7fzl\" (UniqueName: \"kubernetes.io/projected/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f-kube-api-access-v7fzl\") pod \"kserve-controller-manager-6968749498-smdm4\" (UID: \"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f\") " pod="kserve/kserve-controller-manager-6968749498-smdm4" Jul 28 10:14:59.570987 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.570961 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f-cert\") pod \"kserve-controller-manager-6968749498-smdm4\" (UID: \"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f\") " pod="kserve/kserve-controller-manager-6968749498-smdm4" Jul 28 10:14:59.579718 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.579699 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7fzl\" (UniqueName: \"kubernetes.io/projected/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f-kube-api-access-v7fzl\") pod \"kserve-controller-manager-6968749498-smdm4\" (UID: \"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f\") " pod="kserve/kserve-controller-manager-6968749498-smdm4" Jul 28 10:14:59.633316 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.633295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:14:59.668980 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.668957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ktmm\" (UniqueName: \"kubernetes.io/projected/45608ce3-8940-40e6-8253-eaf58049deb8-kube-api-access-8ktmm\") pod \"llmisvc-controller-manager-654c557856-d9lxr\" (UID: \"45608ce3-8940-40e6-8253-eaf58049deb8\") " pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" Jul 28 10:14:59.669106 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.668990 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45608ce3-8940-40e6-8253-eaf58049deb8-cert\") pod \"llmisvc-controller-manager-654c557856-d9lxr\" (UID: \"45608ce3-8940-40e6-8253-eaf58049deb8\") " pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" Jul 28 10:14:59.671194 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.671175 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45608ce3-8940-40e6-8253-eaf58049deb8-cert\") pod \"llmisvc-controller-manager-654c557856-d9lxr\" (UID: \"45608ce3-8940-40e6-8253-eaf58049deb8\") " pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" Jul 28 10:14:59.677903 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.677885 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ktmm\" (UniqueName: \"kubernetes.io/projected/45608ce3-8940-40e6-8253-eaf58049deb8-kube-api-access-8ktmm\") pod \"llmisvc-controller-manager-654c557856-d9lxr\" (UID: \"45608ce3-8940-40e6-8253-eaf58049deb8\") " pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" Jul 28 10:14:59.730223 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.730166 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:14:59.770434 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.770413 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6968749498-smdm4" Jul 28 10:14:59.778168 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.778152 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" Jul 28 10:14:59.907903 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.907882 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6968749498-smdm4"] Jul 28 10:14:59.909688 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:14:59.909655 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65c9e97_96b5_4464_a88c_2eaccbb8ba2f.slice/crio-dd9c5603ec087f1cd18c4543f44779cc3b88be6c2f1752fda63ea194d1ee7b0b WatchSource:0}: Error finding container dd9c5603ec087f1cd18c4543f44779cc3b88be6c2f1752fda63ea194d1ee7b0b: Status 404 returned error can't find the container with id dd9c5603ec087f1cd18c4543f44779cc3b88be6c2f1752fda63ea194d1ee7b0b Jul 28 10:14:59.923919 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.923902 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-d9lxr"] Jul 28 10:14:59.925457 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:14:59.925433 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod45608ce3_8940_40e6_8253_eaf58049deb8.slice/crio-609bac1e20005d235bffaeba905d58e7670e159cdd38d36066495ca78fb5d9c7 WatchSource:0}: Error finding container 609bac1e20005d235bffaeba905d58e7670e159cdd38d36066495ca78fb5d9c7: Status 404 returned error can't find the container with id 609bac1e20005d235bffaeba905d58e7670e159cdd38d36066495ca78fb5d9c7 Jul 28 10:14:59.928624 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:14:59.928597 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6968749498-smdm4" event={"ID":"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f","Type":"ContainerStarted","Data":"dd9c5603ec087f1cd18c4543f44779cc3b88be6c2f1752fda63ea194d1ee7b0b"} Jul 28 10:15:00.025011 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:00.024948 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:00.131542 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:00.131514 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:00.936965 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:00.936891 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" event={"ID":"45608ce3-8940-40e6-8253-eaf58049deb8","Type":"ContainerStarted","Data":"609bac1e20005d235bffaeba905d58e7670e159cdd38d36066495ca78fb5d9c7"} Jul 28 10:15:03.128053 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:03.128015 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:03.953114 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:03.953061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" event={"ID":"45608ce3-8940-40e6-8253-eaf58049deb8","Type":"ContainerStarted","Data":"8f3e6e3682ee402410f225932486351d63085275878011afc5d8710abea903fc"} Jul 28 10:15:03.953312 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:03.953163 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" Jul 28 10:15:03.954887 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:03.954858 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6968749498-smdm4" event={"ID":"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f","Type":"ContainerStarted","Data":"4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb"} Jul 28 10:15:03.954994 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:03.954952 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6968749498-smdm4" Jul 28 10:15:03.972238 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:03.972190 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" podStartSLOduration=1.397394768 podStartE2EDuration="4.972177299s" totalImagesPullingTime="3.574782531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:15:03.970807111 +0000 UTC m=+465.449788909" watchObservedRunningTime="2026-07-28 10:15:03.972177299 +0000 UTC m=+465.451159094" Jul 28 10:15:03.991563 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:03.991522 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6968749498-smdm4" podStartSLOduration=1.401110696 podStartE2EDuration="4.991508967s" totalImagesPullingTime="3.590398271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:15:03.991341214 +0000 UTC m=+465.470323009" watchObservedRunningTime="2026-07-28 10:15:03.991508967 +0000 UTC m=+465.470490762" Jul 28 10:15:09.247937 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.247905 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b4978674d-sd9fk"] Jul 28 10:15:09.251287 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.251269 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.274990 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.274965 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4978674d-sd9fk"] Jul 28 10:15:09.343205 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.343178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:09.345267 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.345243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7235b0c-8f98-4c8a-b980-4c46006514a7-service-ca\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.345363 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.345276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7235b0c-8f98-4c8a-b980-4c46006514a7-console-oauth-config\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.345363 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.345298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7235b0c-8f98-4c8a-b980-4c46006514a7-trusted-ca-bundle\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.345437 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.345388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7235b0c-8f98-4c8a-b980-4c46006514a7-oauth-serving-cert\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.345471 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.345456 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8hss\" (UniqueName: \"kubernetes.io/projected/d7235b0c-8f98-4c8a-b980-4c46006514a7-kube-api-access-z8hss\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.345503 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.345479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7235b0c-8f98-4c8a-b980-4c46006514a7-console-serving-cert\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.345503 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.345496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7235b0c-8f98-4c8a-b980-4c46006514a7-console-config\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.424643 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.424618 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:09.445850 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.445828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7235b0c-8f98-4c8a-b980-4c46006514a7-oauth-serving-cert\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.445931 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.445876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8hss\" (UniqueName: \"kubernetes.io/projected/d7235b0c-8f98-4c8a-b980-4c46006514a7-kube-api-access-z8hss\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.445931 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.445904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7235b0c-8f98-4c8a-b980-4c46006514a7-console-serving-cert\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.446014 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.445929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7235b0c-8f98-4c8a-b980-4c46006514a7-console-config\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.446014 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.445961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7235b0c-8f98-4c8a-b980-4c46006514a7-service-ca\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.446014 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.445987 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7235b0c-8f98-4c8a-b980-4c46006514a7-console-oauth-config\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.446201 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.446017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7235b0c-8f98-4c8a-b980-4c46006514a7-trusted-ca-bundle\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.446785 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.446761 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7235b0c-8f98-4c8a-b980-4c46006514a7-oauth-serving-cert\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.446876 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.446783 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7235b0c-8f98-4c8a-b980-4c46006514a7-service-ca\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.446876 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.446796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7235b0c-8f98-4c8a-b980-4c46006514a7-console-config\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.446995 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.446947 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7235b0c-8f98-4c8a-b980-4c46006514a7-trusted-ca-bundle\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.448416 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.448393 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7235b0c-8f98-4c8a-b980-4c46006514a7-console-oauth-config\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.448567 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.448550 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7235b0c-8f98-4c8a-b980-4c46006514a7-console-serving-cert\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.456996 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.456978 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8hss\" (UniqueName: \"kubernetes.io/projected/d7235b0c-8f98-4c8a-b980-4c46006514a7-kube-api-access-z8hss\") pod \"console-b4978674d-sd9fk\" (UID: \"d7235b0c-8f98-4c8a-b980-4c46006514a7\") " pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.560218 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.560166 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:09.692558 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.692468 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4978674d-sd9fk"] Jul 28 10:15:09.695105 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:15:09.695061 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7235b0c_8f98_4c8a_b980_4c46006514a7.slice/crio-a98a64ac05c5e06482d19121496ec11b0a84a6a0a6c5fde074e1d9c8f3d974b1 WatchSource:0}: Error finding container a98a64ac05c5e06482d19121496ec11b0a84a6a0a6c5fde074e1d9c8f3d974b1: Status 404 returned error can't find the container with id a98a64ac05c5e06482d19121496ec11b0a84a6a0a6c5fde074e1d9c8f3d974b1 Jul 28 10:15:09.982094 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.982051 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4978674d-sd9fk" event={"ID":"d7235b0c-8f98-4c8a-b980-4c46006514a7","Type":"ContainerStarted","Data":"70f85a20ddcb869e318ad2dbd6650b33cf54cc40ab0959ac11354ed1e28ed97c"} Jul 28 10:15:09.982260 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:09.982112 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4978674d-sd9fk" event={"ID":"d7235b0c-8f98-4c8a-b980-4c46006514a7","Type":"ContainerStarted","Data":"a98a64ac05c5e06482d19121496ec11b0a84a6a0a6c5fde074e1d9c8f3d974b1"} Jul 28 10:15:10.033916 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:10.033865 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b4978674d-sd9fk" podStartSLOduration=1.033849925 podStartE2EDuration="1.033849925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:15:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:15:10.032870707 +0000 UTC m=+471.511852503" watchObservedRunningTime="2026-07-28 10:15:10.033849925 +0000 UTC m=+471.512831787" Jul 28 10:15:19.560502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:19.560466 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:19.560962 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:19.560522 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:19.565123 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:19.565102 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:20.025612 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:20.025585 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b4978674d-sd9fk" Jul 28 10:15:20.074524 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:20.074492 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-667858cbfb-5z9jm"] Jul 28 10:15:20.185957 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:20.185922 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:20.285926 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:20.285864 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:20.387210 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:20.387186 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:34.962677 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:34.962642 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-d9lxr" Jul 28 10:15:34.965685 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:34.965665 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6968749498-smdm4" Jul 28 10:15:42.487162 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.487129 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6968749498-smdm4"] Jul 28 10:15:42.487590 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.487312 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-6968749498-smdm4" podUID="b65c9e97-96b5-4464-a88c-2eaccbb8ba2f" containerName="manager" containerID="cri-o://4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb" gracePeriod=10 Jul 28 10:15:42.510215 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.510190 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6968749498-6d7w4"] Jul 28 10:15:42.512282 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.512266 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6968749498-6d7w4" Jul 28 10:15:42.524033 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.524008 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6968749498-6d7w4"] Jul 28 10:15:42.589737 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.589712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qxnb\" (UniqueName: \"kubernetes.io/projected/ba20ba0c-0706-40e8-b2ef-0f41e1058b92-kube-api-access-5qxnb\") pod \"kserve-controller-manager-6968749498-6d7w4\" (UID: \"ba20ba0c-0706-40e8-b2ef-0f41e1058b92\") " pod="kserve/kserve-controller-manager-6968749498-6d7w4" Jul 28 10:15:42.589835 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.589745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba20ba0c-0706-40e8-b2ef-0f41e1058b92-cert\") pod \"kserve-controller-manager-6968749498-6d7w4\" (UID: \"ba20ba0c-0706-40e8-b2ef-0f41e1058b92\") " pod="kserve/kserve-controller-manager-6968749498-6d7w4" Jul 28 10:15:42.690579 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.690549 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qxnb\" (UniqueName: \"kubernetes.io/projected/ba20ba0c-0706-40e8-b2ef-0f41e1058b92-kube-api-access-5qxnb\") pod \"kserve-controller-manager-6968749498-6d7w4\" (UID: \"ba20ba0c-0706-40e8-b2ef-0f41e1058b92\") " pod="kserve/kserve-controller-manager-6968749498-6d7w4" Jul 28 10:15:42.690709 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.690586 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba20ba0c-0706-40e8-b2ef-0f41e1058b92-cert\") pod \"kserve-controller-manager-6968749498-6d7w4\" (UID: \"ba20ba0c-0706-40e8-b2ef-0f41e1058b92\") " pod="kserve/kserve-controller-manager-6968749498-6d7w4" Jul 28 10:15:42.692722 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.692706 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba20ba0c-0706-40e8-b2ef-0f41e1058b92-cert\") pod \"kserve-controller-manager-6968749498-6d7w4\" (UID: \"ba20ba0c-0706-40e8-b2ef-0f41e1058b92\") " pod="kserve/kserve-controller-manager-6968749498-6d7w4" Jul 28 10:15:42.700921 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.700903 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qxnb\" (UniqueName: \"kubernetes.io/projected/ba20ba0c-0706-40e8-b2ef-0f41e1058b92-kube-api-access-5qxnb\") pod \"kserve-controller-manager-6968749498-6d7w4\" (UID: \"ba20ba0c-0706-40e8-b2ef-0f41e1058b92\") " pod="kserve/kserve-controller-manager-6968749498-6d7w4" Jul 28 10:15:42.728558 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.728541 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6968749498-smdm4" Jul 28 10:15:42.791076 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.791005 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7fzl\" (UniqueName: \"kubernetes.io/projected/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f-kube-api-access-v7fzl\") pod \"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f\" (UID: \"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f\") " Jul 28 10:15:42.791197 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.791088 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f-cert\") pod \"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f\" (UID: \"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f\") " Jul 28 10:15:42.793182 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.793154 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f-kube-api-access-v7fzl" (OuterVolumeSpecName: "kube-api-access-v7fzl") pod "b65c9e97-96b5-4464-a88c-2eaccbb8ba2f" (UID: "b65c9e97-96b5-4464-a88c-2eaccbb8ba2f"). InnerVolumeSpecName "kube-api-access-v7fzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:15:42.793283 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.793185 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f-cert" (OuterVolumeSpecName: "cert") pod "b65c9e97-96b5-4464-a88c-2eaccbb8ba2f" (UID: "b65c9e97-96b5-4464-a88c-2eaccbb8ba2f"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:15:42.867163 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.867141 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6968749498-6d7w4" Jul 28 10:15:42.892293 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.892273 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7fzl\" (UniqueName: \"kubernetes.io/projected/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f-kube-api-access-v7fzl\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:15:42.892293 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.892295 2581 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:15:42.997680 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:42.997657 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6968749498-6d7w4"] Jul 28 10:15:42.999510 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:15:42.999486 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba20ba0c_0706_40e8_b2ef_0f41e1058b92.slice/crio-ee1046d129e54b869182d169a94bad5a629e443fb00c1705fcfab9c8a85841fc WatchSource:0}: Error finding container ee1046d129e54b869182d169a94bad5a629e443fb00c1705fcfab9c8a85841fc: Status 404 returned error can't find the container with id ee1046d129e54b869182d169a94bad5a629e443fb00c1705fcfab9c8a85841fc Jul 28 10:15:43.119804 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:43.119774 2581 generic.go:356] "Generic (PLEG): container finished" podID="b65c9e97-96b5-4464-a88c-2eaccbb8ba2f" containerID="4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb" exitCode=0 Jul 28 10:15:43.119916 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:43.119814 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6968749498-smdm4" Jul 28 10:15:43.119916 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:43.119867 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6968749498-smdm4" event={"ID":"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f","Type":"ContainerDied","Data":"4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb"} Jul 28 10:15:43.120027 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:43.119920 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6968749498-smdm4" event={"ID":"b65c9e97-96b5-4464-a88c-2eaccbb8ba2f","Type":"ContainerDied","Data":"dd9c5603ec087f1cd18c4543f44779cc3b88be6c2f1752fda63ea194d1ee7b0b"} Jul 28 10:15:43.120027 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:43.119952 2581 scope.go:117] "RemoveContainer" containerID="4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb" Jul 28 10:15:43.121148 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:43.121122 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6968749498-6d7w4" event={"ID":"ba20ba0c-0706-40e8-b2ef-0f41e1058b92","Type":"ContainerStarted","Data":"ee1046d129e54b869182d169a94bad5a629e443fb00c1705fcfab9c8a85841fc"} Jul 28 10:15:43.127692 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:43.127678 2581 scope.go:117] "RemoveContainer" containerID="4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb" Jul 28 10:15:43.127925 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:15:43.127906 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb\": container with ID starting with 4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb not found: ID does not exist" containerID="4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb" Jul 28 10:15:43.127972 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:43.127939 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb"} err="failed to get container status \"4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb\": rpc error: code = NotFound desc = could not find container \"4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb\": container with ID starting with 4d4441e7920c55d119909cefa98230074dc08f397f8c7270b4fb814c8b5fa1eb not found: ID does not exist" Jul 28 10:15:43.136811 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:43.136792 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6968749498-smdm4"] Jul 28 10:15:43.138116 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:43.138097 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-6968749498-smdm4"] Jul 28 10:15:44.126584 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:44.126550 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6968749498-6d7w4" event={"ID":"ba20ba0c-0706-40e8-b2ef-0f41e1058b92","Type":"ContainerStarted","Data":"fed703428d3f74a6f2532f23c31529b5d4030ba54b25171faec85948b17b6781"} Jul 28 10:15:44.127038 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:44.126671 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6968749498-6d7w4" Jul 28 10:15:44.147556 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:44.147514 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6968749498-6d7w4" podStartSLOduration=1.6728895609999999 podStartE2EDuration="2.147502061s" totalImagesPullingTime="474.6125ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:15:44.145594624 +0000 UTC m=+505.624576442" watchObservedRunningTime="2026-07-28 10:15:44.147502061 +0000 UTC m=+505.626483857" Jul 28 10:15:45.096430 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.096396 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b65c9e97-96b5-4464-a88c-2eaccbb8ba2f" path="/var/lib/kubelet/pods/b65c9e97-96b5-4464-a88c-2eaccbb8ba2f/volumes" Jul 28 10:15:45.096922 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.096894 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-667858cbfb-5z9jm" podUID="cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" containerName="console" containerID="cri-o://43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74" gracePeriod=15 Jul 28 10:15:45.340288 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.340265 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:15:45.411911 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.411852 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2j7r\" (UniqueName: \"kubernetes.io/projected/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-kube-api-access-b2j7r\") pod \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " Jul 28 10:15:45.411911 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.411891 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-serving-cert\") pod \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " Jul 28 10:15:45.412124 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.411933 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-trusted-ca-bundle\") pod \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " Jul 28 10:15:45.412124 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.411973 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-service-ca\") pod \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " Jul 28 10:15:45.412124 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.412010 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-oauth-config\") pod \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " Jul 28 10:15:45.412124 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.412044 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-oauth-serving-cert\") pod \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " Jul 28 10:15:45.412124 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.412096 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-config\") pod \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\" (UID: \"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8\") " Jul 28 10:15:45.412408 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.412382 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" (UID: "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:15:45.412466 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.412433 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" (UID: "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:15:45.412523 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.412490 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-service-ca" (OuterVolumeSpecName: "service-ca") pod "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" (UID: "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:15:45.412650 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.412628 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-config" (OuterVolumeSpecName: "console-config") pod "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" (UID: "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:15:45.413970 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.413953 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" (UID: "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:15:45.414058 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.413985 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-kube-api-access-b2j7r" (OuterVolumeSpecName: "kube-api-access-b2j7r") pod "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" (UID: "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8"). InnerVolumeSpecName "kube-api-access-b2j7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:15:45.414127 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.414063 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" (UID: "cb41e18a-2fec-490f-abb0-65cb3bcdd3e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:15:45.513570 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.513547 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-trusted-ca-bundle\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:15:45.513570 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.513568 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-service-ca\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:15:45.513736 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.513578 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-oauth-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:15:45.513736 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.513588 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-oauth-serving-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:15:45.513736 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.513596 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:15:45.513736 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.513605 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2j7r\" (UniqueName: \"kubernetes.io/projected/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-kube-api-access-b2j7r\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:15:45.513736 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:45.513613 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8-console-serving-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:15:46.136742 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:46.136709 2581 generic.go:356] "Generic (PLEG): container finished" podID="cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" containerID="43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74" exitCode=0 Jul 28 10:15:46.136902 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:46.136753 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667858cbfb-5z9jm" Jul 28 10:15:46.136902 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:46.136796 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667858cbfb-5z9jm" event={"ID":"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8","Type":"ContainerDied","Data":"43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74"} Jul 28 10:15:46.136902 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:46.136841 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667858cbfb-5z9jm" event={"ID":"cb41e18a-2fec-490f-abb0-65cb3bcdd3e8","Type":"ContainerDied","Data":"eed8ec8de256c1474e8d4acb30c917f5c3dc70fde9bcaaee797a4d3ed5be2f8c"} Jul 28 10:15:46.136902 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:46.136861 2581 scope.go:117] "RemoveContainer" containerID="43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74" Jul 28 10:15:46.145766 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:46.145749 2581 scope.go:117] "RemoveContainer" containerID="43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74" Jul 28 10:15:46.146003 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:15:46.145985 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74\": container with ID starting with 43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74 not found: ID does not exist" containerID="43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74" Jul 28 10:15:46.146089 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:46.146008 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74"} err="failed to get container status \"43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74\": rpc error: code = NotFound desc = could not find container \"43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74\": container with ID starting with 43c44b433b2c86f4ad4de120e7f6ff2c758846140c0719118bdc7dd9902d5d74 not found: ID does not exist" Jul 28 10:15:46.163526 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:46.163505 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-667858cbfb-5z9jm"] Jul 28 10:15:46.167338 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:46.167319 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-667858cbfb-5z9jm"] Jul 28 10:15:47.096018 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:47.095986 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" path="/var/lib/kubelet/pods/cb41e18a-2fec-490f-abb0-65cb3bcdd3e8/volumes" Jul 28 10:15:53.890379 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:15:53.890346 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:15.137479 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:15.137390 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6968749498-6d7w4" Jul 28 10:16:16.184623 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.184593 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:16.228358 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.228323 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-rmqrp"] Jul 28 10:16:16.228643 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.228630 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65c9e97-96b5-4464-a88c-2eaccbb8ba2f" containerName="manager" Jul 28 10:16:16.228686 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.228644 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65c9e97-96b5-4464-a88c-2eaccbb8ba2f" containerName="manager" Jul 28 10:16:16.228686 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.228662 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" containerName="console" Jul 28 10:16:16.228686 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.228667 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" containerName="console" Jul 28 10:16:16.228778 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.228719 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65c9e97-96b5-4464-a88c-2eaccbb8ba2f" containerName="manager" Jul 28 10:16:16.228778 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.228730 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb41e18a-2fec-490f-abb0-65cb3bcdd3e8" containerName="console" Jul 28 10:16:16.231674 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.231655 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-rmqrp" Jul 28 10:16:16.234611 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.234588 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 28 10:16:16.234727 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.234617 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-nm9bp\"" Jul 28 10:16:16.241275 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.241246 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-rmqrp"] Jul 28 10:16:16.243028 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.243008 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-69npt"] Jul 28 10:16:16.244930 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.244865 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9bb375b-1db7-4600-818e-49e8667d66ad-tls-certs\") pod \"model-serving-api-7b954ffc95-rmqrp\" (UID: \"d9bb375b-1db7-4600-818e-49e8667d66ad\") " pod="kserve/model-serving-api-7b954ffc95-rmqrp" Jul 28 10:16:16.244930 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.244915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rk7q\" (UniqueName: \"kubernetes.io/projected/d9bb375b-1db7-4600-818e-49e8667d66ad-kube-api-access-2rk7q\") pod \"model-serving-api-7b954ffc95-rmqrp\" (UID: \"d9bb375b-1db7-4600-818e-49e8667d66ad\") " pod="kserve/model-serving-api-7b954ffc95-rmqrp" Jul 28 10:16:16.246087 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.246056 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-69npt" Jul 28 10:16:16.248951 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.248929 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-s8w5l\"" Jul 28 10:16:16.249203 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.249180 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 28 10:16:16.259260 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.259238 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-69npt"] Jul 28 10:16:16.276270 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.276235 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:16.345615 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.345588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9bb375b-1db7-4600-818e-49e8667d66ad-tls-certs\") pod \"model-serving-api-7b954ffc95-rmqrp\" (UID: \"d9bb375b-1db7-4600-818e-49e8667d66ad\") " pod="kserve/model-serving-api-7b954ffc95-rmqrp" Jul 28 10:16:16.345783 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.345626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rk7q\" (UniqueName: \"kubernetes.io/projected/d9bb375b-1db7-4600-818e-49e8667d66ad-kube-api-access-2rk7q\") pod \"model-serving-api-7b954ffc95-rmqrp\" (UID: \"d9bb375b-1db7-4600-818e-49e8667d66ad\") " pod="kserve/model-serving-api-7b954ffc95-rmqrp" Jul 28 10:16:16.345783 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.345657 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adc29a75-3f96-4e73-babc-72c6f9542c2d-cert\") pod \"odh-model-controller-75d9cdbddf-69npt\" (UID: \"adc29a75-3f96-4e73-babc-72c6f9542c2d\") " pod="kserve/odh-model-controller-75d9cdbddf-69npt" Jul 28 10:16:16.345783 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:16:16.345723 2581 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 28 10:16:16.345783 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:16:16.345778 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9bb375b-1db7-4600-818e-49e8667d66ad-tls-certs podName:d9bb375b-1db7-4600-818e-49e8667d66ad nodeName:}" failed. No retries permitted until 2026-07-28 10:16:16.845763356 +0000 UTC m=+538.324745130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d9bb375b-1db7-4600-818e-49e8667d66ad-tls-certs") pod "model-serving-api-7b954ffc95-rmqrp" (UID: "d9bb375b-1db7-4600-818e-49e8667d66ad") : secret "model-serving-api-tls" not found Jul 28 10:16:16.345783 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.345725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2rqz\" (UniqueName: \"kubernetes.io/projected/adc29a75-3f96-4e73-babc-72c6f9542c2d-kube-api-access-m2rqz\") pod \"odh-model-controller-75d9cdbddf-69npt\" (UID: \"adc29a75-3f96-4e73-babc-72c6f9542c2d\") " pod="kserve/odh-model-controller-75d9cdbddf-69npt" Jul 28 10:16:16.354303 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.354274 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rk7q\" (UniqueName: \"kubernetes.io/projected/d9bb375b-1db7-4600-818e-49e8667d66ad-kube-api-access-2rk7q\") pod \"model-serving-api-7b954ffc95-rmqrp\" (UID: \"d9bb375b-1db7-4600-818e-49e8667d66ad\") " pod="kserve/model-serving-api-7b954ffc95-rmqrp" Jul 28 10:16:16.386096 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.386056 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:16.446506 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.446435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2rqz\" (UniqueName: \"kubernetes.io/projected/adc29a75-3f96-4e73-babc-72c6f9542c2d-kube-api-access-m2rqz\") pod \"odh-model-controller-75d9cdbddf-69npt\" (UID: \"adc29a75-3f96-4e73-babc-72c6f9542c2d\") " pod="kserve/odh-model-controller-75d9cdbddf-69npt" Jul 28 10:16:16.446506 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.446501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adc29a75-3f96-4e73-babc-72c6f9542c2d-cert\") pod \"odh-model-controller-75d9cdbddf-69npt\" (UID: \"adc29a75-3f96-4e73-babc-72c6f9542c2d\") " pod="kserve/odh-model-controller-75d9cdbddf-69npt" Jul 28 10:16:16.448745 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.448719 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adc29a75-3f96-4e73-babc-72c6f9542c2d-cert\") pod \"odh-model-controller-75d9cdbddf-69npt\" (UID: \"adc29a75-3f96-4e73-babc-72c6f9542c2d\") " pod="kserve/odh-model-controller-75d9cdbddf-69npt" Jul 28 10:16:16.456977 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.456955 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2rqz\" (UniqueName: \"kubernetes.io/projected/adc29a75-3f96-4e73-babc-72c6f9542c2d-kube-api-access-m2rqz\") pod \"odh-model-controller-75d9cdbddf-69npt\" (UID: \"adc29a75-3f96-4e73-babc-72c6f9542c2d\") " pod="kserve/odh-model-controller-75d9cdbddf-69npt" Jul 28 10:16:16.487017 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.486989 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:16.555324 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.555283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-69npt" Jul 28 10:16:16.682295 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.682270 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-69npt"] Jul 28 10:16:16.684188 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:16:16.684162 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc29a75_3f96_4e73_babc_72c6f9542c2d.slice/crio-57c5f7359b6c66bd2946e541a7c14b04e7480c5a5abdc1e9fb16e00acca5b484 WatchSource:0}: Error finding container 57c5f7359b6c66bd2946e541a7c14b04e7480c5a5abdc1e9fb16e00acca5b484: Status 404 returned error can't find the container with id 57c5f7359b6c66bd2946e541a7c14b04e7480c5a5abdc1e9fb16e00acca5b484 Jul 28 10:16:16.848944 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.848911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9bb375b-1db7-4600-818e-49e8667d66ad-tls-certs\") pod \"model-serving-api-7b954ffc95-rmqrp\" (UID: \"d9bb375b-1db7-4600-818e-49e8667d66ad\") " pod="kserve/model-serving-api-7b954ffc95-rmqrp" Jul 28 10:16:16.851229 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.851208 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9bb375b-1db7-4600-818e-49e8667d66ad-tls-certs\") pod \"model-serving-api-7b954ffc95-rmqrp\" (UID: \"d9bb375b-1db7-4600-818e-49e8667d66ad\") " pod="kserve/model-serving-api-7b954ffc95-rmqrp" Jul 28 10:16:16.883028 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.883004 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:16.944841 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:16.944809 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:17.141908 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:17.141831 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-rmqrp" Jul 28 10:16:17.264884 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:17.264851 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-69npt" event={"ID":"adc29a75-3f96-4e73-babc-72c6f9542c2d","Type":"ContainerStarted","Data":"57c5f7359b6c66bd2946e541a7c14b04e7480c5a5abdc1e9fb16e00acca5b484"} Jul 28 10:16:17.287997 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:17.287971 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-rmqrp"] Jul 28 10:16:17.289821 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:16:17.289796 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bb375b_1db7_4600_818e_49e8667d66ad.slice/crio-28a196620f24145818cc18b6f75e658030bb9752655eae48af8cfa3e9fd988d1 WatchSource:0}: Error finding container 28a196620f24145818cc18b6f75e658030bb9752655eae48af8cfa3e9fd988d1: Status 404 returned error can't find the container with id 28a196620f24145818cc18b6f75e658030bb9752655eae48af8cfa3e9fd988d1 Jul 28 10:16:18.273145 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:18.273051 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-rmqrp" event={"ID":"d9bb375b-1db7-4600-818e-49e8667d66ad","Type":"ContainerStarted","Data":"28a196620f24145818cc18b6f75e658030bb9752655eae48af8cfa3e9fd988d1"} Jul 28 10:16:21.289434 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:21.289395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-69npt" event={"ID":"adc29a75-3f96-4e73-babc-72c6f9542c2d","Type":"ContainerStarted","Data":"dff1bfa71c652116556ecb7ec7c144359f387632ad299fc48b3afd7a8ec4e748"} Jul 28 10:16:21.289872 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:21.289483 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-75d9cdbddf-69npt" Jul 28 10:16:21.290816 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:21.290794 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-rmqrp" event={"ID":"d9bb375b-1db7-4600-818e-49e8667d66ad","Type":"ContainerStarted","Data":"41229fcc5e1eae21b44eaef69c8986c5677022162f868c2e4484926edeb1334a"} Jul 28 10:16:21.290933 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:21.290919 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-rmqrp" Jul 28 10:16:21.307151 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:21.307107 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-75d9cdbddf-69npt" podStartSLOduration=1.250474804 podStartE2EDuration="5.307093365s" totalImagesPullingTime="4.056618561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:16:21.305942434 +0000 UTC m=+542.784924230" watchObservedRunningTime="2026-07-28 10:16:21.307093365 +0000 UTC m=+542.786075156" Jul 28 10:16:21.323848 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:21.323810 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-rmqrp" podStartSLOduration=1.835780807 podStartE2EDuration="5.323792716s" totalImagesPullingTime="3.488011909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:16:21.323733857 +0000 UTC m=+542.802715653" watchObservedRunningTime="2026-07-28 10:16:21.323792716 +0000 UTC m=+542.802774512" Jul 28 10:16:32.298242 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:32.298197 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-75d9cdbddf-69npt" Jul 28 10:16:32.300370 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:16:32.300348 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-rmqrp" Jul 28 10:17:18.930404 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:17:18.930373 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:17:18.934646 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:17:18.934621 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:17:51.446632 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:17:51.446599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:17:51.798851 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:17:51.798779 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:18:10.786289 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:18:10.786256 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:18:12.330844 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:18:12.330812 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:18:24.554549 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:18:24.554511 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:18:24.655002 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:18:24.654955 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:18:25.340629 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:18:25.340596 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:18:25.440449 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:18:25.440416 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:18:36.259410 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:18:36.259360 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:18:36.402439 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:18:36.402407 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:18:39.988952 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:18:39.988923 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:18:40.090581 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:18:40.090553 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:31.485231 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:20:31.485192 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:31.545883 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:20:31.545851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:31.604244 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:20:31.604211 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:44.215089 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:20:44.214985 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:22:06.667938 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:22:06.667891 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:22:06.768478 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:22:06.768441 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:22:06.870989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:22:06.870957 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:22:16.706704 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:22:16.706622 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:22:17.092504 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:22:17.092467 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:22:18.957967 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:22:18.957940 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:22:18.959227 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:22:18.959205 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:23:07.940377 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:23:07.940338 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:23:51.983688 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:23:51.983588 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:23:53.162114 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:23:53.162079 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:25:04.382118 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:25:04.382061 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:26:58.831238 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:26:58.831201 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:27:03.873585 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:27:03.873551 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:27:04.262255 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:27:04.262180 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:27:08.177484 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:27:08.177450 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:27:18.985648 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:27:18.985616 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:27:18.986553 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:27:18.986525 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:29:20.455737 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:29:20.455700 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:29:25.443064 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:29:25.443034 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:29:25.650228 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:29:25.650192 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:29:51.286297 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:29:51.286220 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:26.058504 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:31:26.058420 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:26.145852 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:31:26.145817 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:42.286317 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:31:42.286281 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:47.446604 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:31:47.446561 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:47.533759 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:31:47.533717 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:32:13.881199 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:32:13.881165 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:32:19.011175 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:32:19.011149 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:32:19.012596 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:32:19.012571 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:32:19.945943 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:32:19.945906 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:33:53.804333 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:33:53.804294 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:33:58.879142 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:33:58.879102 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:33:59.179513 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:33:59.179442 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:34:41.406563 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:34:41.406457 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:34:46.637372 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:34:46.637328 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:34:46.977362 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:34:46.977270 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:35:21.842203 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:35:21.842168 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:35:23.668201 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:35:23.668161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:35:26.985361 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:35:26.985316 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:35:27.074344 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:35:27.074310 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:35:27.157885 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:35:27.157849 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:35:27.539159 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:35:27.539117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:36:57.161409 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:36:57.161379 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:36:57.222087 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:36:57.222028 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:37:02.259092 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:37:02.259033 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:37:02.343473 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:37:02.343432 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:37:02.400008 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:37:02.399982 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:37:02.584783 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:37:02.584752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:37:19.038352 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:37:19.038325 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:37:19.040343 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:37:19.040316 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:38:32.441703 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.441662 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:38:32.493142 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.493107 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm"] Jul 28 10:38:32.496647 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.496627 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.499248 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.499227 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 28 10:38:32.499370 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.499288 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 28 10:38:32.499370 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.499312 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-tww8p\"" Jul 28 10:38:32.499464 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.499389 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 28 10:38:32.500272 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.500252 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 28 10:38:32.500360 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.500275 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\"" Jul 28 10:38:32.500360 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.500275 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-v2-predictor-serving-cert\"" Jul 28 10:38:32.510411 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.510392 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm"] Jul 28 10:38:32.587238 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.587210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjmrb\" (UniqueName: \"kubernetes.io/projected/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kube-api-access-cjmrb\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.587365 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.587290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.587365 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.587314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.587365 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.587333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.587365 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.587355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.688437 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.688409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.688437 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.688438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.688629 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.688455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.688629 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.688478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.688629 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.688505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjmrb\" (UniqueName: \"kubernetes.io/projected/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kube-api-access-cjmrb\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.688877 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.688859 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.689202 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.689182 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.689202 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.689196 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.690945 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.690928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.696717 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.696661 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjmrb\" (UniqueName: \"kubernetes.io/projected/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kube-api-access-cjmrb\") pod \"isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.806780 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.806751 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:32.938962 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.938939 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm"] Jul 28 10:38:32.941245 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:38:32.941210 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d4c0e9_f185_42e6_b1c3_5df0361a0249.slice/crio-f5ad853c19597965e2a277b527744816e9a915ee9b8f031981432de7688baa38 WatchSource:0}: Error finding container f5ad853c19597965e2a277b527744816e9a915ee9b8f031981432de7688baa38: Status 404 returned error can't find the container with id f5ad853c19597965e2a277b527744816e9a915ee9b8f031981432de7688baa38 Jul 28 10:38:32.943250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:32.943234 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 10:38:33.907911 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:33.907876 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" event={"ID":"d9d4c0e9-f185-42e6-b1c3-5df0361a0249","Type":"ContainerStarted","Data":"f5ad853c19597965e2a277b527744816e9a915ee9b8f031981432de7688baa38"} Jul 28 10:38:36.923990 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:36.923943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" event={"ID":"d9d4c0e9-f185-42e6-b1c3-5df0361a0249","Type":"ContainerStarted","Data":"854a156cd4380709a20629cd730fbc2ac4acdc89090e88abb041228cf1b2021e"} Jul 28 10:38:40.942920 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:40.942850 2581 generic.go:356] "Generic (PLEG): container finished" podID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerID="854a156cd4380709a20629cd730fbc2ac4acdc89090e88abb041228cf1b2021e" exitCode=0 Jul 28 10:38:40.942920 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:40.942898 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" event={"ID":"d9d4c0e9-f185-42e6-b1c3-5df0361a0249","Type":"ContainerDied","Data":"854a156cd4380709a20629cd730fbc2ac4acdc89090e88abb041228cf1b2021e"} Jul 28 10:38:54.017974 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:54.017904 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" event={"ID":"d9d4c0e9-f185-42e6-b1c3-5df0361a0249","Type":"ContainerStarted","Data":"3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb"} Jul 28 10:38:57.036906 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:57.036869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" event={"ID":"d9d4c0e9-f185-42e6-b1c3-5df0361a0249","Type":"ContainerStarted","Data":"73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b"} Jul 28 10:38:57.039193 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:57.036941 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:57.039193 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:57.037106 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:38:57.039193 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:57.038396 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Jul 28 10:38:57.060232 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:57.060190 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podStartSLOduration=2.831630343 podStartE2EDuration="25.060174747s" totalImagesPullingTime="18.598108444s" totalInitContainerRuntime="3.63043596s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:38:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:38:57.059725047 +0000 UTC m=+1898.538706852" watchObservedRunningTime="2026-07-28 10:38:57.060174747 +0000 UTC m=+1898.539156542" Jul 28 10:38:58.041204 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:38:58.041119 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Jul 28 10:39:03.046120 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:39:03.046090 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:39:03.046573 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:39:03.046547 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Jul 28 10:39:13.046797 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:39:13.046753 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Jul 28 10:39:23.047060 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:39:23.047017 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Jul 28 10:39:33.047425 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:39:33.047382 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Jul 28 10:39:38.833092 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:39:38.833046 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:39:38.933387 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:39:38.933354 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:39:43.046774 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:39:43.046725 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Jul 28 10:39:53.046540 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:39:53.046498 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Jul 28 10:40:03.047300 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:03.047259 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Jul 28 10:40:07.096884 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:07.096858 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:40:12.666348 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:12.666256 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm"] Jul 28 10:40:12.666786 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:12.666610 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" containerID="cri-o://3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb" gracePeriod=30 Jul 28 10:40:12.666786 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:12.666692 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kube-rbac-proxy" containerID="cri-o://73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b" gracePeriod=30 Jul 28 10:40:12.698614 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:12.698585 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:40:13.041679 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:13.041586 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.30:8643/healthz\": dial tcp 10.133.0.30:8643: connect: connection refused" Jul 28 10:40:13.361918 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:13.361885 2581 generic.go:356] "Generic (PLEG): container finished" podID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerID="73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b" exitCode=2 Jul 28 10:40:13.362087 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:13.361957 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" event={"ID":"d9d4c0e9-f185-42e6-b1c3-5df0361a0249","Type":"ContainerDied","Data":"73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b"} Jul 28 10:40:17.116889 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.116865 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:40:17.193906 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.193878 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kserve-provision-location\") pod \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " Jul 28 10:40:17.194058 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.193939 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjmrb\" (UniqueName: \"kubernetes.io/projected/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kube-api-access-cjmrb\") pod \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " Jul 28 10:40:17.194058 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.193980 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-proxy-tls\") pod \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " Jul 28 10:40:17.194058 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.194010 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-cabundle-cert\") pod \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " Jul 28 10:40:17.194250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.194095 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kube-rbac-proxy-sar-config\") pod \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\" (UID: \"d9d4c0e9-f185-42e6-b1c3-5df0361a0249\") " Jul 28 10:40:17.194250 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.194191 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d9d4c0e9-f185-42e6-b1c3-5df0361a0249" (UID: "d9d4c0e9-f185-42e6-b1c3-5df0361a0249"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:40:17.194385 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.194372 2581 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kserve-provision-location\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:40:17.194502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.194469 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "d9d4c0e9-f185-42e6-b1c3-5df0361a0249" (UID: "d9d4c0e9-f185-42e6-b1c3-5df0361a0249"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:40:17.194502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.194492 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d9d4c0e9-f185-42e6-b1c3-5df0361a0249" (UID: "d9d4c0e9-f185-42e6-b1c3-5df0361a0249"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:40:17.196214 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.196191 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d9d4c0e9-f185-42e6-b1c3-5df0361a0249" (UID: "d9d4c0e9-f185-42e6-b1c3-5df0361a0249"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:40:17.196315 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.196266 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kube-api-access-cjmrb" (OuterVolumeSpecName: "kube-api-access-cjmrb") pod "d9d4c0e9-f185-42e6-b1c3-5df0361a0249" (UID: "d9d4c0e9-f185-42e6-b1c3-5df0361a0249"). InnerVolumeSpecName "kube-api-access-cjmrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:40:17.295402 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.295379 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjmrb\" (UniqueName: \"kubernetes.io/projected/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kube-api-access-cjmrb\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:40:17.295402 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.295402 2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-proxy-tls\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:40:17.295571 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.295412 2581 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-cabundle-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:40:17.295571 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.295421 2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d9d4c0e9-f185-42e6-b1c3-5df0361a0249-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:40:17.379487 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.379456 2581 generic.go:356] "Generic (PLEG): container finished" podID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerID="3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb" exitCode=0 Jul 28 10:40:17.379613 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.379517 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" Jul 28 10:40:17.379613 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.379536 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" event={"ID":"d9d4c0e9-f185-42e6-b1c3-5df0361a0249","Type":"ContainerDied","Data":"3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb"} Jul 28 10:40:17.379613 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.379595 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" event={"ID":"d9d4c0e9-f185-42e6-b1c3-5df0361a0249","Type":"ContainerDied","Data":"f5ad853c19597965e2a277b527744816e9a915ee9b8f031981432de7688baa38"} Jul 28 10:40:17.379722 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.379622 2581 scope.go:117] "RemoveContainer" containerID="73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b" Jul 28 10:40:17.387982 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.387957 2581 scope.go:117] "RemoveContainer" containerID="3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb" Jul 28 10:40:17.394884 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.394867 2581 scope.go:117] "RemoveContainer" containerID="854a156cd4380709a20629cd730fbc2ac4acdc89090e88abb041228cf1b2021e" Jul 28 10:40:17.401675 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.401658 2581 scope.go:117] "RemoveContainer" containerID="73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b" Jul 28 10:40:17.401954 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:40:17.401930 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b\": container with ID starting with 73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b not found: ID does not exist" containerID="73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b" Jul 28 10:40:17.402006 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.401965 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b"} err="failed to get container status \"73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b\": rpc error: code = NotFound desc = could not find container \"73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b\": container with ID starting with 73d679adb4a9363ec07cda30ae52b7ef3d69aae6b29fdba7e8ee0d1e6cd5e17b not found: ID does not exist" Jul 28 10:40:17.402006 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.401986 2581 scope.go:117] "RemoveContainer" containerID="3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb" Jul 28 10:40:17.402251 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:40:17.402232 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb\": container with ID starting with 3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb not found: ID does not exist" containerID="3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb" Jul 28 10:40:17.402303 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.402258 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb"} err="failed to get container status \"3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb\": rpc error: code = NotFound desc = could not find container \"3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb\": container with ID starting with 3936b787f362c7fd45fa37a411e38184119ae0c65ba0cf099b3748151558b2bb not found: ID does not exist" Jul 28 10:40:17.402303 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.402274 2581 scope.go:117] "RemoveContainer" containerID="854a156cd4380709a20629cd730fbc2ac4acdc89090e88abb041228cf1b2021e" Jul 28 10:40:17.402544 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:40:17.402520 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"854a156cd4380709a20629cd730fbc2ac4acdc89090e88abb041228cf1b2021e\": container with ID starting with 854a156cd4380709a20629cd730fbc2ac4acdc89090e88abb041228cf1b2021e not found: ID does not exist" containerID="854a156cd4380709a20629cd730fbc2ac4acdc89090e88abb041228cf1b2021e" Jul 28 10:40:17.402644 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.402553 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854a156cd4380709a20629cd730fbc2ac4acdc89090e88abb041228cf1b2021e"} err="failed to get container status \"854a156cd4380709a20629cd730fbc2ac4acdc89090e88abb041228cf1b2021e\": rpc error: code = NotFound desc = could not find container \"854a156cd4380709a20629cd730fbc2ac4acdc89090e88abb041228cf1b2021e\": container with ID starting with 854a156cd4380709a20629cd730fbc2ac4acdc89090e88abb041228cf1b2021e not found: ID does not exist" Jul 28 10:40:17.405869 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.405845 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm"] Jul 28 10:40:17.411641 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.411622 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm"] Jul 28 10:40:17.803255 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.803220 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:40:17.873658 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:17.873626 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:40:18.035713 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:18.035682 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:40:18.091936 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:18.091881 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-74bdc8ffff-ltttm" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: i/o timeout" Jul 28 10:40:18.137919 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:18.137881 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:40:19.096173 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:40:19.096142 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" path="/var/lib/kubelet/pods/d9d4c0e9-f185-42e6-b1c3-5df0361a0249/volumes" Jul 28 10:41:47.936275 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.936175 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:47.981944 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.981915 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67"] Jul 28 10:41:47.982277 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.982264 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kube-rbac-proxy" Jul 28 10:41:47.982325 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.982279 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kube-rbac-proxy" Jul 28 10:41:47.982325 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.982293 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="storage-initializer" Jul 28 10:41:47.982325 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.982299 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="storage-initializer" Jul 28 10:41:47.982325 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.982321 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" Jul 28 10:41:47.982484 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.982327 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" Jul 28 10:41:47.982484 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.982378 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kserve-container" Jul 28 10:41:47.982484 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.982390 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d4c0e9-f185-42e6-b1c3-5df0361a0249" containerName="kube-rbac-proxy" Jul 28 10:41:47.985522 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.985503 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:47.988126 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.988102 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 28 10:41:47.988226 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.988133 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\"" Jul 28 10:41:47.988226 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.988107 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 28 10:41:47.988226 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.988157 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-tww8p\"" Jul 28 10:41:47.988226 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.988107 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 28 10:41:47.989227 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.989206 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\"" Jul 28 10:41:47.989335 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.989239 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 28 10:41:47.996440 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:47.996419 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67"] Jul 28 10:41:48.115697 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.115674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.115808 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.115701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg42t\" (UniqueName: \"kubernetes.io/projected/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kube-api-access-sg42t\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.115808 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.115733 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-proxy-tls\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.115808 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.115790 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.115913 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.115858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-cabundle-cert\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.216391 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.216323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.216391 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.216380 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-cabundle-cert\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.216522 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.216408 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.216522 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.216426 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg42t\" (UniqueName: \"kubernetes.io/projected/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kube-api-access-sg42t\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.216522 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.216457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-proxy-tls\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.216787 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.216768 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.217052 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.217025 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.217183 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.217062 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-cabundle-cert\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.218925 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.218907 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-proxy-tls\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.225668 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.225646 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg42t\" (UniqueName: \"kubernetes.io/projected/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kube-api-access-sg42t\") pod \"isvc-canary-rollback-predictor-bb95f9bbd-mdf67\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.296076 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.296047 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:48.418817 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.418793 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67"] Jul 28 10:41:48.420657 ip-10-0-136-186 kubenswrapper[2581]: W0728 10:41:48.420632 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e13dcb_bd82_437f_b92d_52cfd9637dd7.slice/crio-cbe7d551c0cbd7bca00d0f7ef7346fff8e0776f1fe43abe1bdd67afbbfa3b0a8 WatchSource:0}: Error finding container cbe7d551c0cbd7bca00d0f7ef7346fff8e0776f1fe43abe1bdd67afbbfa3b0a8: Status 404 returned error can't find the container with id cbe7d551c0cbd7bca00d0f7ef7346fff8e0776f1fe43abe1bdd67afbbfa3b0a8 Jul 28 10:41:48.787496 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.787422 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" event={"ID":"b1e13dcb-bd82-437f-b92d-52cfd9637dd7","Type":"ContainerStarted","Data":"f59a4b4936857867ad5d855ebc57922d1d0bea01c3db62a65823be40749f4de0"} Jul 28 10:41:48.787496 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:48.787483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" event={"ID":"b1e13dcb-bd82-437f-b92d-52cfd9637dd7","Type":"ContainerStarted","Data":"cbe7d551c0cbd7bca00d0f7ef7346fff8e0776f1fe43abe1bdd67afbbfa3b0a8"} Jul 28 10:41:49.977966 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:49.977929 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:52.809816 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:52.809728 2581 generic.go:356] "Generic (PLEG): container finished" podID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerID="f59a4b4936857867ad5d855ebc57922d1d0bea01c3db62a65823be40749f4de0" exitCode=0 Jul 28 10:41:52.809816 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:52.809789 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" event={"ID":"b1e13dcb-bd82-437f-b92d-52cfd9637dd7","Type":"ContainerDied","Data":"f59a4b4936857867ad5d855ebc57922d1d0bea01c3db62a65823be40749f4de0"} Jul 28 10:41:53.816598 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:53.816562 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" event={"ID":"b1e13dcb-bd82-437f-b92d-52cfd9637dd7","Type":"ContainerStarted","Data":"098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a"} Jul 28 10:41:53.816986 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:53.816622 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" event={"ID":"b1e13dcb-bd82-437f-b92d-52cfd9637dd7","Type":"ContainerStarted","Data":"fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef"} Jul 28 10:41:53.816986 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:53.816917 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:53.816986 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:53.816977 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:53.818510 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:53.818480 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Jul 28 10:41:53.836376 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:53.836336 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podStartSLOduration=2.976291609 podStartE2EDuration="6.836322052s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.860030443s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:41:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:41:53.834670655 +0000 UTC m=+2075.313652450" watchObservedRunningTime="2026-07-28 10:41:53.836322052 +0000 UTC m=+2075.315303912" Jul 28 10:41:54.821520 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:54.821476 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Jul 28 10:41:59.825989 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:59.825963 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:41:59.826477 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:41:59.826448 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Jul 28 10:42:09.826618 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:42:09.826576 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Jul 28 10:42:16.494484 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:42:16.494448 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:42:19.069355 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:42:19.069329 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:42:19.070367 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:42:19.070349 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:42:19.827311 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:42:19.827268 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Jul 28 10:42:29.827331 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:42:29.827285 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Jul 28 10:42:39.826769 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:42:39.826727 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Jul 28 10:42:49.827258 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:42:49.827220 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Jul 28 10:42:59.826898 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:42:59.826860 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Jul 28 10:43:09.827037 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:09.827002 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:43:18.105943 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:18.105862 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67"] Jul 28 10:43:18.106359 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:18.106111 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" containerID="cri-o://fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef" gracePeriod=30 Jul 28 10:43:18.106359 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:18.106142 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kube-rbac-proxy" containerID="cri-o://098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a" gracePeriod=30 Jul 28 10:43:18.133326 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:18.133295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:43:19.184839 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:19.184802 2581 generic.go:356] "Generic (PLEG): container finished" podID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerID="098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a" exitCode=2 Jul 28 10:43:19.185210 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:19.184859 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" event={"ID":"b1e13dcb-bd82-437f-b92d-52cfd9637dd7","Type":"ContainerDied","Data":"098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a"} Jul 28 10:43:19.822316 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:19.822273 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused" Jul 28 10:43:19.826645 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:19.826615 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Jul 28 10:43:22.754664 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:22.754639 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:43:22.951605 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:22.951571 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-proxy-tls\") pod \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " Jul 28 10:43:22.951772 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:22.951627 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-cabundle-cert\") pod \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " Jul 28 10:43:22.951772 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:22.951742 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kube-rbac-proxy-sar-config\") pod \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " Jul 28 10:43:22.951844 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:22.951793 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kserve-provision-location\") pod \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " Jul 28 10:43:22.951844 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:22.951820 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg42t\" (UniqueName: \"kubernetes.io/projected/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kube-api-access-sg42t\") pod \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\" (UID: \"b1e13dcb-bd82-437f-b92d-52cfd9637dd7\") " Jul 28 10:43:22.952009 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:22.951935 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "b1e13dcb-bd82-437f-b92d-52cfd9637dd7" (UID: "b1e13dcb-bd82-437f-b92d-52cfd9637dd7"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:43:22.952175 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:22.952119 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b1e13dcb-bd82-437f-b92d-52cfd9637dd7" (UID: "b1e13dcb-bd82-437f-b92d-52cfd9637dd7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:43:22.952175 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:22.952139 2581 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-cabundle-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:43:22.952175 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:22.952134 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "b1e13dcb-bd82-437f-b92d-52cfd9637dd7" (UID: "b1e13dcb-bd82-437f-b92d-52cfd9637dd7"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:43:22.953726 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:22.953705 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b1e13dcb-bd82-437f-b92d-52cfd9637dd7" (UID: "b1e13dcb-bd82-437f-b92d-52cfd9637dd7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:43:22.953935 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:22.953916 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kube-api-access-sg42t" (OuterVolumeSpecName: "kube-api-access-sg42t") pod "b1e13dcb-bd82-437f-b92d-52cfd9637dd7" (UID: "b1e13dcb-bd82-437f-b92d-52cfd9637dd7"). InnerVolumeSpecName "kube-api-access-sg42t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:43:23.053342 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.053309 2581 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kserve-provision-location\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:43:23.053342 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.053337 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg42t\" (UniqueName: \"kubernetes.io/projected/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kube-api-access-sg42t\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:43:23.053342 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.053347 2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-proxy-tls\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:43:23.053602 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.053356 2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b1e13dcb-bd82-437f-b92d-52cfd9637dd7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" Jul 28 10:43:23.203965 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.203873 2581 generic.go:356] "Generic (PLEG): container finished" podID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerID="fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef" exitCode=0 Jul 28 10:43:23.203965 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.203932 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" event={"ID":"b1e13dcb-bd82-437f-b92d-52cfd9637dd7","Type":"ContainerDied","Data":"fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef"} Jul 28 10:43:23.204208 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.204002 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" event={"ID":"b1e13dcb-bd82-437f-b92d-52cfd9637dd7","Type":"ContainerDied","Data":"cbe7d551c0cbd7bca00d0f7ef7346fff8e0776f1fe43abe1bdd67afbbfa3b0a8"} Jul 28 10:43:23.204208 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.203937 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67" Jul 28 10:43:23.204208 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.204039 2581 scope.go:117] "RemoveContainer" containerID="098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a" Jul 28 10:43:23.212331 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.212307 2581 scope.go:117] "RemoveContainer" containerID="fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef" Jul 28 10:43:23.221362 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.221341 2581 scope.go:117] "RemoveContainer" containerID="f59a4b4936857867ad5d855ebc57922d1d0bea01c3db62a65823be40749f4de0" Jul 28 10:43:23.229647 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.229630 2581 scope.go:117] "RemoveContainer" containerID="098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a" Jul 28 10:43:23.229898 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:43:23.229880 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a\": container with ID starting with 098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a not found: ID does not exist" containerID="098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a" Jul 28 10:43:23.229946 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.229907 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a"} err="failed to get container status \"098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a\": rpc error: code = NotFound desc = could not find container \"098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a\": container with ID starting with 098572383fbe25004835b71c46d860ed23bc9931776e5d48623458a8ee95752a not found: ID does not exist" Jul 28 10:43:23.229946 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.229924 2581 scope.go:117] "RemoveContainer" containerID="fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef" Jul 28 10:43:23.230209 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:43:23.230192 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef\": container with ID starting with fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef not found: ID does not exist" containerID="fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef" Jul 28 10:43:23.230272 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.230214 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef"} err="failed to get container status \"fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef\": rpc error: code = NotFound desc = could not find container \"fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef\": container with ID starting with fb63c92d59e3c0649c386696dd2c608683bd94e6d5b6d98e3d7722cc378947ef not found: ID does not exist" Jul 28 10:43:23.230272 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.230226 2581 scope.go:117] "RemoveContainer" containerID="f59a4b4936857867ad5d855ebc57922d1d0bea01c3db62a65823be40749f4de0" Jul 28 10:43:23.230510 ip-10-0-136-186 kubenswrapper[2581]: E0728 10:43:23.230482 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f59a4b4936857867ad5d855ebc57922d1d0bea01c3db62a65823be40749f4de0\": container with ID starting with f59a4b4936857867ad5d855ebc57922d1d0bea01c3db62a65823be40749f4de0 not found: ID does not exist" containerID="f59a4b4936857867ad5d855ebc57922d1d0bea01c3db62a65823be40749f4de0" Jul 28 10:43:23.230615 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.230514 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f59a4b4936857867ad5d855ebc57922d1d0bea01c3db62a65823be40749f4de0"} err="failed to get container status \"f59a4b4936857867ad5d855ebc57922d1d0bea01c3db62a65823be40749f4de0\": rpc error: code = NotFound desc = could not find container \"f59a4b4936857867ad5d855ebc57922d1d0bea01c3db62a65823be40749f4de0\": container with ID starting with f59a4b4936857867ad5d855ebc57922d1d0bea01c3db62a65823be40749f4de0 not found: ID does not exist" Jul 28 10:43:23.243440 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.243417 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:43:23.249684 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.249660 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67"] Jul 28 10:43:23.252428 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.252408 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-bb95f9bbd-mdf67"] Jul 28 10:43:23.337287 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.337257 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:43:23.419586 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.419554 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:43:23.566295 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:23.566210 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:43:25.096257 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:43:25.096224 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" path="/var/lib/kubelet/pods/b1e13dcb-bd82-437f-b92d-52cfd9637dd7/volumes" Jul 28 10:44:53.309182 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:44:53.309096 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:44:53.367251 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:44:53.367215 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:45:03.537909 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:45:03.537876 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:45:03.850588 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:45:03.850555 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:46:34.041644 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:46:34.041564 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:46:39.095610 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:46:39.095575 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:46:39.755575 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:46:39.755542 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:47:19.094816 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:47:19.094782 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:47:19.097340 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:47:19.097315 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:47:48.454942 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:47:48.454904 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:48:09.704961 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:48:09.704922 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:48:14.773128 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:48:14.773090 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:48:14.956147 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:48:14.956108 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:50:47.546424 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:50:47.546337 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:51:05.021133 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:51:05.021095 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:51:10.100395 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:51:10.100364 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:51:10.564909 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:51:10.564879 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:51:30.213895 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:51:30.213847 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:51:35.352199 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:51:35.352165 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:51:36.579799 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:51:36.579764 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:52:19.119322 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:52:19.119249 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:52:19.122611 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:52:19.122590 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:52:25.482260 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:52:25.482226 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:52:30.607502 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:52:30.607472 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:52:30.933241 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:52:30.933156 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:53:50.749517 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:53:50.749439 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:53:55.869200 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:53:55.869161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:53:56.216647 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:53:56.216558 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:55:07.574322 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:55:07.574285 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:55:12.694333 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:55:12.694297 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:55:12.809925 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:55:12.809892 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:56:14.371671 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:56:14.371640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:56:19.504622 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:56:19.504591 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:56:20.005273 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:56:20.005237 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:56:44.285343 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:56:44.285267 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:57:19.145696 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:57:19.145666 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:57:19.150177 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:57:19.150157 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 10:57:21.478035 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:57:21.478006 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:57:26.604576 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:57:26.604541 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:57:26.875764 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:57:26.875674 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:58:57.924619 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:58:57.924588 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:59:02.997164 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:59:02.997125 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:59:03.167743 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:59:03.167701 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:59:34.521188 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:59:34.521111 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:59:34.604439 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:59:34.604411 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 10:59:49.829130 ip-10-0-136-186 kubenswrapper[2581]: I0728 10:59:49.829016 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:00:34.197251 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:00:34.197214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:00:39.289472 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:00:39.289438 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:00:39.408122 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:00:39.408087 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:02:11.627240 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:02:11.627205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:02:15.573000 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:02:15.572966 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:02:16.120379 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:02:16.120351 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:02:18.773129 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:02:18.773062 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:02:19.175893 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:02:19.175866 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:02:19.181144 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:02:19.181121 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:04:00.831120 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:04:00.831089 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:04:00.987210 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:04:00.987178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:04:18.943588 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:04:18.943505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:04:19.017342 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:04:19.017301 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:04:24.084573 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:04:24.084534 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:04:24.224078 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:04:24.224050 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:04:29.169546 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:04:29.169518 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:04:34.313522 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:04:34.313474 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:04:34.471801 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:04:34.471771 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:06:24.548211 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:06:24.548171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:06:29.602488 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:06:29.602454 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:06:29.861977 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:06:29.861889 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:07:19.204294 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:07:19.204268 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:07:19.210208 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:07:19.210187 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:07:59.800891 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:07:59.800857 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:08:04.894498 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:08:04.894428 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:08:05.412798 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:08:05.412754 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:08:35.207561 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:08:35.207524 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:09:33.403444 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:09:33.403403 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:09:35.101792 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:09:35.101753 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:09:40.189338 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:09:40.189299 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:09:40.291766 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:09:40.291733 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:10:55.512427 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:10:55.512396 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:10:55.565888 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:10:55.565827 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:11:11.201371 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:11:11.201331 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:11:16.327333 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:11:16.327298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:11:16.535858 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:11:16.535814 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:12:19.229613 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:12:19.229587 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:12:19.235219 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:12:19.235199 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:12:46.472670 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:12:46.472631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:12:51.553376 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:12:51.553345 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:12:51.694713 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:12:51.694676 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:14:21.774940 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:14:21.774905 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:14:26.812242 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:14:26.812206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:14:26.912023 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:14:26.911989 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:14:28.902567 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:14:28.902534 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:14:33.992607 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:14:33.992573 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:14:34.267646 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:14:34.267560 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:15:42.407816 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:15:42.407782 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:16:04.205134 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:16:04.205098 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:16:09.292010 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:16:09.291961 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:16:09.352960 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:16:09.352928 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:17:09.441993 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:17:09.441956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:17:14.551477 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:17:14.551428 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:17:14.637920 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:17:14.637887 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:17:19.253821 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:17:19.253799 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:17:19.260418 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:17:19.260396 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:17:39.718636 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:17:39.718598 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:17:46.630530 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:17:46.630447 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:17:51.712217 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:17:51.712171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:17:52.205278 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:17:52.205249 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:18:03.154291 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:18:03.154259 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:18:51.840500 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:18:51.840466 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:18:56.940329 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:18:56.940293 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:18:57.167530 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:18:57.167499 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:20:27.290983 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:20:27.290953 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:20:32.323241 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:20:32.323207 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:20:32.707145 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:20:32.707040 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:22:02.616334 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:22:02.616287 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:22:07.688191 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:22:07.688153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:22:07.948849 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:22:07.948769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:22:19.279546 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:22:19.279480 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:22:19.286387 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:22:19.286368 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:22:48.665987 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:22:48.665932 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:22:53.795309 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:22:53.795262 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:22:53.965315 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:22:53.965283 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:23:34.982086 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:23:34.982049 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:23:40.100245 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:23:40.100205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:23:40.382013 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:23:40.381926 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:24:25.346309 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:24:25.346266 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:24:39.214640 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:24:39.214606 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:24:53.379126 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:24:53.379089 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:25:04.678284 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:25:04.678248 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:25:51.687173 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:25:51.687103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:25:56.730056 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:25:56.729990 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:25:56.883227 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:25:56.883198 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:27:19.309809 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:27:19.309707 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:27:19.316764 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:27:19.316745 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:27:36.909380 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:27:36.909349 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:27:41.955620 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:27:41.955562 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:27:42.172271 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:27:42.172236 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:28:32.139914 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:28:32.139831 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:28:37.258002 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:28:37.257971 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:28:37.357944 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:28:37.357909 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:29:27.351136 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:29:27.351103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:29:32.480555 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:29:32.480518 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:29:32.748097 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:29:32.748010 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:30:11.833807 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:30:11.833742 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:30:52.622324 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:30:52.622288 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:30:57.723611 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:30:57.723574 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:30:59.749428 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:30:59.749395 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:31:58.810677 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:31:58.810641 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:32:03.013487 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:32:03.013450 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:32:03.445964 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:32:03.445929 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:32:19.339743 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:32:19.339720 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:32:19.347024 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:32:19.347008 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:32:23.329673 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:32:23.329642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:33:23.149385 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:33:23.149353 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:33:28.261190 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:33:28.261153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:33:28.541828 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:33:28.541757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:33:35.919711 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:33:35.919680 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:33:35.979479 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:33:35.979453 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:34:58.485700 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:34:58.485663 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:34:58.600216 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:34:58.600186 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:34:58.924925 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:34:58.924887 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:28.654455 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:36:28.654426 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:30.177317 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:36:30.177284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:39.739367 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:36:39.739336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:40.804884 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:36:40.804842 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:41.260503 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:36:41.260469 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:37:01.766593 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:37:01.766559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:37:19.366979 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:37:19.366864 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:37:19.375679 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:37:19.375659 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:37:34.230049 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:37:34.229997 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:00.906166 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:38:00.906130 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:01.927310 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:38:01.927278 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:02.376439 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:38:02.376406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:11.975402 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:38:11.975372 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:13.033236 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:38:13.033205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:13.370106 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:38:13.370057 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:33.147968 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:39:33.147930 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:34.158427 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:39:34.158395 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:34.294711 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:39:34.294667 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:44.233553 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:39:44.233516 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:46.543556 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:39:46.543526 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:46.642514 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:39:46.642479 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:40:21.536363 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:21.536272 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:40:21.694409 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:21.694376 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:40:21.759472 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:21.759428 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:40:24.432284 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:24.432248 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tv5ff_a49fdd3c-8942-4b34-a2f5-beb39b296bb9/global-pull-secret-syncer/0.log" Jul 28 11:40:24.558590 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:24.558558 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" Jul 28 11:40:24.730541 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:24.730465 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-186.ec2.internal_f7ad5f76fc6bb2a29bad07b46c5e652c/haproxy/0.log" Jul 28 11:40:27.399940 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:27.399908 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:40:27.496043 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:27.496015 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdxf8_95b130cc-7b4b-41a0-8143-ccc92ef18bea/konnectivity-agent/0.log" limit=1024 Jul 28 11:40:29.246658 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.246636 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7122bb6e-7960-4aac-9619-97ed8caa21fc/alertmanager/0.log" Jul 28 11:40:29.275846 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.275816 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7122bb6e-7960-4aac-9619-97ed8caa21fc/config-reloader/0.log" Jul 28 11:40:29.299481 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.299451 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7122bb6e-7960-4aac-9619-97ed8caa21fc/kube-rbac-proxy-web/0.log" Jul 28 11:40:29.323963 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.323927 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7122bb6e-7960-4aac-9619-97ed8caa21fc/kube-rbac-proxy/0.log" Jul 28 11:40:29.348970 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.348945 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7122bb6e-7960-4aac-9619-97ed8caa21fc/kube-rbac-proxy-metric/0.log" Jul 28 11:40:29.382384 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.382354 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7122bb6e-7960-4aac-9619-97ed8caa21fc/prom-label-proxy/0.log" Jul 28 11:40:29.408737 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.408714 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7122bb6e-7960-4aac-9619-97ed8caa21fc/init-config-reloader/0.log" Jul 28 11:40:29.482665 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.482640 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-m8tpq_b7fd4d10-960c-470d-8ae0-52a07718b393/kube-state-metrics/0.log" Jul 28 11:40:29.506575 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.506499 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-m8tpq_b7fd4d10-960c-470d-8ae0-52a07718b393/kube-rbac-proxy-main/0.log" Jul 28 11:40:29.531171 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.531142 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-m8tpq_b7fd4d10-960c-470d-8ae0-52a07718b393/kube-rbac-proxy-self/0.log" Jul 28 11:40:29.721566 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.721535 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gbjnn_7e67cea0-f5af-4417-bb50-b556d9bdf9e7/node-exporter/0.log" Jul 28 11:40:29.748531 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.748502 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gbjnn_7e67cea0-f5af-4417-bb50-b556d9bdf9e7/kube-rbac-proxy/0.log" Jul 28 11:40:29.774164 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.774064 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gbjnn_7e67cea0-f5af-4417-bb50-b556d9bdf9e7/init-textfile/0.log" Jul 28 11:40:29.908612 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.908583 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-nq489_cf6529b1-8178-49a4-8417-6c069e3b0ae8/kube-rbac-proxy-main/0.log" Jul 28 11:40:29.930803 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.930777 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-nq489_cf6529b1-8178-49a4-8417-6c069e3b0ae8/kube-rbac-proxy-self/0.log" Jul 28 11:40:29.954136 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:29.954108 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-nq489_cf6529b1-8178-49a4-8417-6c069e3b0ae8/openshift-state-metrics/0.log" Jul 28 11:40:30.318658 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:30.318631 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d4f958555-g2mhk_c734dab6-52f0-4caf-915e-1522cb4c9a27/telemeter-client/0.log" Jul 28 11:40:30.343013 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:30.342989 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d4f958555-g2mhk_c734dab6-52f0-4caf-915e-1522cb4c9a27/reload/0.log" Jul 28 11:40:30.382883 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:30.382851 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d4f958555-g2mhk_c734dab6-52f0-4caf-915e-1522cb4c9a27/kube-rbac-proxy/0.log" Jul 28 11:40:32.670902 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.670872 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b4978674d-sd9fk_d7235b0c-8f98-4c8a-b980-4c46006514a7/console/0.log" Jul 28 11:40:32.985005 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.984917 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd"] Jul 28 11:40:32.985275 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.985263 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" Jul 28 11:40:32.985318 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.985277 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" Jul 28 11:40:32.985318 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.985300 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kube-rbac-proxy" Jul 28 11:40:32.985318 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.985306 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kube-rbac-proxy" Jul 28 11:40:32.985318 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.985312 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="storage-initializer" Jul 28 11:40:32.985318 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.985318 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="storage-initializer" Jul 28 11:40:32.985485 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.985362 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kube-rbac-proxy" Jul 28 11:40:32.985485 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.985372 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1e13dcb-bd82-437f-b92d-52cfd9637dd7" containerName="kserve-container" Jul 28 11:40:32.989315 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.989296 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:32.992199 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.992169 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x6kqb\"/\"openshift-service-ca.crt\"" Jul 28 11:40:32.993277 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.993258 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x6kqb\"/\"default-dockercfg-26d66\"" Jul 28 11:40:32.993388 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.993278 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x6kqb\"/\"kube-root-ca.crt\"" Jul 28 11:40:32.997635 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:32.997607 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd"] Jul 28 11:40:33.145445 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.145406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8c064b7-98f0-416b-8419-648b2651dcd8-proc\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.145445 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.145450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8c064b7-98f0-416b-8419-648b2651dcd8-lib-modules\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.145715 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.145470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8c064b7-98f0-416b-8419-648b2651dcd8-sys\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.145715 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.145498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcf7m\" (UniqueName: \"kubernetes.io/projected/c8c064b7-98f0-416b-8419-648b2651dcd8-kube-api-access-jcf7m\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.145715 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.145609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8c064b7-98f0-416b-8419-648b2651dcd8-podres\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.246569 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.246469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8c064b7-98f0-416b-8419-648b2651dcd8-lib-modules\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.246569 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.246514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8c064b7-98f0-416b-8419-648b2651dcd8-sys\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.246801 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.246549 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcf7m\" (UniqueName: \"kubernetes.io/projected/c8c064b7-98f0-416b-8419-648b2651dcd8-kube-api-access-jcf7m\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.246801 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.246622 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8c064b7-98f0-416b-8419-648b2651dcd8-sys\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.246801 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.246647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8c064b7-98f0-416b-8419-648b2651dcd8-podres\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.246801 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.246651 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8c064b7-98f0-416b-8419-648b2651dcd8-lib-modules\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.246801 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.246734 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8c064b7-98f0-416b-8419-648b2651dcd8-podres\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.246801 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.246735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8c064b7-98f0-416b-8419-648b2651dcd8-proc\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.246801 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.246762 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8c064b7-98f0-416b-8419-648b2651dcd8-proc\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.256482 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.256458 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcf7m\" (UniqueName: \"kubernetes.io/projected/c8c064b7-98f0-416b-8419-648b2651dcd8-kube-api-access-jcf7m\") pod \"perf-node-gather-daemonset-5lwhd\" (UID: \"c8c064b7-98f0-416b-8419-648b2651dcd8\") " pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.300357 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.300319 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:33.451817 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.451787 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd"] Jul 28 11:40:33.453493 ip-10-0-136-186 kubenswrapper[2581]: W0728 11:40:33.453463 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc8c064b7_98f0_416b_8419_648b2651dcd8.slice/crio-922d5b41284e2cb5db0ed72022b1447dfdb48a01735d80baf3facecdf7f38c6f WatchSource:0}: Error finding container 922d5b41284e2cb5db0ed72022b1447dfdb48a01735d80baf3facecdf7f38c6f: Status 404 returned error can't find the container with id 922d5b41284e2cb5db0ed72022b1447dfdb48a01735d80baf3facecdf7f38c6f Jul 28 11:40:33.563495 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:33.563464 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" event={"ID":"c8c064b7-98f0-416b-8419-648b2651dcd8","Type":"ContainerStarted","Data":"922d5b41284e2cb5db0ed72022b1447dfdb48a01735d80baf3facecdf7f38c6f"} Jul 28 11:40:34.267407 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:34.267378 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6sl84_a3f4bdab-e366-421f-a0eb-bb498143954c/dns/0.log" Jul 28 11:40:34.290601 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:34.290575 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6sl84_a3f4bdab-e366-421f-a0eb-bb498143954c/kube-rbac-proxy/0.log" Jul 28 11:40:34.421592 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:34.421556 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7gbnk_488696f4-3639-4b94-abca-a88c17c72588/dns-node-resolver/0.log" Jul 28 11:40:34.569388 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:34.569358 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" event={"ID":"c8c064b7-98f0-416b-8419-648b2651dcd8","Type":"ContainerStarted","Data":"2b57272b0a0f480810fe29af73f6bf167545ddd999a13e56038435bafcfd7e2a"} Jul 28 11:40:34.569560 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:34.569426 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:34.590936 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:34.590887 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" podStartSLOduration=2.59087315 podStartE2EDuration="2.59087315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:40:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:40:34.590054642 +0000 UTC m=+5596.069036441" watchObservedRunningTime="2026-07-28 11:40:34.59087315 +0000 UTC m=+5596.069854944" Jul 28 11:40:34.994255 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:34.994181 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67465d648c-m6fwh_09085ea3-8b04-4a8d-8576-d58729e3c034/registry/0.log" Jul 28 11:40:35.019181 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:35.019161 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8p2v9_8d8e7605-36e7-486f-9a1f-b95586176254/node-ca/0.log" Jul 28 11:40:36.206530 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:36.206503 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vg5dj_7eeecf65-f709-42ed-a7c6-ada08c662150/serve-healthcheck-canary/0.log" Jul 28 11:40:36.737295 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:36.737267 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p9hm6_2cd88b08-3aff-4728-b870-5a9c6dd330bf/kube-rbac-proxy/0.log" Jul 28 11:40:36.759182 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:36.759157 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p9hm6_2cd88b08-3aff-4728-b870-5a9c6dd330bf/exporter/0.log" Jul 28 11:40:36.780095 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:36.780061 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p9hm6_2cd88b08-3aff-4728-b870-5a9c6dd330bf/extractor/0.log" Jul 28 11:40:39.032127 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:39.032098 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-6968749498-6d7w4_ba20ba0c-0706-40e8-b2ef-0f41e1058b92/manager/0.log" Jul 28 11:40:39.060218 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:39.060191 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-d9lxr_45608ce3-8940-40e6-8253-eaf58049deb8/manager/0.log" Jul 28 11:40:39.083233 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:39.083205 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-rmqrp_d9bb375b-1db7-4600-818e-49e8667d66ad/server/0.log" Jul 28 11:40:39.356453 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:39.356419 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-75d9cdbddf-69npt_adc29a75-3f96-4e73-babc-72c6f9542c2d/manager/0.log" Jul 28 11:40:40.583250 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:40.583222 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x6kqb/perf-node-gather-daemonset-5lwhd" Jul 28 11:40:45.289628 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:45.289593 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbtpg_33984ebc-8151-4863-9248-fa23ffcbfb0b/kube-multus-additional-cni-plugins/0.log" Jul 28 11:40:45.313573 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:45.313543 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbtpg_33984ebc-8151-4863-9248-fa23ffcbfb0b/egress-router-binary-copy/0.log" Jul 28 11:40:45.337060 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:45.336999 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbtpg_33984ebc-8151-4863-9248-fa23ffcbfb0b/cni-plugins/0.log" Jul 28 11:40:45.361118 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:45.361093 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbtpg_33984ebc-8151-4863-9248-fa23ffcbfb0b/bond-cni-plugin/0.log" Jul 28 11:40:45.385948 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:45.385922 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbtpg_33984ebc-8151-4863-9248-fa23ffcbfb0b/routeoverride-cni/0.log" Jul 28 11:40:45.408711 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:45.408684 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbtpg_33984ebc-8151-4863-9248-fa23ffcbfb0b/whereabouts-cni-bincopy/0.log" Jul 28 11:40:45.431734 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:45.431705 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbtpg_33984ebc-8151-4863-9248-fa23ffcbfb0b/whereabouts-cni/0.log" Jul 28 11:40:45.550175 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:45.550098 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-td4fh_b53e26e8-d2a5-43e4-acc4-e8f34cff1ee4/kube-multus/0.log" Jul 28 11:40:45.666721 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:45.666694 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hl7rm_432b3c8f-7b69-4d45-97c3-d317cca6324d/network-metrics-daemon/0.log" Jul 28 11:40:45.687387 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:45.687364 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hl7rm_432b3c8f-7b69-4d45-97c3-d317cca6324d/kube-rbac-proxy/0.log" Jul 28 11:40:46.437201 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:46.437172 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-controller/0.log" Jul 28 11:40:46.456834 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:46.456803 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/1.log" Jul 28 11:40:46.456834 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:46.456811 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovn-acl-logging/0.log" Jul 28 11:40:46.473672 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:46.473648 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/kube-rbac-proxy-node/0.log" Jul 28 11:40:46.496757 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:46.496711 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 11:40:46.522552 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:46.522526 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/northd/0.log" Jul 28 11:40:46.543020 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:46.542993 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/nbdb/0.log" Jul 28 11:40:46.565267 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:46.565239 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/sbdb/0.log" Jul 28 11:40:46.609698 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:46.609659 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jn2ms_727eae60-6bdf-4598-ab23-75bec23683bf/ovnkube-controller/0.log" Jul 28 11:40:48.217243 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:48.217210 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dp9sg_377ae0ee-6c31-4912-aa8a-4a65119deb04/network-check-target-container/0.log" Jul 28 11:40:49.226294 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:49.226214 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-qhb8h_77bc183c-bac2-4e26-8356-039d8839f076/iptables-alerter/0.log" Jul 28 11:40:49.834637 ip-10-0-136-186 kubenswrapper[2581]: I0728 11:40:49.834612 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-94hhv_7fc3ff78-e93e-496f-9d82-3ec4c9410d93/tuned/0.log"