Jun 07 08:01:57.942411 ip-10-0-142-99 systemd[1]: Starting Kubernetes Kubelet... Jun 07 08:01:58.379063 ip-10-0-142-99 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 08:01:58.379063 ip-10-0-142-99 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 07 08:01:58.379063 ip-10-0-142-99 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 08:01:58.379063 ip-10-0-142-99 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 07 08:01:58.379063 ip-10-0-142-99 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 08:01:58.380380 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.380292 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 07 08:01:58.386300 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386285 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 08:01:58.386300 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386300 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386304 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386308 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386311 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386315 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386318 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386321 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386323 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386326 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386329 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386331 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386334 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386337 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386339 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386343 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386346 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386349 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386352 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386355 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386357 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386360 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 08:01:58.386366 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386363 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386365 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386368 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386372 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386374 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386377 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386381 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386383 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386386 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386388 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386391 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386394 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386396 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386399 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386402 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386405 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386407 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386410 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386412 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 08:01:58.386857 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386415 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386417 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386420 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386423 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386425 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386428 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386430 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386433 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386435 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386437 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386440 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386442 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386445 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386448 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386451 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386455 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386458 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386461 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386463 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386466 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 08:01:58.387324 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386469 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386471 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386475 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386477 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386480 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386482 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386485 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386487 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386490 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386495 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386499 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386502 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386505 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386508 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386511 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386514 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386516 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386519 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386521 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 08:01:58.387805 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386524 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386526 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386529 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386531 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386534 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386537 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386539 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386544 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386550 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386554 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386558 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386561 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386564 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386567 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386569 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386572 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386575 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386577 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.386580 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 08:01:58.388282 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387342 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387349 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387353 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387356 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387359 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387363 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387365 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387368 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387371 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387374 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387376 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387379 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387382 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387384 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387387 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387389 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387392 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387394 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387397 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387400 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 08:01:58.388775 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387402 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387406 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387409 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387413 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387417 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387420 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387423 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387426 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387428 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387431 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387434 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387436 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387439 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387442 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387444 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387447 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387449 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387452 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387455 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387457 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 08:01:58.389283 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387460 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387462 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387465 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387468 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387471 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387474 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387477 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387479 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387482 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387485 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387487 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387490 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387492 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387496 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387499 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387502 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387504 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387507 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387509 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387512 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 08:01:58.389768 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387515 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387517 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387520 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387523 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387525 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387528 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387530 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387533 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387536 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387538 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387541 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387544 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387547 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387549 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387552 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387554 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387557 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387559 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387562 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387565 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 08:01:58.390259 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387567 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387570 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387572 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387575 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387578 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387582 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387588 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387592 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387595 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387598 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387600 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387603 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387606 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387609 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387611 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387615 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387619 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387622 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.387625 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 08:01:58.390745 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388049 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388054 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388058 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388061 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388068 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388071 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388074 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388076 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388079 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388082 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388084 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388087 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388090 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388092 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388095 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388113 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388119 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388123 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388128 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 08:01:58.391227 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388134 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388138 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388141 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388144 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388147 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388150 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388153 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388156 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388158 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388161 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388164 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388166 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388169 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388172 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388174 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388177 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388180 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388182 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388186 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388190 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 08:01:58.391691 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388193 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388196 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388199 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388201 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388205 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388207 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388210 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388212 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388215 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388218 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388220 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388223 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388227 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388229 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388232 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388235 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388237 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388240 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388242 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388245 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 08:01:58.392207 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388247 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388250 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388252 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388255 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388257 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388260 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388262 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388265 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388267 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388270 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388282 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388287 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388290 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388293 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388296 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388298 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388301 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388304 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388306 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 08:01:58.392713 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388309 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388312 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388315 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388317 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388320 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388323 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388325 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388328 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388331 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388333 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388337 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388340 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388342 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388345 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388348 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388350 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388353 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388355 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388358 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388361 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.388363 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 08:01:58.393197 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388438 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388446 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388451 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388455 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388460 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388464 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388468 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388473 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388476 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388479 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388483 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388486 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388490 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388493 2559 flags.go:64] FLAG: --cgroup-root="" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388496 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388499 2559 flags.go:64] FLAG: --client-ca-file="" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388503 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388506 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388511 2559 flags.go:64] FLAG: --cluster-domain="" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388514 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388517 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388520 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388524 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388528 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 07 08:01:58.393730 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388531 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388534 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388537 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388541 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388544 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388546 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388550 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388553 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388557 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388560 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388562 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388565 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388568 2559 flags.go:64] FLAG: --enable-server="true" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388574 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388579 2559 flags.go:64] FLAG: --event-burst="100" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388582 2559 flags.go:64] FLAG: --event-qps="50" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388585 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388588 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388591 2559 flags.go:64] FLAG: --eviction-hard="" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388594 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388598 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388601 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388605 2559 flags.go:64] FLAG: --eviction-soft="" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388607 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388610 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 07 08:01:58.394317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388613 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388616 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388619 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388622 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388625 2559 flags.go:64] FLAG: --feature-gates="" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388629 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388632 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388635 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388638 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388641 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388644 2559 flags.go:64] FLAG: --help="false" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388647 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388650 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388653 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388656 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388660 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388663 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388666 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388668 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388671 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388674 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388678 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388681 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388683 2559 flags.go:64] FLAG: --kube-reserved="" Jun 07 08:01:58.394937 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388686 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388689 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388692 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388695 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388698 2559 flags.go:64] FLAG: --lock-file="" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388701 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388704 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388707 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388712 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388715 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388718 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388721 2559 flags.go:64] FLAG: --logging-format="text" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388724 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388727 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388730 2559 flags.go:64] FLAG: --manifest-url="" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388733 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388737 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388740 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388745 2559 flags.go:64] FLAG: --max-pods="110" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388748 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388751 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388754 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388757 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388760 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388763 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 07 08:01:58.395553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388766 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388773 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388777 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388780 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388783 2559 flags.go:64] FLAG: --pod-cidr="" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388786 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388792 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388795 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388799 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388802 2559 flags.go:64] FLAG: --port="10250" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388805 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388808 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08ac5a7449576a954" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388811 2559 flags.go:64] FLAG: --qos-reserved="" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388814 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388817 2559 flags.go:64] FLAG: --register-node="true" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388819 2559 flags.go:64] FLAG: --register-with-taints="" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388823 2559 flags.go:64] FLAG: --registry-burst="10" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388826 2559 flags.go:64] FLAG: --registry-qps="5" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388829 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388831 2559 flags.go:64] FLAG: --reserved-memory="" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388835 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388838 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388841 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388844 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388847 2559 flags.go:64] FLAG: --runonce="false" Jun 07 08:01:58.396192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388850 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388853 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388856 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388858 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388861 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388864 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388867 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388870 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388873 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388876 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388879 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388882 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388885 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388888 2559 flags.go:64] FLAG: --system-cgroups="" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388891 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388896 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388899 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388902 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388910 2559 flags.go:64] FLAG: --tls-min-version="" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388913 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388916 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388919 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388922 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388925 2559 flags.go:64] FLAG: --v="2" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388929 2559 flags.go:64] FLAG: --version="false" Jun 07 08:01:58.396809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388933 2559 flags.go:64] FLAG: --vmodule="" Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388937 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.388940 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389081 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389086 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389089 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389092 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389096 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389119 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389122 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389126 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389129 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389132 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389135 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389137 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389140 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389143 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389146 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389148 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389151 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 08:01:58.397457 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389154 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389157 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389160 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389162 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389165 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389169 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389172 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389176 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389179 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389182 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389185 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389188 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389191 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389194 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389196 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389199 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389203 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389206 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389209 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389211 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 08:01:58.397931 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389214 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389217 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389219 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389222 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389225 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389227 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389230 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389233 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389235 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389238 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389240 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389243 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389246 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389248 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389251 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389254 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389257 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389261 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389264 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 08:01:58.398439 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389267 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389269 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389272 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389275 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389277 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389280 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389283 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389285 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389288 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389293 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389295 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389299 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389301 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389304 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389307 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389309 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389312 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389314 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389317 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389320 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 08:01:58.398933 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389322 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389325 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389329 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389333 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389336 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389338 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389341 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389344 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389347 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389349 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389353 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389356 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389359 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389361 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389364 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389366 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389369 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389372 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389374 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389377 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 08:01:58.399492 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389380 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389384 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.389388 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.390318 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.397481 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.397499 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.397519 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.397525 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397597 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397602 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397605 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397608 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397612 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397615 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 08:01:58.400337 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397617 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397620 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397623 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397626 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397628 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397631 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397633 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397636 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397639 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397641 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397644 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397646 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397649 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397652 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397655 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397657 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397660 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397662 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397665 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397668 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 08:01:58.400697 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397670 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397673 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397675 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397686 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397691 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397695 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397698 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397700 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397703 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397706 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397708 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397711 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397714 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397716 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397719 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397721 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397724 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397726 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397729 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 08:01:58.401428 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397731 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397734 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397737 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397739 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397742 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397745 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397747 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397750 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397752 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397755 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397757 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397760 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397762 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397765 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397767 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397770 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397773 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397781 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397784 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397787 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 08:01:58.401902 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397789 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397792 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397795 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397797 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397800 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397802 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397805 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397807 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397810 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397812 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397815 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397817 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397821 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397825 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397827 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397830 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397833 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397837 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397840 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 08:01:58.402419 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397843 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397845 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397848 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397851 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397853 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397856 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397858 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397861 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397864 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397867 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397870 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397878 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397881 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397884 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.397886 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 08:01:58.402880 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.397891 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398047 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398053 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398056 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398058 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398061 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398064 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398067 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398070 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398073 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398075 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398078 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398080 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398083 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398086 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398088 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398091 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398093 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398096 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398114 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 08:01:58.403335 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398118 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398121 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398123 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398126 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398129 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398131 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398134 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398137 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398139 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398148 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398151 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398153 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398155 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398158 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398161 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398163 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398166 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398168 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398171 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398173 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 08:01:58.403870 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398176 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398178 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398181 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398183 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398186 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398190 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398193 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398196 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398199 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398202 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398205 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398207 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398210 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398212 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398215 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398218 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398220 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398223 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398226 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 08:01:58.404381 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398228 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398231 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398233 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398242 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398246 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398248 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398251 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398254 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398256 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398259 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398261 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398264 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398266 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398269 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398271 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398274 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398276 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398279 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398281 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398284 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 08:01:58.404845 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398286 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398289 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398291 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398294 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398297 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398299 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398302 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398305 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398309 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398312 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398315 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398318 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398320 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398323 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398325 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398328 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398337 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398340 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398342 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 08:01:58.405477 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398345 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 08:01:58.405924 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:58.398347 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 08:01:58.405924 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.398352 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 08:01:58.405924 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.398475 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 07 08:01:58.405924 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.403401 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 07 08:01:58.405924 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.404823 2559 server.go:1019] "Starting client certificate rotation" Jun 07 08:01:58.405924 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.404931 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 08:01:58.405924 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.404975 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 08:01:58.407341 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.407329 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 08:01:58.408510 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.408489 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 08:01:58.424644 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.424624 2559 log.go:25] "Validated CRI v1 runtime API" Jun 07 08:01:58.427305 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.427293 2559 log.go:25] "Validated CRI v1 image API" Jun 07 08:01:58.428148 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.428132 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 07 08:01:58.432938 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.432897 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9be216f4-b22c-4ec9-83c0-7a4a00368eb1:/dev/nvme0n1p4 dc301795-a2c5-4dbd-85ab-9da0d48f64b9:/dev/nvme0n1p3] Jun 07 08:01:58.432938 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.432931 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 08:01:58.433052 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.432935 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 07 08:01:58.438474 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.438360 2559 manager.go:216] Machine: {Timestamp:2026-06-07 08:01:58.437146917 +0000 UTC m=+0.371427995 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095272 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2070287140a3e64736d57bc8e1648e SystemUUID:ec207028-7140-a3e6-4736-d57bc8e1648e BootID:f74a1e12-9365-423c-b5cc-58f637c05cc6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ea:e1:66:7b:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ea:e1:66:7b:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:97:76:76:64:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 07 08:01:58.438474 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.438470 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 07 08:01:58.438593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.438548 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 07 08:01:58.441805 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.441778 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 07 08:01:58.441976 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.441806 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-99.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 07 08:01:58.442695 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.442686 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 07 08:01:58.442726 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.442698 2559 container_manager_linux.go:309] "Creating device plugin manager" Jun 07 08:01:58.442726 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.442706 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 08:01:58.443695 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.443685 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 08:01:58.444707 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.444698 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 07 08:01:58.447792 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.447782 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 07 08:01:58.447896 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.447887 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 07 08:01:58.447930 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.447926 2559 kubelet.go:486] "Attempting to sync node with API server" Jun 07 08:01:58.447959 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.447944 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 07 08:01:58.447959 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.447954 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 07 08:01:58.448021 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.447963 2559 kubelet.go:398] "Adding apiserver pod source" Jun 07 08:01:58.448021 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.447971 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 07 08:01:58.448554 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.448538 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 08:01:58.448632 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.448563 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 08:01:58.451904 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.451784 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 07 08:01:58.453673 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.453658 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 07 08:01:58.453735 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.453688 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 07 08:01:58.455578 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.455564 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 07 08:01:58.455633 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.455584 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 07 08:01:58.455633 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.455591 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 07 08:01:58.455633 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.455596 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 07 08:01:58.455633 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.455605 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 07 08:01:58.455633 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.455611 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 07 08:01:58.455633 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.455618 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 07 08:01:58.455633 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.455623 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 07 08:01:58.455817 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.455659 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 07 08:01:58.455817 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.455666 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 07 08:01:58.455817 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.455675 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 07 08:01:58.455817 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.455681 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 07 08:01:58.456706 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.456696 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 07 08:01:58.456706 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.456706 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 07 08:01:58.459018 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.458999 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-99.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 07 08:01:58.459091 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.459013 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 07 08:01:58.459091 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.459036 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 07 08:01:58.459823 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.459812 2559 server.go:1268] "Started kubelet" Jun 07 08:01:58.459936 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.459895 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 07 08:01:58.459936 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.459885 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 07 08:01:58.460059 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.459951 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 07 08:01:58.460667 ip-10-0-142-99 systemd[1]: Started Kubernetes Kubelet. Jun 07 08:01:58.461308 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.461151 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qw55g" Jun 07 08:01:58.461457 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.461408 2559 server.go:310] "Adding debug handlers to kubelet server" Jun 07 08:01:58.461582 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.461556 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 07 08:01:58.468046 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.468025 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 07 08:01:58.468442 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.468427 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 07 08:01:58.468442 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.468436 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 07 08:01:58.468614 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.468583 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:58.468670 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.468619 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qw55g" Jun 07 08:01:58.469150 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.469127 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 07 08:01:58.469150 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.469130 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 07 08:01:58.469150 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.469151 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 07 08:01:58.469491 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.467988 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-99.ec2.internal.18b6bdbc25f2e424 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-99.ec2.internal,UID:ip-10-0-142-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-99.ec2.internal,},FirstTimestamp:2026-06-07 08:01:58.459786276 +0000 UTC m=+0.394067355,LastTimestamp:2026-06-07 08:01:58.459786276 +0000 UTC m=+0.394067355,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-99.ec2.internal,}" Jun 07 08:01:58.469491 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.469449 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 07 08:01:58.469491 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.469459 2559 reconciler.go:29] "Reconciler: start to sync state" Jun 07 08:01:58.470068 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.470051 2559 factory.go:55] Registering systemd factory Jun 07 08:01:58.470068 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.470070 2559 factory.go:223] Registration of the systemd container factory successfully Jun 07 08:01:58.470364 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.470332 2559 factory.go:153] Registering CRI-O factory Jun 07 08:01:58.470364 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.470357 2559 factory.go:223] Registration of the crio container factory successfully Jun 07 08:01:58.470490 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.470442 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 07 08:01:58.470490 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.470473 2559 factory.go:103] Registering Raw factory Jun 07 08:01:58.470590 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.470494 2559 manager.go:1196] Started watching for new ooms in manager Jun 07 08:01:58.470879 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.470863 2559 manager.go:349] Starting recovery of all containers Jun 07 08:01:58.474556 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.474535 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 08:01:58.479498 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.479279 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-99.ec2.internal\" not found" node="ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.481905 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.481888 2559 manager.go:354] Recovery completed Jun 07 08:01:58.485927 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.485915 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 08:01:58.487888 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.487874 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientMemory" Jun 07 08:01:58.487955 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.487901 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 08:01:58.487955 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.487911 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientPID" Jun 07 08:01:58.488413 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.488401 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 08:01:58.488485 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.488404 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 07 08:01:58.488485 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.488445 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 07 08:01:58.488485 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.488461 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 07 08:01:58.489187 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.489170 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientMemory" Jun 07 08:01:58.489257 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.489201 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 08:01:58.489257 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.489217 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientPID" Jun 07 08:01:58.489648 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.489636 2559 policy_none.go:49] "None policy: Start" Jun 07 08:01:58.489685 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.489652 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 07 08:01:58.489685 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.489661 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 07 08:01:58.490596 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.490585 2559 policy_none.go:47] "Start" Jun 07 08:01:58.532054 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.531613 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 07 08:01:58.532674 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.532659 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 07 08:01:58.532723 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.532699 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 07 08:01:58.532723 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.532721 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jun 07 08:01:58.532786 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.532755 2559 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 07 08:01:58.533746 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.533732 2559 manager.go:337] "Starting Device Plugin manager" Jun 07 08:01:58.533827 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.533759 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 07 08:01:58.533827 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.533773 2559 server.go:87] "Starting device plugin registration server" Jun 07 08:01:58.534024 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.534011 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 07 08:01:58.534076 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.534027 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 07 08:01:58.534138 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.534091 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 07 08:01:58.534195 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.534183 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 07 08:01:58.534195 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.534192 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 07 08:01:58.534822 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.534734 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 08:01:58.534822 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.534748 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 07 08:01:58.534822 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.534796 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:58.633755 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.633672 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-99.ec2.internal"] Jun 07 08:01:58.633839 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.633757 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 08:01:58.635013 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.634989 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 08:01:58.636224 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.636210 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientMemory" Jun 07 08:01:58.636286 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.636236 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 08:01:58.636286 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.636247 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientPID" Jun 07 08:01:58.636997 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.636287 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.637244 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.637229 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientMemory" Jun 07 08:01:58.637327 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.637259 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 08:01:58.637327 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.637274 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientPID" Jun 07 08:01:58.638571 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.638556 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 08:01:58.638675 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.638660 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.638718 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.638691 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 08:01:58.640341 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.640316 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientMemory" Jun 07 08:01:58.640341 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.640322 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientMemory" Jun 07 08:01:58.640341 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.640342 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 08:01:58.640488 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.640345 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 08:01:58.640488 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.640375 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientPID" Jun 07 08:01:58.640488 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.640357 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientPID" Jun 07 08:01:58.641539 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.641526 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.641580 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.641548 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 08:01:58.642232 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.642213 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientMemory" Jun 07 08:01:58.642315 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.642238 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 08:01:58.642315 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.642253 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeHasSufficientPID" Jun 07 08:01:58.645980 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.645965 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.646048 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.645989 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-99.ec2.internal\": node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:58.666028 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.666009 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:58.674692 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.674672 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-99.ec2.internal\" not found" node="ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.679088 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.679074 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-99.ec2.internal\" not found" node="ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.766933 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.766917 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:58.770550 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.770537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f189a601c7bde0338de8e3692a36734-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal\" (UID: \"0f189a601c7bde0338de8e3692a36734\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.770597 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.770560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3aa9dc2982fae84a7139add606c8bc21-config\") pod \"kube-apiserver-proxy-ip-10-0-142-99.ec2.internal\" (UID: \"3aa9dc2982fae84a7139add606c8bc21\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.770597 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.770577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f189a601c7bde0338de8e3692a36734-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal\" (UID: \"0f189a601c7bde0338de8e3692a36734\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.867427 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.867381 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:58.871727 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.871710 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f189a601c7bde0338de8e3692a36734-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal\" (UID: \"0f189a601c7bde0338de8e3692a36734\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.871783 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.871737 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3aa9dc2982fae84a7139add606c8bc21-config\") pod \"kube-apiserver-proxy-ip-10-0-142-99.ec2.internal\" (UID: \"3aa9dc2982fae84a7139add606c8bc21\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.871783 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.871775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f189a601c7bde0338de8e3692a36734-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal\" (UID: \"0f189a601c7bde0338de8e3692a36734\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.871848 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.871818 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f189a601c7bde0338de8e3692a36734-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal\" (UID: \"0f189a601c7bde0338de8e3692a36734\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.871880 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.871820 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3aa9dc2982fae84a7139add606c8bc21-config\") pod \"kube-apiserver-proxy-ip-10-0-142-99.ec2.internal\" (UID: \"3aa9dc2982fae84a7139add606c8bc21\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.871880 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.871822 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f189a601c7bde0338de8e3692a36734-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal\" (UID: \"0f189a601c7bde0338de8e3692a36734\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.968174 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:58.968090 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:58.978489 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.978466 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" Jun 07 08:01:58.983296 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:58.983281 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-99.ec2.internal" Jun 07 08:01:59.069052 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:59.069018 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:59.169463 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:59.169435 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:59.269853 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:59.269796 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:59.370266 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:59.370235 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:59.404568 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.404538 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 07 08:01:59.405066 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.404691 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 08:01:59.405066 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.404697 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 08:01:59.470618 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:59.470592 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:59.471848 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.471817 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-06 07:56:58 +0000 UTC" deadline="2028-03-15 00:52:42.469917496 +0000 UTC" Jun 07 08:01:59.471899 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.471849 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15520h50m42.998071973s" Jun 07 08:01:59.520076 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:59.520012 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa9dc2982fae84a7139add606c8bc21.slice/crio-c854fa3abd75f26288182702fabc53e2f91faec559daa20f7cca4b95adca781a WatchSource:0}: Error finding container c854fa3abd75f26288182702fabc53e2f91faec559daa20f7cca4b95adca781a: Status 404 returned error can't find the container with id c854fa3abd75f26288182702fabc53e2f91faec559daa20f7cca4b95adca781a Jun 07 08:01:59.520532 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:01:59.520508 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f189a601c7bde0338de8e3692a36734.slice/crio-843eab1348baa52400fa938592413594eff45cc55cda73a7b2dbd01844fd45ea WatchSource:0}: Error finding container 843eab1348baa52400fa938592413594eff45cc55cda73a7b2dbd01844fd45ea: Status 404 returned error can't find the container with id 843eab1348baa52400fa938592413594eff45cc55cda73a7b2dbd01844fd45ea Jun 07 08:01:59.525380 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.525362 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 08:01:59.536285 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.536231 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-99.ec2.internal" event={"ID":"3aa9dc2982fae84a7139add606c8bc21","Type":"ContainerStarted","Data":"c854fa3abd75f26288182702fabc53e2f91faec559daa20f7cca4b95adca781a"} Jun 07 08:01:59.537184 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.537165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" event={"ID":"0f189a601c7bde0338de8e3692a36734","Type":"ContainerStarted","Data":"843eab1348baa52400fa938592413594eff45cc55cda73a7b2dbd01844fd45ea"} Jun 07 08:01:59.571493 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:59.571459 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:59.671943 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:59.671919 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:59.772445 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:59.772373 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:59.872920 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:01:59.872885 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-99.ec2.internal\" not found" Jun 07 08:01:59.922554 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.922530 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 08:01:59.969660 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.969620 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" Jun 07 08:01:59.980132 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.980096 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 08:01:59.982071 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.982049 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-99.ec2.internal" Jun 07 08:01:59.990271 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:01:59.990247 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 08:02:00.056283 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.056204 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 08:02:00.449422 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.449342 2559 apiserver.go:52] "Watching apiserver" Jun 07 08:02:00.460431 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.460403 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 07 08:02:00.461724 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.461687 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-txfv9","openshift-network-operator/iptables-alerter-xzp2s","kube-system/global-pull-secret-syncer-nj4q2","kube-system/kube-apiserver-proxy-ip-10-0-142-99.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mnk2w","openshift-dns/node-resolver-ds8pq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal","openshift-network-diagnostics/network-check-target-wdr96","openshift-ovn-kubernetes/ovnkube-node-q2zgd","kube-system/konnectivity-agent-2zkpp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm","openshift-image-registry/node-ca-g6wbj","openshift-multus/multus-5k6l4","openshift-multus/multus-additional-cni-plugins-z8gg4"] Jun 07 08:02:00.463477 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.463454 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.464725 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.464704 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzp2s" Jun 07 08:02:00.465917 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.465892 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 07 08:02:00.466318 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.466298 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h22nz\"" Jun 07 08:02:00.466577 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.466547 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 07 08:02:00.466660 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.466576 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 07 08:02:00.466660 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.466602 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 07 08:02:00.466817 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.466802 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 07 08:02:00.466870 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.466844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:00.466943 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:00.466917 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:00.467238 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.467086 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 07 08:02:00.467332 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.467313 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fnd4w\"" Jun 07 08:02:00.467438 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.467422 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 07 08:02:00.468072 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.468053 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:00.468173 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:00.468155 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:00.468548 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.468530 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 07 08:02:00.469190 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.469171 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.470409 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.470390 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ds8pq" Jun 07 08:02:00.471340 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.471323 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 07 08:02:00.471430 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.471331 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 07 08:02:00.471430 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.471407 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-blp44\"" Jun 07 08:02:00.471852 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.471834 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.473203 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.472867 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2lfb4\"" Jun 07 08:02:00.473203 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.473019 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 07 08:02:00.473203 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.473066 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 07 08:02:00.474211 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.474117 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 07 08:02:00.474211 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.474128 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-srmrr\"" Jun 07 08:02:00.474211 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.474149 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 07 08:02:00.474420 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.474347 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:00.474476 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:00.474421 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:00.475867 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.475546 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.477615 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.477595 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2zkpp" Jun 07 08:02:00.477719 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.477696 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 07 08:02:00.478496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.478476 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wp2cz\"" Jun 07 08:02:00.478723 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.478708 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 07 08:02:00.478802 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.478764 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 07 08:02:00.478859 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.478707 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 07 08:02:00.478910 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.478865 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.478960 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.478916 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 07 08:02:00.479018 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-hostroot\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479070 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:00.479070 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-var-lib-kubelet\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.479197 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479086 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbb01ccd-6cba-4d84-9169-118874f860df-etc-tuned\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.479197 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9645848d-2127-444b-a1d7-f9b3900d73f9-hosts-file\") pod \"node-resolver-ds8pq\" (UID: \"9645848d-2127-444b-a1d7-f9b3900d73f9\") " pod="openshift-dns/node-resolver-ds8pq" Jun 07 08:02:00.479197 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-system-cni-dir\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479197 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479173 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-cnibin\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479197 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479182 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 07 08:02:00.479396 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-var-lib-cni-multus\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479396 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-etc-kubernetes\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479396 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-kubernetes\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.479396 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-os-release\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479396 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479290 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-var-lib-kubelet\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479396 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479291 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 08:02:00.479396 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479312 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9gcd\" (UniqueName: \"kubernetes.io/projected/b1b11930-3f95-4b89-9074-f0314179a14c-kube-api-access-k9gcd\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479396 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d2b9be4-3f35-4b32-8c7c-72a52e410172-host-slash\") pod \"iptables-alerter-xzp2s\" (UID: \"9d2b9be4-3f35-4b32-8c7c-72a52e410172\") " pod="openshift-network-operator/iptables-alerter-xzp2s" Jun 07 08:02:00.479396 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlcz7\" (UniqueName: \"kubernetes.io/projected/9d2b9be4-3f35-4b32-8c7c-72a52e410172-kube-api-access-wlcz7\") pod \"iptables-alerter-xzp2s\" (UID: \"9d2b9be4-3f35-4b32-8c7c-72a52e410172\") " pod="openshift-network-operator/iptables-alerter-xzp2s" Jun 07 08:02:00.479396 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479384 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a03170d-f27f-46f7-bad8-4573b640eb20-kubelet-config\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a03170d-f27f-46f7-bad8-4573b640eb20-dbus\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbb01ccd-6cba-4d84-9169-118874f860df-tmp\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479451 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-multus-socket-dir-parent\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-sysctl-conf\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-lib-modules\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479643 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-run-k8s-cni-cncf-io\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479690 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-multus-conf-dir\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479718 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1b11930-3f95-4b89-9074-f0314179a14c-cni-binary-copy\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479744 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-sysconfig\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479766 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-run\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479791 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1b11930-3f95-4b89-9074-f0314179a14c-multus-daemon-config\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-run-multus-certs\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:00.479853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479845 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479866 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlzqj\" (UniqueName: \"kubernetes.io/projected/a0fbf718-ddd2-498e-bfdb-04cf8364884d-kube-api-access-rlzqj\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-systemd\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-722g5\" (UniqueName: \"kubernetes.io/projected/9645848d-2127-444b-a1d7-f9b3900d73f9-kube-api-access-722g5\") pod \"node-resolver-ds8pq\" (UID: \"9645848d-2127-444b-a1d7-f9b3900d73f9\") " pod="openshift-dns/node-resolver-ds8pq" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-multus-cni-dir\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9d2b9be4-3f35-4b32-8c7c-72a52e410172-iptables-alerter-script\") pod \"iptables-alerter-xzp2s\" (UID: \"9d2b9be4-3f35-4b32-8c7c-72a52e410172\") " pod="openshift-network-operator/iptables-alerter-xzp2s" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479982 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wrkxq\"" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.479995 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-sysctl-d\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.480017 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9645848d-2127-444b-a1d7-f9b3900d73f9-tmp-dir\") pod \"node-resolver-ds8pq\" (UID: \"9645848d-2127-444b-a1d7-f9b3900d73f9\") " pod="openshift-dns/node-resolver-ds8pq" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.480038 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-run-netns\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.480060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-var-lib-cni-bin\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.480085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-modprobe-d\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.480143 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-sys\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.480167 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-host\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.480190 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c68h7\" (UniqueName: \"kubernetes.io/projected/bbb01ccd-6cba-4d84-9169-118874f860df-kube-api-access-c68h7\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.480435 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.480334 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g6wbj" Jun 07 08:02:00.481180 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.481060 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 07 08:02:00.481367 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.481317 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 07 08:02:00.483033 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.482498 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 07 08:02:00.483144 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.483060 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dz2n5\"" Jun 07 08:02:00.483601 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.483372 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 07 08:02:00.483601 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.483409 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sjvjr\"" Jun 07 08:02:00.483601 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.483465 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 07 08:02:00.484060 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.484004 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 07 08:02:00.501865 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.501745 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gbrpl" Jun 07 08:02:00.509126 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.509090 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gbrpl" Jun 07 08:02:00.528152 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.528129 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 08:02:00.570058 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.570039 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 07 08:02:00.580539 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580515 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbe41651-a68f-4802-9f52-cc35770441fe-ovnkube-script-lib\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.580651 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-sys-fs\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.580651 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-modprobe-d\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.580651 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580612 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:00.580651 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-run-openvswitch\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.580840 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbe41651-a68f-4802-9f52-cc35770441fe-env-overrides\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.580840 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c83c22f0-6f13-4b1c-b40b-6555159ea62f-os-release\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.580840 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:00.580772 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:00.580840 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-etc-openvswitch\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.581005 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:00.580845 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret podName:7a03170d-f27f-46f7-bad8-4573b640eb20 nodeName:}" failed. No retries permitted until 2026-06-07 08:02:01.080822891 +0000 UTC m=+3.015104002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret") pod "global-pull-secret-syncer-nj4q2" (UID: "7a03170d-f27f-46f7-bad8-4573b640eb20") : object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:00.581005 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580868 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbb01ccd-6cba-4d84-9169-118874f860df-etc-tuned\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.581005 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580841 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-modprobe-d\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.581005 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580898 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9645848d-2127-444b-a1d7-f9b3900d73f9-hosts-file\") pod \"node-resolver-ds8pq\" (UID: \"9645848d-2127-444b-a1d7-f9b3900d73f9\") " pod="openshift-dns/node-resolver-ds8pq" Jun 07 08:02:00.581005 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580929 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-system-cni-dir\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.581005 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580954 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-etc-kubernetes\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.581005 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-systemd-units\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.581005 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.580990 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9645848d-2127-444b-a1d7-f9b3900d73f9-hosts-file\") pod \"node-resolver-ds8pq\" (UID: \"9645848d-2127-444b-a1d7-f9b3900d73f9\") " pod="openshift-dns/node-resolver-ds8pq" Jun 07 08:02:00.581005 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-run-netns\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581024 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-os-release\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-var-lib-kubelet\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581053 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-etc-kubernetes\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-var-lib-openvswitch\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581091 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-system-cni-dir\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581114 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-var-lib-kubelet\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-log-socket\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581157 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-os-release\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbe41651-a68f-4802-9f52-cc35770441fe-ovnkube-config\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gm89\" (UniqueName: \"kubernetes.io/projected/bbe41651-a68f-4802-9f52-cc35770441fe-kube-api-access-9gm89\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581252 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c83c22f0-6f13-4b1c-b40b-6555159ea62f-cnibin\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-socket-dir\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581296 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-sysctl-conf\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581338 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-run-k8s-cni-cncf-io\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-multus-conf-dir\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581392 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-run-k8s-cni-cncf-io\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.581593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581419 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-sysctl-conf\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-kubelet\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581459 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-multus-conf-dir\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581452 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqb74\" (UniqueName: \"kubernetes.io/projected/c83c22f0-6f13-4b1c-b40b-6555159ea62f-kube-api-access-kqb74\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581506 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581542 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-etc-selinux\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-run\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581601 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1b11930-3f95-4b89-9074-f0314179a14c-multus-daemon-config\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581644 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-run\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581641 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c83c22f0-6f13-4b1c-b40b-6555159ea62f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-systemd\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-multus-cni-dir\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581794 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-run-systemd\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-cni-bin\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-systemd\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581844 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c83c22f0-6f13-4b1c-b40b-6555159ea62f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.582339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-sysctl-d\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-run-ovn\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581930 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-multus-cni-dir\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c83c22f0-6f13-4b1c-b40b-6555159ea62f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581981 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbg4g\" (UniqueName: \"kubernetes.io/projected/c97f9116-68af-443a-8c41-152308ff677d-kube-api-access-gbg4g\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.581993 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-sysctl-d\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582020 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-sys\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-host\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c68h7\" (UniqueName: \"kubernetes.io/projected/bbb01ccd-6cba-4d84-9169-118874f860df-kube-api-access-c68h7\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-hostroot\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582149 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-hostroot\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1b11930-3f95-4b89-9074-f0314179a14c-multus-daemon-config\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582199 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-host\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582339 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-sys\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582375 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c83c22f0-6f13-4b1c-b40b-6555159ea62f-system-cni-dir\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-var-lib-kubelet\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582420 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-cnibin\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582435 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-var-lib-cni-multus\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.583065 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582454 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a03170d-f27f-46f7-bad8-4573b640eb20-kubelet-config\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582453 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-var-lib-kubelet\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a03170d-f27f-46f7-bad8-4573b640eb20-dbus\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582521 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-cnibin\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582528 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-kubernetes\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582529 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-var-lib-cni-multus\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9gcd\" (UniqueName: \"kubernetes.io/projected/b1b11930-3f95-4b89-9074-f0314179a14c-kube-api-access-k9gcd\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582565 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a03170d-f27f-46f7-bad8-4573b640eb20-kubelet-config\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582578 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d2b9be4-3f35-4b32-8c7c-72a52e410172-host-slash\") pod \"iptables-alerter-xzp2s\" (UID: \"9d2b9be4-3f35-4b32-8c7c-72a52e410172\") " pod="openshift-network-operator/iptables-alerter-xzp2s" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582603 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-kubernetes\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582621 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d2b9be4-3f35-4b32-8c7c-72a52e410172-host-slash\") pod \"iptables-alerter-xzp2s\" (UID: \"9d2b9be4-3f35-4b32-8c7c-72a52e410172\") " pod="openshift-network-operator/iptables-alerter-xzp2s" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582638 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a03170d-f27f-46f7-bad8-4573b640eb20-dbus\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlcz7\" (UniqueName: \"kubernetes.io/projected/9d2b9be4-3f35-4b32-8c7c-72a52e410172-kube-api-access-wlcz7\") pod \"iptables-alerter-xzp2s\" (UID: \"9d2b9be4-3f35-4b32-8c7c-72a52e410172\") " pod="openshift-network-operator/iptables-alerter-xzp2s" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582724 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s2wf\" (UniqueName: \"kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf\") pod \"network-check-target-wdr96\" (UID: \"0a3db7fd-93b2-42d8-9be4-52ba8687eb4c\") " pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582753 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-slash\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-cni-netd\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582795 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9dc3174-a326-46e3-a685-4ccafa45b1fd-host\") pod \"node-ca-g6wbj\" (UID: \"a9dc3174-a326-46e3-a685-4ccafa45b1fd\") " pod="openshift-image-registry/node-ca-g6wbj" Jun 07 08:02:00.583932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbb01ccd-6cba-4d84-9169-118874f860df-tmp\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582837 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-multus-socket-dir-parent\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-lib-modules\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d994b6c2-9d2a-449b-8f17-6fba9d02c76a-agent-certs\") pod \"konnectivity-agent-2zkpp\" (UID: \"d994b6c2-9d2a-449b-8f17-6fba9d02c76a\") " pod="kube-system/konnectivity-agent-2zkpp" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xxhv\" (UniqueName: \"kubernetes.io/projected/a9dc3174-a326-46e3-a685-4ccafa45b1fd-kube-api-access-5xxhv\") pod \"node-ca-g6wbj\" (UID: \"a9dc3174-a326-46e3-a685-4ccafa45b1fd\") " pod="openshift-image-registry/node-ca-g6wbj" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582900 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-multus-socket-dir-parent\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c83c22f0-6f13-4b1c-b40b-6555159ea62f-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1b11930-3f95-4b89-9074-f0314179a14c-cni-binary-copy\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-sysconfig\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.582993 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-run-multus-certs\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583005 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-lib-modules\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583017 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbe41651-a68f-4802-9f52-cc35770441fe-ovn-node-metrics-cert\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a9dc3174-a326-46e3-a685-4ccafa45b1fd-serviceca\") pod \"node-ca-g6wbj\" (UID: \"a9dc3174-a326-46e3-a685-4ccafa45b1fd\") " pod="openshift-image-registry/node-ca-g6wbj" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583051 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbb01ccd-6cba-4d84-9169-118874f860df-etc-sysconfig\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-registration-dir\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583072 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-run-multus-certs\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:00.584739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583165 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlzqj\" (UniqueName: \"kubernetes.io/projected/a0fbf718-ddd2-498e-bfdb-04cf8364884d-kube-api-access-rlzqj\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-722g5\" (UniqueName: \"kubernetes.io/projected/9645848d-2127-444b-a1d7-f9b3900d73f9-kube-api-access-722g5\") pod \"node-resolver-ds8pq\" (UID: \"9645848d-2127-444b-a1d7-f9b3900d73f9\") " pod="openshift-dns/node-resolver-ds8pq" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:00.583245 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:00.583295 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs podName:a0fbf718-ddd2-498e-bfdb-04cf8364884d nodeName:}" failed. No retries permitted until 2026-06-07 08:02:01.083276246 +0000 UTC m=+3.017557338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs") pod "network-metrics-daemon-txfv9" (UID: "a0fbf718-ddd2-498e-bfdb-04cf8364884d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583512 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1b11930-3f95-4b89-9074-f0314179a14c-cni-binary-copy\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583773 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9d2b9be4-3f35-4b32-8c7c-72a52e410172-iptables-alerter-script\") pod \"iptables-alerter-xzp2s\" (UID: \"9d2b9be4-3f35-4b32-8c7c-72a52e410172\") " pod="openshift-network-operator/iptables-alerter-xzp2s" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583849 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d994b6c2-9d2a-449b-8f17-6fba9d02c76a-konnectivity-ca\") pod \"konnectivity-agent-2zkpp\" (UID: \"d994b6c2-9d2a-449b-8f17-6fba9d02c76a\") " pod="kube-system/konnectivity-agent-2zkpp" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-device-dir\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9645848d-2127-444b-a1d7-f9b3900d73f9-tmp-dir\") pod \"node-resolver-ds8pq\" (UID: \"9645848d-2127-444b-a1d7-f9b3900d73f9\") " pod="openshift-dns/node-resolver-ds8pq" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-run-netns\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-var-lib-cni-bin\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.583977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-node-log\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.584002 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.584098 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-var-lib-cni-bin\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.584142 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1b11930-3f95-4b89-9074-f0314179a14c-host-run-netns\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.584330 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9645848d-2127-444b-a1d7-f9b3900d73f9-tmp-dir\") pod \"node-resolver-ds8pq\" (UID: \"9645848d-2127-444b-a1d7-f9b3900d73f9\") " pod="openshift-dns/node-resolver-ds8pq" Jun 07 08:02:00.585496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.584348 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9d2b9be4-3f35-4b32-8c7c-72a52e410172-iptables-alerter-script\") pod \"iptables-alerter-xzp2s\" (UID: \"9d2b9be4-3f35-4b32-8c7c-72a52e410172\") " pod="openshift-network-operator/iptables-alerter-xzp2s" Jun 07 08:02:00.586128 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.585072 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbb01ccd-6cba-4d84-9169-118874f860df-etc-tuned\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.586128 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.585514 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbb01ccd-6cba-4d84-9169-118874f860df-tmp\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.597954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.597821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-722g5\" (UniqueName: \"kubernetes.io/projected/9645848d-2127-444b-a1d7-f9b3900d73f9-kube-api-access-722g5\") pod \"node-resolver-ds8pq\" (UID: \"9645848d-2127-444b-a1d7-f9b3900d73f9\") " pod="openshift-dns/node-resolver-ds8pq" Jun 07 08:02:00.597954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.597937 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9gcd\" (UniqueName: \"kubernetes.io/projected/b1b11930-3f95-4b89-9074-f0314179a14c-kube-api-access-k9gcd\") pod \"multus-5k6l4\" (UID: \"b1b11930-3f95-4b89-9074-f0314179a14c\") " pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.598142 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.598037 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlzqj\" (UniqueName: \"kubernetes.io/projected/a0fbf718-ddd2-498e-bfdb-04cf8364884d-kube-api-access-rlzqj\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:00.598142 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.598045 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c68h7\" (UniqueName: \"kubernetes.io/projected/bbb01ccd-6cba-4d84-9169-118874f860df-kube-api-access-c68h7\") pod \"tuned-mnk2w\" (UID: \"bbb01ccd-6cba-4d84-9169-118874f860df\") " pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.598610 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.598590 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlcz7\" (UniqueName: \"kubernetes.io/projected/9d2b9be4-3f35-4b32-8c7c-72a52e410172-kube-api-access-wlcz7\") pod \"iptables-alerter-xzp2s\" (UID: \"9d2b9be4-3f35-4b32-8c7c-72a52e410172\") " pod="openshift-network-operator/iptables-alerter-xzp2s" Jun 07 08:02:00.684607 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684576 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-kubelet\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.684754 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684612 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqb74\" (UniqueName: \"kubernetes.io/projected/c83c22f0-6f13-4b1c-b40b-6555159ea62f-kube-api-access-kqb74\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.684754 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.684754 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684652 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-etc-selinux\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.684754 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684669 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c83c22f0-6f13-4b1c-b40b-6555159ea62f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.684754 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-run-systemd\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.684754 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684710 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.684754 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684665 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-kubelet\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.684754 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684716 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-cni-bin\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684769 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-run-systemd\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684770 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c83c22f0-6f13-4b1c-b40b-6555159ea62f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684814 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-cni-bin\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684823 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-etc-selinux\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-run-ovn\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684898 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-run-ovn\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c83c22f0-6f13-4b1c-b40b-6555159ea62f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684949 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbg4g\" (UniqueName: \"kubernetes.io/projected/c97f9116-68af-443a-8c41-152308ff677d-kube-api-access-gbg4g\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.684980 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c83c22f0-6f13-4b1c-b40b-6555159ea62f-system-cni-dir\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685014 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2wf\" (UniqueName: \"kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf\") pod \"network-check-target-wdr96\" (UID: \"0a3db7fd-93b2-42d8-9be4-52ba8687eb4c\") " pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685038 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-slash\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685051 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c83c22f0-6f13-4b1c-b40b-6555159ea62f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685064 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-cni-netd\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685073 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c83c22f0-6f13-4b1c-b40b-6555159ea62f-system-cni-dir\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9dc3174-a326-46e3-a685-4ccafa45b1fd-host\") pod \"node-ca-g6wbj\" (UID: \"a9dc3174-a326-46e3-a685-4ccafa45b1fd\") " pod="openshift-image-registry/node-ca-g6wbj" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d994b6c2-9d2a-449b-8f17-6fba9d02c76a-agent-certs\") pod \"konnectivity-agent-2zkpp\" (UID: \"d994b6c2-9d2a-449b-8f17-6fba9d02c76a\") " pod="kube-system/konnectivity-agent-2zkpp" Jun 07 08:02:00.685206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685150 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xxhv\" (UniqueName: \"kubernetes.io/projected/a9dc3174-a326-46e3-a685-4ccafa45b1fd-kube-api-access-5xxhv\") pod \"node-ca-g6wbj\" (UID: \"a9dc3174-a326-46e3-a685-4ccafa45b1fd\") " pod="openshift-image-registry/node-ca-g6wbj" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685151 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-cni-netd\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685173 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c83c22f0-6f13-4b1c-b40b-6555159ea62f-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685198 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-slash\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685201 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbe41651-a68f-4802-9f52-cc35770441fe-ovn-node-metrics-cert\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685240 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a9dc3174-a326-46e3-a685-4ccafa45b1fd-serviceca\") pod \"node-ca-g6wbj\" (UID: \"a9dc3174-a326-46e3-a685-4ccafa45b1fd\") " pod="openshift-image-registry/node-ca-g6wbj" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685267 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-registration-dir\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685269 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c83c22f0-6f13-4b1c-b40b-6555159ea62f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9dc3174-a326-46e3-a685-4ccafa45b1fd-host\") pod \"node-ca-g6wbj\" (UID: \"a9dc3174-a326-46e3-a685-4ccafa45b1fd\") " pod="openshift-image-registry/node-ca-g6wbj" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685284 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c83c22f0-6f13-4b1c-b40b-6555159ea62f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685319 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d994b6c2-9d2a-449b-8f17-6fba9d02c76a-konnectivity-ca\") pod \"konnectivity-agent-2zkpp\" (UID: \"d994b6c2-9d2a-449b-8f17-6fba9d02c76a\") " pod="kube-system/konnectivity-agent-2zkpp" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-device-dir\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-node-log\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685426 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbe41651-a68f-4802-9f52-cc35770441fe-ovnkube-script-lib\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685477 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-sys-fs\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.685954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685513 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-run-openvswitch\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685520 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-registration-dir\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbe41651-a68f-4802-9f52-cc35770441fe-env-overrides\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c83c22f0-6f13-4b1c-b40b-6555159ea62f-os-release\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685580 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-etc-openvswitch\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-systemd-units\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685616 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-node-log\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-run-netns\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685660 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-var-lib-openvswitch\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685672 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-device-dir\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685685 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-log-socket\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685711 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbe41651-a68f-4802-9f52-cc35770441fe-ovnkube-config\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gm89\" (UniqueName: \"kubernetes.io/projected/bbe41651-a68f-4802-9f52-cc35770441fe-kube-api-access-9gm89\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685736 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c83c22f0-6f13-4b1c-b40b-6555159ea62f-cnibin\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-socket-dir\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685797 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c83c22f0-6f13-4b1c-b40b-6555159ea62f-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.686711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-sys-fs\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685862 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-run-netns\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685866 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-etc-openvswitch\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685874 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-log-socket\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c83c22f0-6f13-4b1c-b40b-6555159ea62f-os-release\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685927 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-systemd-units\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.685967 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c83c22f0-6f13-4b1c-b40b-6555159ea62f-cnibin\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.686004 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-var-lib-openvswitch\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.686009 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c97f9116-68af-443a-8c41-152308ff677d-socket-dir\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.686024 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d994b6c2-9d2a-449b-8f17-6fba9d02c76a-konnectivity-ca\") pod \"konnectivity-agent-2zkpp\" (UID: \"d994b6c2-9d2a-449b-8f17-6fba9d02c76a\") " pod="kube-system/konnectivity-agent-2zkpp" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.686116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbe41651-a68f-4802-9f52-cc35770441fe-run-openvswitch\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.686121 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbe41651-a68f-4802-9f52-cc35770441fe-env-overrides\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.686308 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbe41651-a68f-4802-9f52-cc35770441fe-ovnkube-script-lib\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.686329 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a9dc3174-a326-46e3-a685-4ccafa45b1fd-serviceca\") pod \"node-ca-g6wbj\" (UID: \"a9dc3174-a326-46e3-a685-4ccafa45b1fd\") " pod="openshift-image-registry/node-ca-g6wbj" Jun 07 08:02:00.687294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.686470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbe41651-a68f-4802-9f52-cc35770441fe-ovnkube-config\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.688128 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.688090 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d994b6c2-9d2a-449b-8f17-6fba9d02c76a-agent-certs\") pod \"konnectivity-agent-2zkpp\" (UID: \"d994b6c2-9d2a-449b-8f17-6fba9d02c76a\") " pod="kube-system/konnectivity-agent-2zkpp" Jun 07 08:02:00.688247 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.688199 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbe41651-a68f-4802-9f52-cc35770441fe-ovn-node-metrics-cert\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.690583 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:00.690563 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 08:02:00.690692 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:00.690587 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 08:02:00.690692 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:00.690600 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9s2wf for pod openshift-network-diagnostics/network-check-target-wdr96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:00.690692 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:00.690662 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf podName:0a3db7fd-93b2-42d8-9be4-52ba8687eb4c nodeName:}" failed. No retries permitted until 2026-06-07 08:02:01.190642985 +0000 UTC m=+3.124924067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9s2wf" (UniqueName: "kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf") pod "network-check-target-wdr96" (UID: "0a3db7fd-93b2-42d8-9be4-52ba8687eb4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:00.693164 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.693146 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbg4g\" (UniqueName: \"kubernetes.io/projected/c97f9116-68af-443a-8c41-152308ff677d-kube-api-access-gbg4g\") pod \"aws-ebs-csi-driver-node-xx5tm\" (UID: \"c97f9116-68af-443a-8c41-152308ff677d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.693297 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.693278 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqb74\" (UniqueName: \"kubernetes.io/projected/c83c22f0-6f13-4b1c-b40b-6555159ea62f-kube-api-access-kqb74\") pod \"multus-additional-cni-plugins-z8gg4\" (UID: \"c83c22f0-6f13-4b1c-b40b-6555159ea62f\") " pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.693339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.693278 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xxhv\" (UniqueName: \"kubernetes.io/projected/a9dc3174-a326-46e3-a685-4ccafa45b1fd-kube-api-access-5xxhv\") pod \"node-ca-g6wbj\" (UID: \"a9dc3174-a326-46e3-a685-4ccafa45b1fd\") " pod="openshift-image-registry/node-ca-g6wbj" Jun 07 08:02:00.693339 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.693328 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gm89\" (UniqueName: \"kubernetes.io/projected/bbe41651-a68f-4802-9f52-cc35770441fe-kube-api-access-9gm89\") pod \"ovnkube-node-q2zgd\" (UID: \"bbe41651-a68f-4802-9f52-cc35770441fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.776843 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.776749 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5k6l4" Jun 07 08:02:00.786463 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.786444 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzp2s" Jun 07 08:02:00.793978 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.793957 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" Jun 07 08:02:00.799620 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.799602 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ds8pq" Jun 07 08:02:00.805186 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.805168 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z8gg4" Jun 07 08:02:00.811869 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.811843 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:00.818361 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.818335 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2zkpp" Jun 07 08:02:00.826742 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.826728 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" Jun 07 08:02:00.831360 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.831341 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g6wbj" Jun 07 08:02:00.957680 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:00.957654 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 08:02:01.089042 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.088950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:01.089042 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.089004 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:01.089260 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:01.089152 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:01.089260 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:01.089237 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs podName:a0fbf718-ddd2-498e-bfdb-04cf8364884d nodeName:}" failed. No retries permitted until 2026-06-07 08:02:02.089215919 +0000 UTC m=+4.023497015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs") pod "network-metrics-daemon-txfv9" (UID: "a0fbf718-ddd2-498e-bfdb-04cf8364884d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:01.089260 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:01.089164 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:01.089409 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:01.089319 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret podName:7a03170d-f27f-46f7-bad8-4573b640eb20 nodeName:}" failed. No retries permitted until 2026-06-07 08:02:02.089294566 +0000 UTC m=+4.023575644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret") pod "global-pull-secret-syncer-nj4q2" (UID: "7a03170d-f27f-46f7-bad8-4573b640eb20") : object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:01.290304 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.290281 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2wf\" (UniqueName: \"kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf\") pod \"network-check-target-wdr96\" (UID: \"0a3db7fd-93b2-42d8-9be4-52ba8687eb4c\") " pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:01.290458 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:01.290442 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 08:02:01.290500 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:01.290466 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 08:02:01.290500 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:01.290476 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9s2wf for pod openshift-network-diagnostics/network-check-target-wdr96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:01.290565 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:01.290540 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf podName:0a3db7fd-93b2-42d8-9be4-52ba8687eb4c nodeName:}" failed. No retries permitted until 2026-06-07 08:02:02.290509703 +0000 UTC m=+4.224790766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s2wf" (UniqueName: "kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf") pod "network-check-target-wdr96" (UID: "0a3db7fd-93b2-42d8-9be4-52ba8687eb4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:01.320853 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:02:01.320825 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbb01ccd_6cba_4d84_9169_118874f860df.slice/crio-c45ca18bc99651f9dc808090929fbc4686aa5a3d01e4c83fb1fd6abd7f67f8f2 WatchSource:0}: Error finding container c45ca18bc99651f9dc808090929fbc4686aa5a3d01e4c83fb1fd6abd7f67f8f2: Status 404 returned error can't find the container with id c45ca18bc99651f9dc808090929fbc4686aa5a3d01e4c83fb1fd6abd7f67f8f2 Jun 07 08:02:01.322005 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:02:01.321950 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9645848d_2127_444b_a1d7_f9b3900d73f9.slice/crio-7d222b135bf0690a8fe7c54f69c7673d65c78c6cde0dfedfbc3fd2922dc11aeb WatchSource:0}: Error finding container 7d222b135bf0690a8fe7c54f69c7673d65c78c6cde0dfedfbc3fd2922dc11aeb: Status 404 returned error can't find the container with id 7d222b135bf0690a8fe7c54f69c7673d65c78c6cde0dfedfbc3fd2922dc11aeb Jun 07 08:02:01.323866 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:02:01.323841 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9dc3174_a326_46e3_a685_4ccafa45b1fd.slice/crio-d78e7f176c339c6f0780d0c1a241e9b276ae973fe6efebec00ac61e44efac2e3 WatchSource:0}: Error finding container d78e7f176c339c6f0780d0c1a241e9b276ae973fe6efebec00ac61e44efac2e3: Status 404 returned error can't find the container with id d78e7f176c339c6f0780d0c1a241e9b276ae973fe6efebec00ac61e44efac2e3 Jun 07 08:02:01.327214 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:02:01.327191 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbe41651_a68f_4802_9f52_cc35770441fe.slice/crio-3127c4a7ac5a2867d0a336a046245546449ac35d0f04fcfcc31824c05f655cb7 WatchSource:0}: Error finding container 3127c4a7ac5a2867d0a336a046245546449ac35d0f04fcfcc31824c05f655cb7: Status 404 returned error can't find the container with id 3127c4a7ac5a2867d0a336a046245546449ac35d0f04fcfcc31824c05f655cb7 Jun 07 08:02:01.328268 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:02:01.328233 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83c22f0_6f13_4b1c_b40b_6555159ea62f.slice/crio-469955e495d12d69cf296a66e7062dda284691b1618dfdf78fe5feb2f3b1c8c7 WatchSource:0}: Error finding container 469955e495d12d69cf296a66e7062dda284691b1618dfdf78fe5feb2f3b1c8c7: Status 404 returned error can't find the container with id 469955e495d12d69cf296a66e7062dda284691b1618dfdf78fe5feb2f3b1c8c7 Jun 07 08:02:01.329649 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:02:01.329622 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd994b6c2_9d2a_449b_8f17_6fba9d02c76a.slice/crio-d075644468d09bf52266ab347eda3fd2052ee0952e2988a028f50f6098e2dbf6 WatchSource:0}: Error finding container d075644468d09bf52266ab347eda3fd2052ee0952e2988a028f50f6098e2dbf6: Status 404 returned error can't find the container with id d075644468d09bf52266ab347eda3fd2052ee0952e2988a028f50f6098e2dbf6 Jun 07 08:02:01.331151 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:02:01.331131 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2b9be4_3f35_4b32_8c7c_72a52e410172.slice/crio-83ab75c67ce9121c9ac81240e1d41a72c2974dd4bb6e256fff5af27e4871c97a WatchSource:0}: Error finding container 83ab75c67ce9121c9ac81240e1d41a72c2974dd4bb6e256fff5af27e4871c97a: Status 404 returned error can't find the container with id 83ab75c67ce9121c9ac81240e1d41a72c2974dd4bb6e256fff5af27e4871c97a Jun 07 08:02:01.332934 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:02:01.332685 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc97f9116_68af_443a_8c41_152308ff677d.slice/crio-399dda912f09bc624d6e0b37764aee92354590cd08bc3df56697d98c6d535ba8 WatchSource:0}: Error finding container 399dda912f09bc624d6e0b37764aee92354590cd08bc3df56697d98c6d535ba8: Status 404 returned error can't find the container with id 399dda912f09bc624d6e0b37764aee92354590cd08bc3df56697d98c6d535ba8 Jun 07 08:02:01.333267 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:02:01.333214 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b11930_3f95_4b89_9074_f0314179a14c.slice/crio-ad28cdcc467959fc4f1eb6a32b4652b14eed4b7847bfc03377d6767d0960a9ed WatchSource:0}: Error finding container ad28cdcc467959fc4f1eb6a32b4652b14eed4b7847bfc03377d6767d0960a9ed: Status 404 returned error can't find the container with id ad28cdcc467959fc4f1eb6a32b4652b14eed4b7847bfc03377d6767d0960a9ed Jun 07 08:02:01.511826 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.511629 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 07:57:00 +0000 UTC" deadline="2028-01-30 00:21:44.906597809 +0000 UTC" Jun 07 08:02:01.511826 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.511828 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14440h19m43.394778756s" Jun 07 08:02:01.541629 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.541596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ds8pq" event={"ID":"9645848d-2127-444b-a1d7-f9b3900d73f9","Type":"ContainerStarted","Data":"7d222b135bf0690a8fe7c54f69c7673d65c78c6cde0dfedfbc3fd2922dc11aeb"} Jun 07 08:02:01.542573 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.542552 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" event={"ID":"c97f9116-68af-443a-8c41-152308ff677d","Type":"ContainerStarted","Data":"399dda912f09bc624d6e0b37764aee92354590cd08bc3df56697d98c6d535ba8"} Jun 07 08:02:01.543446 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.543421 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzp2s" event={"ID":"9d2b9be4-3f35-4b32-8c7c-72a52e410172","Type":"ContainerStarted","Data":"83ab75c67ce9121c9ac81240e1d41a72c2974dd4bb6e256fff5af27e4871c97a"} Jun 07 08:02:01.544474 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.544456 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" event={"ID":"bbb01ccd-6cba-4d84-9169-118874f860df","Type":"ContainerStarted","Data":"c45ca18bc99651f9dc808090929fbc4686aa5a3d01e4c83fb1fd6abd7f67f8f2"} Jun 07 08:02:01.546582 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.546548 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-99.ec2.internal" event={"ID":"3aa9dc2982fae84a7139add606c8bc21","Type":"ContainerStarted","Data":"46cfc38ec3f643616ada8b63ac2a529046d52ed88e31310805258e2d4dd90c36"} Jun 07 08:02:01.547573 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.547555 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5k6l4" event={"ID":"b1b11930-3f95-4b89-9074-f0314179a14c","Type":"ContainerStarted","Data":"ad28cdcc467959fc4f1eb6a32b4652b14eed4b7847bfc03377d6767d0960a9ed"} Jun 07 08:02:01.548561 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.548541 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2zkpp" event={"ID":"d994b6c2-9d2a-449b-8f17-6fba9d02c76a","Type":"ContainerStarted","Data":"d075644468d09bf52266ab347eda3fd2052ee0952e2988a028f50f6098e2dbf6"} Jun 07 08:02:01.549476 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.549459 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gg4" event={"ID":"c83c22f0-6f13-4b1c-b40b-6555159ea62f","Type":"ContainerStarted","Data":"469955e495d12d69cf296a66e7062dda284691b1618dfdf78fe5feb2f3b1c8c7"} Jun 07 08:02:01.550522 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.550491 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" event={"ID":"bbe41651-a68f-4802-9f52-cc35770441fe","Type":"ContainerStarted","Data":"3127c4a7ac5a2867d0a336a046245546449ac35d0f04fcfcc31824c05f655cb7"} Jun 07 08:02:01.551424 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.551406 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g6wbj" event={"ID":"a9dc3174-a326-46e3-a685-4ccafa45b1fd","Type":"ContainerStarted","Data":"d78e7f176c339c6f0780d0c1a241e9b276ae973fe6efebec00ac61e44efac2e3"} Jun 07 08:02:01.561749 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:01.561689 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-99.ec2.internal" podStartSLOduration=2.561676606 podStartE2EDuration="2.561676606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:01:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:02:01.561584626 +0000 UTC m=+3.495865712" watchObservedRunningTime="2026-06-07 08:02:01.561676606 +0000 UTC m=+3.495957691" Jun 07 08:02:02.097026 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:02.096165 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:02.097026 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:02.096282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:02.097026 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:02.096427 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:02.097026 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:02.096495 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs podName:a0fbf718-ddd2-498e-bfdb-04cf8364884d nodeName:}" failed. No retries permitted until 2026-06-07 08:02:04.096475118 +0000 UTC m=+6.030756187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs") pod "network-metrics-daemon-txfv9" (UID: "a0fbf718-ddd2-498e-bfdb-04cf8364884d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:02.097026 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:02.096882 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:02.097026 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:02.096939 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret podName:7a03170d-f27f-46f7-bad8-4573b640eb20 nodeName:}" failed. No retries permitted until 2026-06-07 08:02:04.096922771 +0000 UTC m=+6.031203866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret") pod "global-pull-secret-syncer-nj4q2" (UID: "7a03170d-f27f-46f7-bad8-4573b640eb20") : object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:02.298823 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:02.298170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2wf\" (UniqueName: \"kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf\") pod \"network-check-target-wdr96\" (UID: \"0a3db7fd-93b2-42d8-9be4-52ba8687eb4c\") " pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:02.298823 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:02.298385 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 08:02:02.298823 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:02.298405 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 08:02:02.298823 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:02.298417 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9s2wf for pod openshift-network-diagnostics/network-check-target-wdr96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:02.298823 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:02.298475 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf podName:0a3db7fd-93b2-42d8-9be4-52ba8687eb4c nodeName:}" failed. No retries permitted until 2026-06-07 08:02:04.298456123 +0000 UTC m=+6.232737193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s2wf" (UniqueName: "kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf") pod "network-check-target-wdr96" (UID: "0a3db7fd-93b2-42d8-9be4-52ba8687eb4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:02.512636 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:02.512491 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 07:57:00 +0000 UTC" deadline="2028-03-23 14:18:20.590144774 +0000 UTC" Jun 07 08:02:02.512636 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:02.512552 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15726h16m18.077596722s" Jun 07 08:02:02.536631 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:02.535792 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:02.536631 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:02.535916 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:02.536631 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:02.536005 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:02.536631 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:02.536089 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:02.536631 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:02.536167 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:02.536631 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:02.536247 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:02.580022 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:02.579984 2559 generic.go:356] "Generic (PLEG): container finished" podID="0f189a601c7bde0338de8e3692a36734" containerID="3b2c6cb99aef81762f07203d770c9499c2aa9499fa2a14232a0fc5219d65fd8f" exitCode=0 Jun 07 08:02:02.581123 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:02.581054 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" event={"ID":"0f189a601c7bde0338de8e3692a36734","Type":"ContainerDied","Data":"3b2c6cb99aef81762f07203d770c9499c2aa9499fa2a14232a0fc5219d65fd8f"} Jun 07 08:02:03.601846 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:03.601811 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" event={"ID":"0f189a601c7bde0338de8e3692a36734","Type":"ContainerStarted","Data":"82648ec183a6cfe484bc8ffd57f1c9822ae2ca1fb191502c3c916924fc62caaf"} Jun 07 08:02:03.618914 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:03.618857 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-99.ec2.internal" podStartSLOduration=4.6188357920000005 podStartE2EDuration="4.618835792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:01:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:02:03.618133065 +0000 UTC m=+5.552414150" watchObservedRunningTime="2026-06-07 08:02:03.618835792 +0000 UTC m=+5.553116880" Jun 07 08:02:04.114447 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:04.113704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:04.114447 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:04.113763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:04.114447 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:04.113936 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:04.114447 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:04.114003 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret podName:7a03170d-f27f-46f7-bad8-4573b640eb20 nodeName:}" failed. No retries permitted until 2026-06-07 08:02:08.113981154 +0000 UTC m=+10.048262222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret") pod "global-pull-secret-syncer-nj4q2" (UID: "7a03170d-f27f-46f7-bad8-4573b640eb20") : object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:04.114447 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:04.114067 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:04.114447 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:04.114116 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs podName:a0fbf718-ddd2-498e-bfdb-04cf8364884d nodeName:}" failed. No retries permitted until 2026-06-07 08:02:08.114088122 +0000 UTC m=+10.048369199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs") pod "network-metrics-daemon-txfv9" (UID: "a0fbf718-ddd2-498e-bfdb-04cf8364884d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:04.315592 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:04.314936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2wf\" (UniqueName: \"kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf\") pod \"network-check-target-wdr96\" (UID: \"0a3db7fd-93b2-42d8-9be4-52ba8687eb4c\") " pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:04.315592 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:04.315130 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 08:02:04.315592 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:04.315155 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 08:02:04.315592 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:04.315168 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9s2wf for pod openshift-network-diagnostics/network-check-target-wdr96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:04.315592 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:04.315246 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf podName:0a3db7fd-93b2-42d8-9be4-52ba8687eb4c nodeName:}" failed. No retries permitted until 2026-06-07 08:02:08.31522444 +0000 UTC m=+10.249505527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s2wf" (UniqueName: "kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf") pod "network-check-target-wdr96" (UID: "0a3db7fd-93b2-42d8-9be4-52ba8687eb4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:04.534125 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:04.534033 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:04.534274 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:04.534256 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:04.534643 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:04.534620 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:04.534753 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:04.534722 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:04.534938 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:04.534818 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:04.534938 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:04.534897 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:06.534056 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:06.534020 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:06.534518 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:06.534030 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:06.534518 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:06.534221 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:06.534518 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:06.534239 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:06.534518 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:06.534333 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:06.534518 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:06.534414 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:08.147426 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:08.147389 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:08.147912 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:08.147447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:08.147912 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:08.147562 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:08.147912 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:08.147644 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs podName:a0fbf718-ddd2-498e-bfdb-04cf8364884d nodeName:}" failed. No retries permitted until 2026-06-07 08:02:16.147619451 +0000 UTC m=+18.081900539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs") pod "network-metrics-daemon-txfv9" (UID: "a0fbf718-ddd2-498e-bfdb-04cf8364884d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:08.147912 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:08.147575 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:08.147912 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:08.147727 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret podName:7a03170d-f27f-46f7-bad8-4573b640eb20 nodeName:}" failed. No retries permitted until 2026-06-07 08:02:16.147705522 +0000 UTC m=+18.081986603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret") pod "global-pull-secret-syncer-nj4q2" (UID: "7a03170d-f27f-46f7-bad8-4573b640eb20") : object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:08.348610 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:08.348572 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2wf\" (UniqueName: \"kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf\") pod \"network-check-target-wdr96\" (UID: \"0a3db7fd-93b2-42d8-9be4-52ba8687eb4c\") " pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:08.348807 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:08.348768 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 08:02:08.348886 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:08.348809 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 08:02:08.348886 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:08.348823 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9s2wf for pod openshift-network-diagnostics/network-check-target-wdr96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:08.348886 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:08.348883 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf podName:0a3db7fd-93b2-42d8-9be4-52ba8687eb4c nodeName:}" failed. No retries permitted until 2026-06-07 08:02:16.34886283 +0000 UTC m=+18.283143908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s2wf" (UniqueName: "kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf") pod "network-check-target-wdr96" (UID: "0a3db7fd-93b2-42d8-9be4-52ba8687eb4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:08.534622 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:08.534503 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:08.534783 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:08.534618 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:08.534783 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:08.534700 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:08.534783 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:08.534746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:08.534966 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:08.534829 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:08.534966 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:08.534916 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:10.533368 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:10.533334 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:10.533822 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:10.533336 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:10.533822 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:10.533467 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:10.533822 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:10.533504 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:10.533822 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:10.533609 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:10.533822 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:10.533686 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:12.533687 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:12.533651 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:12.534129 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:12.533651 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:12.534129 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:12.533779 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:12.534129 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:12.533651 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:12.534129 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:12.533851 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:12.534129 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:12.533965 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:14.533522 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:14.533485 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:14.534043 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:14.533485 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:14.534043 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:14.533625 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:14.534043 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:14.533613 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:14.534043 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:14.533739 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:14.534043 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:14.533812 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:16.203487 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:16.203445 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:16.204013 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:16.203495 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:16.204013 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:16.203609 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:16.204013 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:16.203687 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs podName:a0fbf718-ddd2-498e-bfdb-04cf8364884d nodeName:}" failed. No retries permitted until 2026-06-07 08:02:32.203667639 +0000 UTC m=+34.137948719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs") pod "network-metrics-daemon-txfv9" (UID: "a0fbf718-ddd2-498e-bfdb-04cf8364884d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:16.204013 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:16.203621 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:16.204013 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:16.203778 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret podName:7a03170d-f27f-46f7-bad8-4573b640eb20 nodeName:}" failed. No retries permitted until 2026-06-07 08:02:32.203756549 +0000 UTC m=+34.138037617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret") pod "global-pull-secret-syncer-nj4q2" (UID: "7a03170d-f27f-46f7-bad8-4573b640eb20") : object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:16.405247 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:16.405209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2wf\" (UniqueName: \"kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf\") pod \"network-check-target-wdr96\" (UID: \"0a3db7fd-93b2-42d8-9be4-52ba8687eb4c\") " pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:16.405432 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:16.405352 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 08:02:16.405432 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:16.405373 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 08:02:16.405432 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:16.405385 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9s2wf for pod openshift-network-diagnostics/network-check-target-wdr96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:16.405561 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:16.405449 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf podName:0a3db7fd-93b2-42d8-9be4-52ba8687eb4c nodeName:}" failed. No retries permitted until 2026-06-07 08:02:32.405431617 +0000 UTC m=+34.339712693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s2wf" (UniqueName: "kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf") pod "network-check-target-wdr96" (UID: "0a3db7fd-93b2-42d8-9be4-52ba8687eb4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:16.533887 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:16.533801 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:16.534052 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:16.533803 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:16.534052 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:16.533937 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:16.534052 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:16.533803 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:16.534052 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:16.534041 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:16.534279 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:16.534134 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:18.533882 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:18.533849 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:18.534357 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:18.533966 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:18.534357 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:18.534042 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:18.534357 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:18.534150 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:18.534357 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:18.534190 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:18.534357 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:18.534242 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:20.534039 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.533651 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:20.534755 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.533651 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:20.534755 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:20.534202 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:20.534755 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:20.534266 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:20.534755 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.533704 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:20.534755 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:20.534361 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:20.633699 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.633670 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g6wbj" event={"ID":"a9dc3174-a326-46e3-a685-4ccafa45b1fd","Type":"ContainerStarted","Data":"b4fd403d4e2b2186dca321fb8975d934b9b50133ef5c96ebf8418698282b4429"} Jun 07 08:02:20.634927 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.634907 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ds8pq" event={"ID":"9645848d-2127-444b-a1d7-f9b3900d73f9","Type":"ContainerStarted","Data":"2f1dde4cac139a11abd5e01f9b35112f4e02ff01930eb42754b6cb573470dda1"} Jun 07 08:02:20.636290 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.636267 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" event={"ID":"c97f9116-68af-443a-8c41-152308ff677d","Type":"ContainerStarted","Data":"00ae9f48635bf0700e3388c05a0b5188fde059b0d419ffeb24203178992b9411"} Jun 07 08:02:20.638446 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.638427 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" event={"ID":"bbb01ccd-6cba-4d84-9169-118874f860df","Type":"ContainerStarted","Data":"0a720882846da8c0aa91e8ce901c22806470b899f3147feadedd2e2788fd8f0f"} Jun 07 08:02:20.640454 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.640422 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5k6l4" event={"ID":"b1b11930-3f95-4b89-9074-f0314179a14c","Type":"ContainerStarted","Data":"bc2190088771c50c16b0ff6e9d83516baa783e509cbdcad563241fb1c5be59df"} Jun 07 08:02:20.641725 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.641708 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2zkpp" event={"ID":"d994b6c2-9d2a-449b-8f17-6fba9d02c76a","Type":"ContainerStarted","Data":"aec1fd94ca81444f76a35e92f7f10ffc36658689bf823b75b25da8d11917136f"} Jun 07 08:02:20.643142 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.643094 2559 generic.go:356] "Generic (PLEG): container finished" podID="c83c22f0-6f13-4b1c-b40b-6555159ea62f" containerID="df2a93ce5a5c0c1eca1d083f4a11f1a9d2e13691b855f12969014ae309759f96" exitCode=0 Jun 07 08:02:20.643230 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.643145 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gg4" event={"ID":"c83c22f0-6f13-4b1c-b40b-6555159ea62f","Type":"ContainerDied","Data":"df2a93ce5a5c0c1eca1d083f4a11f1a9d2e13691b855f12969014ae309759f96"} Jun 07 08:02:20.645454 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.645436 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" event={"ID":"bbe41651-a68f-4802-9f52-cc35770441fe","Type":"ContainerStarted","Data":"dfe28e283998bcf7f7c562c3ce344da1de8b62ae242dfecf74a609eef17b6f20"} Jun 07 08:02:20.645554 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.645505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" event={"ID":"bbe41651-a68f-4802-9f52-cc35770441fe","Type":"ContainerStarted","Data":"b567f9b2ee6a0a632a3cf71d6e85f130f025cb3a1efa8fe22ba64921068a3319"} Jun 07 08:02:20.645617 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.645558 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" event={"ID":"bbe41651-a68f-4802-9f52-cc35770441fe","Type":"ContainerStarted","Data":"cbe4411eb388f15e93dd4b045df7b55434a5ab406fb5384bb2d561f3cfb5a1e9"} Jun 07 08:02:20.650467 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.650426 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g6wbj" podStartSLOduration=3.859483986 podStartE2EDuration="22.650411391s" totalImagesPullingTime="18.790927405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:02:20.650009011 +0000 UTC m=+22.584290091" watchObservedRunningTime="2026-06-07 08:02:20.650411391 +0000 UTC m=+22.584692478" Jun 07 08:02:20.668774 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.668730 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mnk2w" podStartSLOduration=3.853972348 podStartE2EDuration="22.668713077s" totalImagesPullingTime="18.814740729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:02:20.668260651 +0000 UTC m=+22.602541727" watchObservedRunningTime="2026-06-07 08:02:20.668713077 +0000 UTC m=+22.602994164" Jun 07 08:02:20.681319 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.681286 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ds8pq" podStartSLOduration=4.248426744 podStartE2EDuration="22.681274719s" totalImagesPullingTime="18.432847975s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:02:20.680968602 +0000 UTC m=+22.615249687" watchObservedRunningTime="2026-06-07 08:02:20.681274719 +0000 UTC m=+22.615555804" Jun 07 08:02:20.712738 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.712697 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2zkpp" podStartSLOduration=8.577859038 podStartE2EDuration="22.712684483s" totalImagesPullingTime="14.134825445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:02:20.712096969 +0000 UTC m=+22.646378056" watchObservedRunningTime="2026-06-07 08:02:20.712684483 +0000 UTC m=+22.646965569" Jun 07 08:02:20.727724 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.727685 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5k6l4" podStartSLOduration=3.913043156 podStartE2EDuration="22.727673237s" totalImagesPullingTime="18.814630081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:02:20.727122526 +0000 UTC m=+22.661403603" watchObservedRunningTime="2026-06-07 08:02:20.727673237 +0000 UTC m=+22.661954323" Jun 07 08:02:20.871370 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.871341 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:20.948752 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:20.948720 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:21.507445 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:21.507391 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 07 08:02:21.545902 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:21.545819 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-07T08:02:21.50742199Z","UUID":"252e34eb-4935-4072-af00-db8e7a70bcd5","Handler":null,"Name":"","Endpoint":""} Jun 07 08:02:21.547353 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:21.547327 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 07 08:02:21.547457 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:21.547375 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 07 08:02:21.651008 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:21.650978 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" event={"ID":"bbe41651-a68f-4802-9f52-cc35770441fe","Type":"ContainerStarted","Data":"27bbfc1052135e3922d41e04ca1b85da3167ac11b447d2c636609a7e8b4c1d40"} Jun 07 08:02:21.651367 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:21.651121 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" event={"ID":"bbe41651-a68f-4802-9f52-cc35770441fe","Type":"ContainerStarted","Data":"2df7cde3e62d3b8795870a4740badfe306b41e7eb0e0614ef3e69b031542264f"} Jun 07 08:02:21.651367 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:21.651182 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" event={"ID":"bbe41651-a68f-4802-9f52-cc35770441fe","Type":"ContainerStarted","Data":"63a21a41dfe07bb794a26deb033bd130d068a635504d904b3fbce0ca001ac6ea"} Jun 07 08:02:21.653183 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:21.653149 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" event={"ID":"c97f9116-68af-443a-8c41-152308ff677d","Type":"ContainerStarted","Data":"2305f177e00bed7db920bba49b979dcbf2f2d55443bddc90e66ad84191d711f5"} Jun 07 08:02:21.654795 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:21.654767 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzp2s" event={"ID":"9d2b9be4-3f35-4b32-8c7c-72a52e410172","Type":"ContainerStarted","Data":"fad52e336fd068f02bfda9be2da09310adee5d18d2efaeb99b97214273d3adcf"} Jun 07 08:02:21.668986 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:21.668949 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xzp2s" podStartSLOduration=4.885870015 podStartE2EDuration="23.668937473s" totalImagesPullingTime="18.783067458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:02:21.668905132 +0000 UTC m=+23.603186219" watchObservedRunningTime="2026-06-07 08:02:21.668937473 +0000 UTC m=+23.603218559" Jun 07 08:02:21.853315 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:21.853228 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:21.952780 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:21.952750 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:22.476722 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:22.476692 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2zkpp" Jun 07 08:02:22.477209 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:22.477195 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2zkpp" Jun 07 08:02:22.533784 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:22.533758 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:22.533784 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:22.533771 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:22.533955 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:22.533771 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:22.533955 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:22.533847 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:22.533955 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:22.533933 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:22.534126 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:22.533985 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:22.657240 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:22.657213 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2zkpp" Jun 07 08:02:22.657654 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:22.657629 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2zkpp" Jun 07 08:02:22.710967 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:22.710946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:23.662166 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:23.661972 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" event={"ID":"bbe41651-a68f-4802-9f52-cc35770441fe","Type":"ContainerStarted","Data":"76ea5292c25a5ba5edf55c644fc7c21016520e9347471ec5f3a1f9d706a417fb"} Jun 07 08:02:23.663940 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:23.663912 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" event={"ID":"c97f9116-68af-443a-8c41-152308ff677d","Type":"ContainerStarted","Data":"2a4cbc7f04c5bd76c72dcf23f458c645687499cd8af904663a5d746fd9939af6"} Jun 07 08:02:23.680609 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:23.680562 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xx5tm" podStartSLOduration=4.8464141739999995 podStartE2EDuration="25.680548534s" totalImagesPullingTime="20.83413436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:01:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:02:23.680443344 +0000 UTC m=+25.614724430" watchObservedRunningTime="2026-06-07 08:02:23.680548534 +0000 UTC m=+25.614829620" Jun 07 08:02:23.809761 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:23.809729 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:23.910732 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:23.910700 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:24.011644 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:24.011556 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:24.072192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:24.072162 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:24.532913 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:24.532881 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:24.533085 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:24.532880 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:24.533085 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:24.532975 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:24.533085 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:24.532886 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:24.533085 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:24.533048 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:24.533326 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:24.533169 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:24.876507 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:24.876419 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:24.923549 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:24.923505 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:26.533431 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:26.533277 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:26.533967 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:26.533286 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:26.533967 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:26.533503 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:26.533967 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:26.533286 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:26.533967 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:26.533582 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:26.533967 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:26.533682 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:26.671825 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:26.671794 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gg4" event={"ID":"c83c22f0-6f13-4b1c-b40b-6555159ea62f","Type":"ContainerStarted","Data":"ecf60eaf7576e17f5e82a3f3a021b059ab557edf8ce17602f7e63084ce05fdcb"} Jun 07 08:02:26.675570 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:26.675546 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" event={"ID":"bbe41651-a68f-4802-9f52-cc35770441fe","Type":"ContainerStarted","Data":"9fc315c355d6735e92bf099928056ff87e4196ee8cada7da09b96d5fd8386afc"} Jun 07 08:02:26.675942 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:26.675859 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:26.675942 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:26.675926 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:26.692346 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:26.692317 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:26.692726 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:26.692707 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:26.717275 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:26.717234 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" podStartSLOduration=9.759855904 podStartE2EDuration="28.717220972s" totalImagesPullingTime="18.957365068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:02:26.715926311 +0000 UTC m=+28.650207408" watchObservedRunningTime="2026-06-07 08:02:26.717220972 +0000 UTC m=+28.651502057" Jun 07 08:02:26.810527 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:26.810448 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:27.679712 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:27.679675 2559 generic.go:356] "Generic (PLEG): container finished" podID="c83c22f0-6f13-4b1c-b40b-6555159ea62f" containerID="ecf60eaf7576e17f5e82a3f3a021b059ab557edf8ce17602f7e63084ce05fdcb" exitCode=0 Jun 07 08:02:27.680217 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:27.679753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gg4" event={"ID":"c83c22f0-6f13-4b1c-b40b-6555159ea62f","Type":"ContainerDied","Data":"ecf60eaf7576e17f5e82a3f3a021b059ab557edf8ce17602f7e63084ce05fdcb"} Jun 07 08:02:27.680217 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:27.679912 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 07 08:02:28.182157 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:28.182124 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wdr96"] Jun 07 08:02:28.182346 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:28.182243 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:28.182440 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:28.182333 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:28.184914 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:28.184871 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nj4q2"] Jun 07 08:02:28.185050 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:28.184981 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:28.185147 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:28.185074 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:28.185595 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:28.185569 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-txfv9"] Jun 07 08:02:28.185694 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:28.185676 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:28.185805 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:28.185770 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:28.388442 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:28.388376 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:29.533226 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:29.533157 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:29.533571 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:29.533162 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:29.533571 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:29.533274 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:29.533571 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:29.533321 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:29.686025 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:29.685864 2559 generic.go:356] "Generic (PLEG): container finished" podID="c83c22f0-6f13-4b1c-b40b-6555159ea62f" containerID="216827f1ec6a5725d6cf0c3aafd7bd9cbcae3fe8760414df384a5c860aea7682" exitCode=0 Jun 07 08:02:29.686192 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:29.685900 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gg4" event={"ID":"c83c22f0-6f13-4b1c-b40b-6555159ea62f","Type":"ContainerDied","Data":"216827f1ec6a5725d6cf0c3aafd7bd9cbcae3fe8760414df384a5c860aea7682"} Jun 07 08:02:30.536718 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:30.536698 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:30.537021 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:30.536788 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:31.533800 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:31.533760 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:31.533966 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:31.533870 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj4q2" podUID="7a03170d-f27f-46f7-bad8-4573b640eb20" Jun 07 08:02:31.533966 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:31.533922 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:31.534039 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:31.534018 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:02:31.695493 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:31.695460 2559 generic.go:356] "Generic (PLEG): container finished" podID="c83c22f0-6f13-4b1c-b40b-6555159ea62f" containerID="aa9764c1add3a8accc512d83b29c84a8cb3f11e7a38a34f4462275895827ded9" exitCode=0 Jun 07 08:02:31.695916 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:31.695513 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gg4" event={"ID":"c83c22f0-6f13-4b1c-b40b-6555159ea62f","Type":"ContainerDied","Data":"aa9764c1add3a8accc512d83b29c84a8cb3f11e7a38a34f4462275895827ded9"} Jun 07 08:02:32.228446 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.228414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:32.228627 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.228484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:32.228627 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:32.228567 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:32.228735 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:32.228643 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret podName:7a03170d-f27f-46f7-bad8-4573b640eb20 nodeName:}" failed. No retries permitted until 2026-06-07 08:03:04.228621911 +0000 UTC m=+66.162902987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret") pod "global-pull-secret-syncer-nj4q2" (UID: "7a03170d-f27f-46f7-bad8-4573b640eb20") : object "kube-system"/"original-pull-secret" not registered Jun 07 08:02:32.228735 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:32.228573 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:32.228735 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:32.228724 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs podName:a0fbf718-ddd2-498e-bfdb-04cf8364884d nodeName:}" failed. No retries permitted until 2026-06-07 08:03:04.228697751 +0000 UTC m=+66.162978831 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs") pod "network-metrics-daemon-txfv9" (UID: "a0fbf718-ddd2-498e-bfdb-04cf8364884d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 08:02:32.430886 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.430849 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2wf\" (UniqueName: \"kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf\") pod \"network-check-target-wdr96\" (UID: \"0a3db7fd-93b2-42d8-9be4-52ba8687eb4c\") " pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:32.431041 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:32.431005 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 08:02:32.431041 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:32.431024 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 08:02:32.431041 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:32.431033 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9s2wf for pod openshift-network-diagnostics/network-check-target-wdr96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:32.431163 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:32.431087 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf podName:0a3db7fd-93b2-42d8-9be4-52ba8687eb4c nodeName:}" failed. No retries permitted until 2026-06-07 08:03:04.431066467 +0000 UTC m=+66.365347551 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s2wf" (UniqueName: "kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf") pod "network-check-target-wdr96" (UID: "0a3db7fd-93b2-42d8-9be4-52ba8687eb4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 08:02:32.533870 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.533805 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:32.534019 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:32.533909 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdr96" podUID="0a3db7fd-93b2-42d8-9be4-52ba8687eb4c" Jun 07 08:02:32.884715 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.884640 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-99.ec2.internal" event="NodeReady" Jun 07 08:02:32.885261 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.884775 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 07 08:02:32.923507 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.923473 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2qj4k"] Jun 07 08:02:32.925243 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.925223 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:32.926392 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.926372 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-296jh"] Jun 07 08:02:32.927532 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.927512 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 07 08:02:32.927604 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.927570 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 07 08:02:32.927604 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.927582 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f7smc\"" Jun 07 08:02:32.927939 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.927920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-296jh" Jun 07 08:02:32.929909 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.929886 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 07 08:02:32.930163 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.930053 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 07 08:02:32.930544 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.930527 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l6blh\"" Jun 07 08:02:32.930594 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.930527 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 07 08:02:32.935558 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.935539 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2qj4k"] Jun 07 08:02:32.938809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:32.938788 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-296jh"] Jun 07 08:02:33.034900 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.034869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d66177-6372-411b-be13-63a8d12b2f35-cert\") pod \"ingress-canary-296jh\" (UID: \"88d66177-6372-411b-be13-63a8d12b2f35\") " pod="openshift-ingress-canary/ingress-canary-296jh" Jun 07 08:02:33.035048 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.034967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:33.035048 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.035026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwjdq\" (UniqueName: \"kubernetes.io/projected/a900da45-2f59-4457-b120-e3c0046f6332-kube-api-access-jwjdq\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:33.035191 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.035045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldq9f\" (UniqueName: \"kubernetes.io/projected/88d66177-6372-411b-be13-63a8d12b2f35-kube-api-access-ldq9f\") pod \"ingress-canary-296jh\" (UID: \"88d66177-6372-411b-be13-63a8d12b2f35\") " pod="openshift-ingress-canary/ingress-canary-296jh" Jun 07 08:02:33.035191 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.035094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a900da45-2f59-4457-b120-e3c0046f6332-config-volume\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:33.035191 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.035144 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a900da45-2f59-4457-b120-e3c0046f6332-tmp-dir\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:33.036008 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.035983 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:33.136475 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.136383 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:33.136475 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.136466 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwjdq\" (UniqueName: \"kubernetes.io/projected/a900da45-2f59-4457-b120-e3c0046f6332-kube-api-access-jwjdq\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:33.136705 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.136490 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldq9f\" (UniqueName: \"kubernetes.io/projected/88d66177-6372-411b-be13-63a8d12b2f35-kube-api-access-ldq9f\") pod \"ingress-canary-296jh\" (UID: \"88d66177-6372-411b-be13-63a8d12b2f35\") " pod="openshift-ingress-canary/ingress-canary-296jh" Jun 07 08:02:33.136705 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.136516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a900da45-2f59-4457-b120-e3c0046f6332-config-volume\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:33.136705 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:33.136539 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 08:02:33.136705 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.136555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a900da45-2f59-4457-b120-e3c0046f6332-tmp-dir\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:33.136705 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.136593 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d66177-6372-411b-be13-63a8d12b2f35-cert\") pod \"ingress-canary-296jh\" (UID: \"88d66177-6372-411b-be13-63a8d12b2f35\") " pod="openshift-ingress-canary/ingress-canary-296jh" Jun 07 08:02:33.136705 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:33.136612 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls podName:a900da45-2f59-4457-b120-e3c0046f6332 nodeName:}" failed. No retries permitted until 2026-06-07 08:02:33.63659357 +0000 UTC m=+35.570874659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls") pod "dns-default-2qj4k" (UID: "a900da45-2f59-4457-b120-e3c0046f6332") : secret "dns-default-metrics-tls" not found Jun 07 08:02:33.137014 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.136993 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a900da45-2f59-4457-b120-e3c0046f6332-tmp-dir\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:33.137226 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.137205 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a900da45-2f59-4457-b120-e3c0046f6332-config-volume\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:33.137648 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.137621 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:33.141607 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.141586 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d66177-6372-411b-be13-63a8d12b2f35-cert\") pod \"ingress-canary-296jh\" (UID: \"88d66177-6372-411b-be13-63a8d12b2f35\") " pod="openshift-ingress-canary/ingress-canary-296jh" Jun 07 08:02:33.145084 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.145060 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldq9f\" (UniqueName: \"kubernetes.io/projected/88d66177-6372-411b-be13-63a8d12b2f35-kube-api-access-ldq9f\") pod \"ingress-canary-296jh\" (UID: \"88d66177-6372-411b-be13-63a8d12b2f35\") " pod="openshift-ingress-canary/ingress-canary-296jh" Jun 07 08:02:33.145292 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.145271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwjdq\" (UniqueName: \"kubernetes.io/projected/a900da45-2f59-4457-b120-e3c0046f6332-kube-api-access-jwjdq\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:33.241558 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.241528 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-296jh" Jun 07 08:02:33.393911 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.393699 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-296jh"] Jun 07 08:02:33.397709 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:02:33.397679 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d66177_6372_411b_be13_63a8d12b2f35.slice/crio-5aeeeca4eabbe2c51fad56d324b871c5b71b2daec8c7d4dfe7b67f9ee65f2651 WatchSource:0}: Error finding container 5aeeeca4eabbe2c51fad56d324b871c5b71b2daec8c7d4dfe7b67f9ee65f2651: Status 404 returned error can't find the container with id 5aeeeca4eabbe2c51fad56d324b871c5b71b2daec8c7d4dfe7b67f9ee65f2651 Jun 07 08:02:33.533323 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.533294 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:02:33.533443 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.533294 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:02:33.536035 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.536010 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27w6v\"" Jun 07 08:02:33.536162 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.536047 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 08:02:33.536162 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.536118 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 08:02:33.640460 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.640434 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:33.640632 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:33.640614 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 08:02:33.640694 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:33.640683 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls podName:a900da45-2f59-4457-b120-e3c0046f6332 nodeName:}" failed. No retries permitted until 2026-06-07 08:02:34.640667585 +0000 UTC m=+36.574948648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls") pod "dns-default-2qj4k" (UID: "a900da45-2f59-4457-b120-e3c0046f6332") : secret "dns-default-metrics-tls" not found Jun 07 08:02:33.701166 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:33.701135 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-296jh" event={"ID":"88d66177-6372-411b-be13-63a8d12b2f35","Type":"ContainerStarted","Data":"5aeeeca4eabbe2c51fad56d324b871c5b71b2daec8c7d4dfe7b67f9ee65f2651"} Jun 07 08:02:34.533247 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:34.533214 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:02:34.536115 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:34.536048 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 08:02:34.537007 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:34.536984 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 08:02:34.537007 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:34.536988 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zw2zf\"" Jun 07 08:02:34.649532 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:34.649359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:34.649720 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:34.649560 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 08:02:34.649720 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:34.649630 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls podName:a900da45-2f59-4457-b120-e3c0046f6332 nodeName:}" failed. No retries permitted until 2026-06-07 08:02:36.649611017 +0000 UTC m=+38.583892083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls") pod "dns-default-2qj4k" (UID: "a900da45-2f59-4457-b120-e3c0046f6332") : secret "dns-default-metrics-tls" not found Jun 07 08:02:36.085012 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:36.084984 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:36.135033 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:36.134994 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:36.664282 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:36.664249 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:36.664442 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:36.664391 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 08:02:36.664570 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:36.664458 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls podName:a900da45-2f59-4457-b120-e3c0046f6332 nodeName:}" failed. No retries permitted until 2026-06-07 08:02:40.664440089 +0000 UTC m=+42.598721153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls") pod "dns-default-2qj4k" (UID: "a900da45-2f59-4457-b120-e3c0046f6332") : secret "dns-default-metrics-tls" not found Jun 07 08:02:37.549349 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:37.549309 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:37.597915 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:37.597887 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:37.712195 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:37.712162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-296jh" event={"ID":"88d66177-6372-411b-be13-63a8d12b2f35","Type":"ContainerStarted","Data":"c3ded4609cafcd2a028be572ea57a2b31c089c8dfc75752f4fef209312e8fe79"} Jun 07 08:02:37.714756 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:37.714733 2559 generic.go:356] "Generic (PLEG): container finished" podID="c83c22f0-6f13-4b1c-b40b-6555159ea62f" containerID="c280e83c127dbfdf8ad8041e01167ebbb323ce3cf3d0525f4ce3c46db522711d" exitCode=0 Jun 07 08:02:37.714865 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:37.714779 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gg4" event={"ID":"c83c22f0-6f13-4b1c-b40b-6555159ea62f","Type":"ContainerDied","Data":"c280e83c127dbfdf8ad8041e01167ebbb323ce3cf3d0525f4ce3c46db522711d"} Jun 07 08:02:37.733161 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:37.730130 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-296jh" podStartSLOduration=2.293716881 podStartE2EDuration="5.730116026s" totalImagesPullingTime="3.436399145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:02:37.730087216 +0000 UTC m=+39.664368302" watchObservedRunningTime="2026-06-07 08:02:37.730116026 +0000 UTC m=+39.664397102" Jun 07 08:02:38.330092 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:38.330060 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:38.383450 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:38.383418 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:38.719964 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:38.719936 2559 generic.go:356] "Generic (PLEG): container finished" podID="c83c22f0-6f13-4b1c-b40b-6555159ea62f" containerID="ccb0db4f0d040b5caca7f293d82d7c6206999e74bc18c7c6af5c3d9269e1df77" exitCode=0 Jun 07 08:02:38.720455 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:38.720018 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gg4" event={"ID":"c83c22f0-6f13-4b1c-b40b-6555159ea62f","Type":"ContainerDied","Data":"ccb0db4f0d040b5caca7f293d82d7c6206999e74bc18c7c6af5c3d9269e1df77"} Jun 07 08:02:39.726179 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:39.726146 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gg4" event={"ID":"c83c22f0-6f13-4b1c-b40b-6555159ea62f","Type":"ContainerStarted","Data":"f0e19b2afda96c1363f255d9c91af0a3affa3258f840a4b369c127dcbfec95d1"} Jun 07 08:02:39.749300 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:39.749255 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z8gg4" podStartSLOduration=9.94554921 podStartE2EDuration="41.749241904s" totalImagesPullingTime="31.803692694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:01:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:02:39.746537171 +0000 UTC m=+41.680818263" watchObservedRunningTime="2026-06-07 08:02:39.749241904 +0000 UTC m=+41.683522990" Jun 07 08:02:39.843423 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:39.843382 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:39.897227 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:39.897197 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:40.694361 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:40.694327 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:40.694536 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:40.694477 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 08:02:40.694580 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:40.694543 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls podName:a900da45-2f59-4457-b120-e3c0046f6332 nodeName:}" failed. No retries permitted until 2026-06-07 08:02:48.694526998 +0000 UTC m=+50.628808062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls") pod "dns-default-2qj4k" (UID: "a900da45-2f59-4457-b120-e3c0046f6332") : secret "dns-default-metrics-tls" not found Jun 07 08:02:40.823289 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:40.823250 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:40.923763 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:40.923733 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:41.024584 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:41.024501 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:41.124348 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:41.124314 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:48.747627 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:48.747594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:02:48.748165 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:48.747720 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 08:02:48.748165 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:02:48.747767 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls podName:a900da45-2f59-4457-b120-e3c0046f6332 nodeName:}" failed. No retries permitted until 2026-06-07 08:03:04.747754038 +0000 UTC m=+66.682035103 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls") pod "dns-default-2qj4k" (UID: "a900da45-2f59-4457-b120-e3c0046f6332") : secret "dns-default-metrics-tls" not found Jun 07 08:02:58.353001 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.352968 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx"] Jun 07 08:02:58.392857 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.392829 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv"] Jun 07 08:02:58.392995 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.392955 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" Jun 07 08:02:58.395816 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.395794 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 07 08:02:58.395944 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.395836 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qb7bp\"" Jun 07 08:02:58.395944 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.395802 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 07 08:02:58.395944 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.395795 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 07 08:02:58.396131 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.396088 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 07 08:02:58.408405 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.408382 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx"] Jun 07 08:02:58.408405 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.408407 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv"] Jun 07 08:02:58.408535 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.408472 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.410755 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.410738 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 07 08:02:58.410854 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.410825 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 07 08:02:58.410971 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.410958 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 07 08:02:58.411015 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.411004 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 07 08:02:58.513309 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.513278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/629bfbb7-dd56-4394-9a93-b6fc09f78035-hub\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.513454 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.513323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/629bfbb7-dd56-4394-9a93-b6fc09f78035-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.513454 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.513386 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z2dz\" (UniqueName: \"kubernetes.io/projected/629bfbb7-dd56-4394-9a93-b6fc09f78035-kube-api-access-4z2dz\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.513454 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.513429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/629bfbb7-dd56-4394-9a93-b6fc09f78035-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.513564 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.513476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/629bfbb7-dd56-4394-9a93-b6fc09f78035-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.513564 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.513494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/60f9a3db-22ec-4237-911c-b01c461ff9cf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-699cb67c74-9xqwx\" (UID: \"60f9a3db-22ec-4237-911c-b01c461ff9cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" Jun 07 08:02:58.513564 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.513512 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/629bfbb7-dd56-4394-9a93-b6fc09f78035-ca\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.513564 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.513544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phxlp\" (UniqueName: \"kubernetes.io/projected/60f9a3db-22ec-4237-911c-b01c461ff9cf-kube-api-access-phxlp\") pod \"managed-serviceaccount-addon-agent-699cb67c74-9xqwx\" (UID: \"60f9a3db-22ec-4237-911c-b01c461ff9cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" Jun 07 08:02:58.613921 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.613861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/629bfbb7-dd56-4394-9a93-b6fc09f78035-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.613921 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.613898 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/60f9a3db-22ec-4237-911c-b01c461ff9cf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-699cb67c74-9xqwx\" (UID: \"60f9a3db-22ec-4237-911c-b01c461ff9cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" Jun 07 08:02:58.613921 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.613916 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/629bfbb7-dd56-4394-9a93-b6fc09f78035-ca\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.614190 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.613967 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phxlp\" (UniqueName: \"kubernetes.io/projected/60f9a3db-22ec-4237-911c-b01c461ff9cf-kube-api-access-phxlp\") pod \"managed-serviceaccount-addon-agent-699cb67c74-9xqwx\" (UID: \"60f9a3db-22ec-4237-911c-b01c461ff9cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" Jun 07 08:02:58.614190 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.613997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/629bfbb7-dd56-4394-9a93-b6fc09f78035-hub\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.614190 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.614018 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/629bfbb7-dd56-4394-9a93-b6fc09f78035-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.614190 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.614088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z2dz\" (UniqueName: \"kubernetes.io/projected/629bfbb7-dd56-4394-9a93-b6fc09f78035-kube-api-access-4z2dz\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.614190 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.614135 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/629bfbb7-dd56-4394-9a93-b6fc09f78035-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.616621 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.616594 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 07 08:02:58.616621 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.616596 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 07 08:02:58.616804 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.616596 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 07 08:02:58.616927 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.616907 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 07 08:02:58.617000 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.616986 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 07 08:02:58.617211 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.617195 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 07 08:02:58.621765 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.621745 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 07 08:02:58.624904 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.624879 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/629bfbb7-dd56-4394-9a93-b6fc09f78035-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.627829 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.627806 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/629bfbb7-dd56-4394-9a93-b6fc09f78035-hub\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.627938 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.627919 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/629bfbb7-dd56-4394-9a93-b6fc09f78035-ca\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.628042 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.628024 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/60f9a3db-22ec-4237-911c-b01c461ff9cf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-699cb67c74-9xqwx\" (UID: \"60f9a3db-22ec-4237-911c-b01c461ff9cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" Jun 07 08:02:58.628078 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.628046 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/629bfbb7-dd56-4394-9a93-b6fc09f78035-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.628150 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.628131 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/629bfbb7-dd56-4394-9a93-b6fc09f78035-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.631698 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.631673 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phxlp\" (UniqueName: \"kubernetes.io/projected/60f9a3db-22ec-4237-911c-b01c461ff9cf-kube-api-access-phxlp\") pod \"managed-serviceaccount-addon-agent-699cb67c74-9xqwx\" (UID: \"60f9a3db-22ec-4237-911c-b01c461ff9cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" Jun 07 08:02:58.642617 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.642591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z2dz\" (UniqueName: \"kubernetes.io/projected/629bfbb7-dd56-4394-9a93-b6fc09f78035-kube-api-access-4z2dz\") pod \"cluster-proxy-proxy-agent-7c7c4667dc-djtfv\" (UID: \"629bfbb7-dd56-4394-9a93-b6fc09f78035\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.714990 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.714961 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 07 08:02:58.719063 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.719048 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:02:58.725125 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.725092 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qb7bp\"" Jun 07 08:02:58.734157 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.734143 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" Jun 07 08:02:58.882905 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.882836 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv"] Jun 07 08:02:58.886217 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:02:58.886195 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod629bfbb7_dd56_4394_9a93_b6fc09f78035.slice/crio-66c18a692f8104c40cf63ed6f8320d7ce539f55ea1eed1528851715bb39cb709 WatchSource:0}: Error finding container 66c18a692f8104c40cf63ed6f8320d7ce539f55ea1eed1528851715bb39cb709: Status 404 returned error can't find the container with id 66c18a692f8104c40cf63ed6f8320d7ce539f55ea1eed1528851715bb39cb709 Jun 07 08:02:58.892959 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:58.892939 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx"] Jun 07 08:02:58.895743 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:02:58.895720 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60f9a3db_22ec_4237_911c_b01c461ff9cf.slice/crio-72bd7b578fb2e291b94f77d98d2e4dbd404c49b1486f65a093571c3cab26b5c6 WatchSource:0}: Error finding container 72bd7b578fb2e291b94f77d98d2e4dbd404c49b1486f65a093571c3cab26b5c6: Status 404 returned error can't find the container with id 72bd7b578fb2e291b94f77d98d2e4dbd404c49b1486f65a093571c3cab26b5c6 Jun 07 08:02:59.708477 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:59.707882 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2zgd" Jun 07 08:02:59.775549 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:59.775476 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" event={"ID":"60f9a3db-22ec-4237-911c-b01c461ff9cf","Type":"ContainerStarted","Data":"72bd7b578fb2e291b94f77d98d2e4dbd404c49b1486f65a093571c3cab26b5c6"} Jun 07 08:02:59.777830 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:59.777767 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" event={"ID":"629bfbb7-dd56-4394-9a93-b6fc09f78035","Type":"ContainerStarted","Data":"66c18a692f8104c40cf63ed6f8320d7ce539f55ea1eed1528851715bb39cb709"} Jun 07 08:02:59.863516 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:59.863341 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:02:59.959763 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:02:59.959663 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:03:01.908808 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:01.908773 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:03:01.971892 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:01.971850 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:03:02.032637 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:02.032595 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:03:03.789883 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:03.789848 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" event={"ID":"60f9a3db-22ec-4237-911c-b01c461ff9cf","Type":"ContainerStarted","Data":"1ba3c9940b0c2d49b8987c01f544d1ead9f10aa2b30ba497ab8a3b03c5e98831"} Jun 07 08:03:03.791946 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:03.791923 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" event={"ID":"629bfbb7-dd56-4394-9a93-b6fc09f78035","Type":"ContainerStarted","Data":"35d98e2370d8d0ca59980d62aaebd61b7afcea3aebcbadf350611b363cd655a9"} Jun 07 08:03:03.792064 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:03.791958 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" event={"ID":"629bfbb7-dd56-4394-9a93-b6fc09f78035","Type":"ContainerStarted","Data":"61a73fecb69eb96995a04e79e8c2f4f7ef296c4478f6acddb4172c5354cdd753"} Jun 07 08:03:03.792064 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:03.791977 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" event={"ID":"629bfbb7-dd56-4394-9a93-b6fc09f78035","Type":"ContainerStarted","Data":"f5d215213b28e495a2c100e9725102d8da1c2f46fdadada59696d5cf174d18d7"} Jun 07 08:03:03.804904 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:03.804861 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" podStartSLOduration=1.353859141 podStartE2EDuration="5.804846128s" totalImagesPullingTime="4.450986987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:03:03.80439833 +0000 UTC m=+65.738679416" watchObservedRunningTime="2026-06-07 08:03:03.804846128 +0000 UTC m=+65.739127214" Jun 07 08:03:03.823586 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:03.823541 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" podStartSLOduration=1.351857708 podStartE2EDuration="5.823525705s" totalImagesPullingTime="4.471667997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:03:03.822842944 +0000 UTC m=+65.757124030" watchObservedRunningTime="2026-06-07 08:03:03.823525705 +0000 UTC m=+65.757806790" Jun 07 08:03:04.261258 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.261198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:03:04.261258 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.261261 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:03:04.263557 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.263538 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 08:03:04.263630 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.263583 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 08:03:04.271593 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:03:04.271564 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 08:03:04.271699 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:03:04.271637 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs podName:a0fbf718-ddd2-498e-bfdb-04cf8364884d nodeName:}" failed. No retries permitted until 2026-06-07 08:04:08.2716198 +0000 UTC m=+130.205900877 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs") pod "network-metrics-daemon-txfv9" (UID: "a0fbf718-ddd2-498e-bfdb-04cf8364884d") : secret "metrics-daemon-secret" not found Jun 07 08:03:04.273885 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.273850 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a03170d-f27f-46f7-bad8-4573b640eb20-original-pull-secret\") pod \"global-pull-secret-syncer-nj4q2\" (UID: \"7a03170d-f27f-46f7-bad8-4573b640eb20\") " pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:03:04.443425 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.443387 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj4q2" Jun 07 08:03:04.463332 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.463298 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2wf\" (UniqueName: \"kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf\") pod \"network-check-target-wdr96\" (UID: \"0a3db7fd-93b2-42d8-9be4-52ba8687eb4c\") " pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:03:04.465812 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.465781 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 08:03:04.475996 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.475962 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 08:03:04.486758 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.486728 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s2wf\" (UniqueName: \"kubernetes.io/projected/0a3db7fd-93b2-42d8-9be4-52ba8687eb4c-kube-api-access-9s2wf\") pod \"network-check-target-wdr96\" (UID: \"0a3db7fd-93b2-42d8-9be4-52ba8687eb4c\") " pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:03:04.547653 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.547626 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zw2zf\"" Jun 07 08:03:04.555841 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.555813 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:03:04.566219 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.566194 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nj4q2"] Jun 07 08:03:04.569863 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:03:04.569840 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a03170d_f27f_46f7_bad8_4573b640eb20.slice/crio-221a9a74a4fb8070738b9f709e7f32a96df7ccab1973b9a1f23378a90a0ad412 WatchSource:0}: Error finding container 221a9a74a4fb8070738b9f709e7f32a96df7ccab1973b9a1f23378a90a0ad412: Status 404 returned error can't find the container with id 221a9a74a4fb8070738b9f709e7f32a96df7ccab1973b9a1f23378a90a0ad412 Jun 07 08:03:04.672397 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.672362 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wdr96"] Jun 07 08:03:04.674913 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:03:04.674881 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3db7fd_93b2_42d8_9be4_52ba8687eb4c.slice/crio-146cbcdd272e5ae4fa0527270ecb062f42edc5ea05169323bd7abb3d68e3831c WatchSource:0}: Error finding container 146cbcdd272e5ae4fa0527270ecb062f42edc5ea05169323bd7abb3d68e3831c: Status 404 returned error can't find the container with id 146cbcdd272e5ae4fa0527270ecb062f42edc5ea05169323bd7abb3d68e3831c Jun 07 08:03:04.766694 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.766658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:03:04.766855 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:03:04.766784 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 08:03:04.766855 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:03:04.766852 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls podName:a900da45-2f59-4457-b120-e3c0046f6332 nodeName:}" failed. No retries permitted until 2026-06-07 08:03:36.766836243 +0000 UTC m=+98.701117335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls") pod "dns-default-2qj4k" (UID: "a900da45-2f59-4457-b120-e3c0046f6332") : secret "dns-default-metrics-tls" not found Jun 07 08:03:04.795725 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.795644 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wdr96" event={"ID":"0a3db7fd-93b2-42d8-9be4-52ba8687eb4c","Type":"ContainerStarted","Data":"146cbcdd272e5ae4fa0527270ecb062f42edc5ea05169323bd7abb3d68e3831c"} Jun 07 08:03:04.796778 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:04.796752 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nj4q2" event={"ID":"7a03170d-f27f-46f7-bad8-4573b640eb20","Type":"ContainerStarted","Data":"221a9a74a4fb8070738b9f709e7f32a96df7ccab1973b9a1f23378a90a0ad412"} Jun 07 08:03:09.813229 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:09.813185 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wdr96" event={"ID":"0a3db7fd-93b2-42d8-9be4-52ba8687eb4c","Type":"ContainerStarted","Data":"e884bf41da9475efa12ccbfe9896f5b239cb7eb45d574848febe58beaf7bd26a"} Jun 07 08:03:09.813704 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:09.813283 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:03:09.814650 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:09.814625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nj4q2" event={"ID":"7a03170d-f27f-46f7-bad8-4573b640eb20","Type":"ContainerStarted","Data":"4c0fc7ae73197488f7eb0e08bdf5148557ca7f8340cb9b121e7715dbb4ae484a"} Jun 07 08:03:09.827735 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:09.827689 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wdr96" podStartSLOduration=67.409048127 podStartE2EDuration="1m11.82767654s" totalImagesPullingTime="4.418628413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:03:09.826839033 +0000 UTC m=+71.761120118" watchObservedRunningTime="2026-06-07 08:03:09.82767654 +0000 UTC m=+71.761957625" Jun 07 08:03:09.840694 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:09.840639 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nj4q2" podStartSLOduration=67.313103873 podStartE2EDuration="1m11.840625338s" totalImagesPullingTime="4.527521465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:03:09.839739845 +0000 UTC m=+71.774020930" watchObservedRunningTime="2026-06-07 08:03:09.840625338 +0000 UTC m=+71.774906423" Jun 07 08:03:36.781649 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:36.781618 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:03:36.782098 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:03:36.781768 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 08:03:36.782098 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:03:36.781842 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls podName:a900da45-2f59-4457-b120-e3c0046f6332 nodeName:}" failed. No retries permitted until 2026-06-07 08:04:40.781825505 +0000 UTC m=+162.716106587 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls") pod "dns-default-2qj4k" (UID: "a900da45-2f59-4457-b120-e3c0046f6332") : secret "dns-default-metrics-tls" not found Jun 07 08:03:40.819862 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:03:40.819833 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wdr96" Jun 07 08:04:08.276368 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:04:08.276318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:04:08.276944 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:04:08.276445 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 08:04:08.276944 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:04:08.276532 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs podName:a0fbf718-ddd2-498e-bfdb-04cf8364884d nodeName:}" failed. No retries permitted until 2026-06-07 08:06:10.276518597 +0000 UTC m=+252.210799660 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs") pod "network-metrics-daemon-txfv9" (UID: "a0fbf718-ddd2-498e-bfdb-04cf8364884d") : secret "metrics-daemon-secret" not found Jun 07 08:04:35.934982 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:04:35.934939 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2qj4k" podUID="a900da45-2f59-4457-b120-e3c0046f6332" Jun 07 08:04:36.054157 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:04:36.054127 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2qj4k" Jun 07 08:04:36.548444 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:04:36.548411 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-txfv9" podUID="a0fbf718-ddd2-498e-bfdb-04cf8364884d" Jun 07 08:04:40.791984 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:04:40.791888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:04:40.792390 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:04:40.792046 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 08:04:40.792390 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:04:40.792137 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls podName:a900da45-2f59-4457-b120-e3c0046f6332 nodeName:}" failed. No retries permitted until 2026-06-07 08:06:42.792120362 +0000 UTC m=+284.726401425 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls") pod "dns-default-2qj4k" (UID: "a900da45-2f59-4457-b120-e3c0046f6332") : secret "dns-default-metrics-tls" not found Jun 07 08:04:50.533398 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:04:50.533360 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:05:04.128391 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:04.128353 2559 generic.go:356] "Generic (PLEG): container finished" podID="60f9a3db-22ec-4237-911c-b01c461ff9cf" containerID="1ba3c9940b0c2d49b8987c01f544d1ead9f10aa2b30ba497ab8a3b03c5e98831" exitCode=255 Jun 07 08:05:04.128891 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:04.128420 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" event={"ID":"60f9a3db-22ec-4237-911c-b01c461ff9cf","Type":"ContainerDied","Data":"1ba3c9940b0c2d49b8987c01f544d1ead9f10aa2b30ba497ab8a3b03c5e98831"} Jun 07 08:05:04.128891 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:04.128783 2559 scope.go:117] "RemoveContainer" containerID="1ba3c9940b0c2d49b8987c01f544d1ead9f10aa2b30ba497ab8a3b03c5e98831" Jun 07 08:05:05.133206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:05.133173 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-699cb67c74-9xqwx" event={"ID":"60f9a3db-22ec-4237-911c-b01c461ff9cf","Type":"ContainerStarted","Data":"314063e34e67ca8111c4d8fa658f6f61e8bde1a1646e8326d6abb8ba49ea1555"} Jun 07 08:05:08.372533 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:08.372484 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:31.061550 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:31.061501 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:31.160723 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:31.160689 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:32.343047 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:32.343015 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:32.391623 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:32.391592 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:35.368732 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:35.368701 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:35.683436 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:35.683412 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:35.790494 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:35.790466 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:35.887593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:35.887566 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:36.006131 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:36.006049 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:36.115983 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:36.115949 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:37.399116 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:37.399086 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ds8pq_9645848d-2127-444b-a1d7-f9b3900d73f9/dns-node-resolver/0.log" Jun 07 08:05:37.719564 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:37.719491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:37.817499 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:37.817465 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:38.069711 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:38.069631 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:38.184260 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:38.184232 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:38.398593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:38.398571 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g6wbj_a9dc3174-a326-46e3-a685-4ccafa45b1fd/node-ca/0.log" Jun 07 08:05:38.873304 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:38.873217 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:39.199825 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:39.199804 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-296jh_88d66177-6372-411b-be13-63a8d12b2f35/serve-healthcheck-canary/0.log" Jun 07 08:05:39.841660 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:39.841635 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:40.163419 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:40.163387 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:40.333232 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:40.333196 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:40.939552 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:40.939520 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:41.321662 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:41.321562 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:41.747660 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:41.747628 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:42.114929 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:42.114856 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:42.340578 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:42.340551 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:42.934832 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:42.934801 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:43.148652 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:43.148624 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:43.339223 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:43.339152 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:43.561185 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:43.561159 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:43.735119 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:43.735062 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:43.939010 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:43.938986 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:44.039774 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:44.039713 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:44.581867 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:44.581842 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:44.921477 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:44.921444 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:45.134979 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:45.134953 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:45.721236 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:45.721204 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:46.123579 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:46.123461 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:46.227455 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:46.227426 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:46.326048 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:46.326025 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:46.731976 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:46.731947 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:47.522458 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:47.522405 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:47.761733 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:47.761701 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:47.915288 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:47.915263 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:48.330005 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:48.329929 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:48.754355 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:48.754328 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:48.856087 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:48.856054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:49.368817 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:49.368781 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:49.937756 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:49.937722 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:50.131116 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:50.131077 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:50.343308 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:50.343199 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:50.538979 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:50.538949 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:50.799313 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:50.799275 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:54.829401 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:54.829357 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:54.929714 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:54.929685 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:54.996727 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:54.996707 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:55.137080 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:55.136979 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:55.308990 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:55.308958 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:55.389942 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:55.389849 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:55.714128 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:55.714058 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:55.917421 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:55.917394 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:55.973785 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:55.973680 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:56.366535 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:56.366461 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:56.521739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:56.521710 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:56.622297 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:56.622199 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:58.170849 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:58.170819 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:05:58.270468 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:05:58.270437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:00.025973 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.025942 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:00.079718 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.079687 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:00.648667 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.648636 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-992qd"] Jun 07 08:06:00.650546 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.650531 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.654474 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.654453 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 07 08:06:00.654594 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.654482 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jp8s9\"" Jun 07 08:06:00.654767 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.654742 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 07 08:06:00.654857 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.654748 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 07 08:06:00.654857 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.654748 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 07 08:06:00.676771 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.676750 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-992qd"] Jun 07 08:06:00.728616 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.728596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-data-volume\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.728721 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.728627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.728721 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.728648 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-crio-socket\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.728808 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.728721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.728808 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.728748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2t6t\" (UniqueName: \"kubernetes.io/projected/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-kube-api-access-n2t6t\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.790905 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.790873 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:00.829631 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.829600 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.829747 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.829646 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2t6t\" (UniqueName: \"kubernetes.io/projected/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-kube-api-access-n2t6t\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.829747 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.829696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-data-volume\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.829747 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.829731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.829894 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.829761 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-crio-socket\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.829894 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.829834 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-crio-socket\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.830000 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.829983 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-data-volume\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.830141 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.830126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.831996 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.831976 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.836846 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.836825 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f7dbd49db-wl4kr"] Jun 07 08:06:00.838857 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.838844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:00.841535 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.841517 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 07 08:06:00.841740 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.841718 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 07 08:06:00.841855 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.841794 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 07 08:06:00.841914 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.841866 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d6cgd\"" Jun 07 08:06:00.843754 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.843728 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2t6t\" (UniqueName: \"kubernetes.io/projected/9fb5c2a7-ca60-42b7-bd32-ba42aec895d0-kube-api-access-n2t6t\") pod \"insights-runtime-extractor-992qd\" (UID: \"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0\") " pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.849438 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.849416 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 07 08:06:00.859248 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.859228 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f7dbd49db-wl4kr"] Jun 07 08:06:00.895554 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.895529 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:00.930203 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.930159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b1040d1-ebbb-4935-a6ca-8c8585949274-installation-pull-secrets\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:00.930203 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.930183 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b1040d1-ebbb-4935-a6ca-8c8585949274-registry-tls\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:00.930203 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.930200 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b1040d1-ebbb-4935-a6ca-8c8585949274-bound-sa-token\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:00.930347 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.930215 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b1040d1-ebbb-4935-a6ca-8c8585949274-trusted-ca\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:00.930347 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.930231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srjhs\" (UniqueName: \"kubernetes.io/projected/7b1040d1-ebbb-4935-a6ca-8c8585949274-kube-api-access-srjhs\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:00.930347 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.930324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b1040d1-ebbb-4935-a6ca-8c8585949274-registry-certificates\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:00.930439 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.930372 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b1040d1-ebbb-4935-a6ca-8c8585949274-ca-trust-extracted\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:00.930439 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.930429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b1040d1-ebbb-4935-a6ca-8c8585949274-image-registry-private-configuration\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:00.959504 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.959486 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-992qd" Jun 07 08:06:00.991826 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:00.991803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:01.030698 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.030674 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b1040d1-ebbb-4935-a6ca-8c8585949274-registry-certificates\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.031072 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.030721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b1040d1-ebbb-4935-a6ca-8c8585949274-ca-trust-extracted\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.031072 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.030759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b1040d1-ebbb-4935-a6ca-8c8585949274-image-registry-private-configuration\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.031072 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.030776 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b1040d1-ebbb-4935-a6ca-8c8585949274-installation-pull-secrets\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.031072 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.030795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b1040d1-ebbb-4935-a6ca-8c8585949274-registry-tls\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.031072 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.030813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b1040d1-ebbb-4935-a6ca-8c8585949274-bound-sa-token\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.031072 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.030828 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b1040d1-ebbb-4935-a6ca-8c8585949274-trusted-ca\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.031072 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.030845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srjhs\" (UniqueName: \"kubernetes.io/projected/7b1040d1-ebbb-4935-a6ca-8c8585949274-kube-api-access-srjhs\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.031806 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.031778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b1040d1-ebbb-4935-a6ca-8c8585949274-registry-certificates\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.031906 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.031811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b1040d1-ebbb-4935-a6ca-8c8585949274-trusted-ca\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.032140 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.032095 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b1040d1-ebbb-4935-a6ca-8c8585949274-ca-trust-extracted\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.033390 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.033353 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b1040d1-ebbb-4935-a6ca-8c8585949274-installation-pull-secrets\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.033971 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.033639 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b1040d1-ebbb-4935-a6ca-8c8585949274-image-registry-private-configuration\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.033971 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.033956 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b1040d1-ebbb-4935-a6ca-8c8585949274-registry-tls\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.044319 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.044299 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srjhs\" (UniqueName: \"kubernetes.io/projected/7b1040d1-ebbb-4935-a6ca-8c8585949274-kube-api-access-srjhs\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.044440 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.044422 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b1040d1-ebbb-4935-a6ca-8c8585949274-bound-sa-token\") pod \"image-registry-f7dbd49db-wl4kr\" (UID: \"7b1040d1-ebbb-4935-a6ca-8c8585949274\") " pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.084303 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:06:01.084278 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb5c2a7_ca60_42b7_bd32_ba42aec895d0.slice/crio-ee45850f7f2e6f8a2f04f83584671a5c462ac17a9c6b2234949ac33c44884928 WatchSource:0}: Error finding container ee45850f7f2e6f8a2f04f83584671a5c462ac17a9c6b2234949ac33c44884928: Status 404 returned error can't find the container with id ee45850f7f2e6f8a2f04f83584671a5c462ac17a9c6b2234949ac33c44884928 Jun 07 08:06:01.085146 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.085098 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-992qd"] Jun 07 08:06:01.152742 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.152720 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:01.275934 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.275904 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f7dbd49db-wl4kr"] Jun 07 08:06:01.278380 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:06:01.278353 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1040d1_ebbb_4935_a6ca_8c8585949274.slice/crio-756dd6fdec785991c3db240679f52e08a3087096674aaa65e51681e7ea2ac8b4 WatchSource:0}: Error finding container 756dd6fdec785991c3db240679f52e08a3087096674aaa65e51681e7ea2ac8b4: Status 404 returned error can't find the container with id 756dd6fdec785991c3db240679f52e08a3087096674aaa65e51681e7ea2ac8b4 Jun 07 08:06:01.293389 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.293361 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" event={"ID":"7b1040d1-ebbb-4935-a6ca-8c8585949274","Type":"ContainerStarted","Data":"756dd6fdec785991c3db240679f52e08a3087096674aaa65e51681e7ea2ac8b4"} Jun 07 08:06:01.294976 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.294952 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-992qd" event={"ID":"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0","Type":"ContainerStarted","Data":"f3066f7ca15e9a6939827ef367cffd6b77fc53452afaf1bfd9ac8b5301ce6fea"} Jun 07 08:06:01.295075 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:01.295000 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-992qd" event={"ID":"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0","Type":"ContainerStarted","Data":"ee45850f7f2e6f8a2f04f83584671a5c462ac17a9c6b2234949ac33c44884928"} Jun 07 08:06:02.299631 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:02.299596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" event={"ID":"7b1040d1-ebbb-4935-a6ca-8c8585949274","Type":"ContainerStarted","Data":"aade49465c52faf8a0dea13632d7ee4128eef35c65259a4378004656be7a54e3"} Jun 07 08:06:02.300370 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:02.299700 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:02.301735 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:02.301707 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-992qd" event={"ID":"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0","Type":"ContainerStarted","Data":"56bd28fa7948bdeab84eefa7d64032a3b1d95ddc27193edea2a3253f414f0ee4"} Jun 07 08:06:02.328064 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:02.328005 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" podStartSLOduration=2.327984541 podStartE2EDuration="2.327984541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:06:02.326870246 +0000 UTC m=+244.261151333" watchObservedRunningTime="2026-06-07 08:06:02.327984541 +0000 UTC m=+244.262265629" Jun 07 08:06:03.306921 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:03.306875 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-992qd" event={"ID":"9fb5c2a7-ca60-42b7-bd32-ba42aec895d0","Type":"ContainerStarted","Data":"1eeaac21ea086800b9279079e89959bf5c648fa38c2b6ebfec5bd612830f0c75"} Jun 07 08:06:03.328683 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:03.328628 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-992qd" podStartSLOduration=1.399971368 podStartE2EDuration="3.328611727s" totalImagesPullingTime="1.928640359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:06:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:06:03.326891739 +0000 UTC m=+245.261172824" watchObservedRunningTime="2026-06-07 08:06:03.328611727 +0000 UTC m=+245.262892814" Jun 07 08:06:05.208875 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:05.208844 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:05.274697 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:05.274670 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:06.145635 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:06.145598 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:06.249377 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:06.249347 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:06.323188 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:06.323163 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:08.081157 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:08.081066 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:08.934039 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:08.934009 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:08.998016 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:08.997982 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:10.298882 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:10.298845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:06:10.301060 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:10.301041 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0fbf718-ddd2-498e-bfdb-04cf8364884d-metrics-certs\") pod \"network-metrics-daemon-txfv9\" (UID: \"a0fbf718-ddd2-498e-bfdb-04cf8364884d\") " pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:06:10.335917 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:10.335894 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27w6v\"" Jun 07 08:06:10.344693 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:10.344673 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txfv9" Jun 07 08:06:10.460167 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:10.460089 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-txfv9"] Jun 07 08:06:10.462610 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:06:10.462589 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0fbf718_ddd2_498e_bfdb_04cf8364884d.slice/crio-fcc3514ae9eabe6bc5f2cf45be660daf99ae9203d6123849ec3d61a3a70b1989 WatchSource:0}: Error finding container fcc3514ae9eabe6bc5f2cf45be660daf99ae9203d6123849ec3d61a3a70b1989: Status 404 returned error can't find the container with id fcc3514ae9eabe6bc5f2cf45be660daf99ae9203d6123849ec3d61a3a70b1989 Jun 07 08:06:11.331773 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:11.331729 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txfv9" event={"ID":"a0fbf718-ddd2-498e-bfdb-04cf8364884d","Type":"ContainerStarted","Data":"fa83d54b67da642754e3998678cea900b7dbbd06b9b3eacf329cb94b147fd8c7"} Jun 07 08:06:11.332073 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:11.331820 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txfv9" event={"ID":"a0fbf718-ddd2-498e-bfdb-04cf8364884d","Type":"ContainerStarted","Data":"fcc3514ae9eabe6bc5f2cf45be660daf99ae9203d6123849ec3d61a3a70b1989"} Jun 07 08:06:11.935783 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:11.935754 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:12.336734 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:12.336644 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txfv9" event={"ID":"a0fbf718-ddd2-498e-bfdb-04cf8364884d","Type":"ContainerStarted","Data":"38f441c442a438d248a1f997ce22d971044c04f3a479160fe19e0f489dbda5f6"} Jun 07 08:06:12.352226 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:12.352184 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-txfv9" podStartSLOduration=253.570222635 podStartE2EDuration="4m14.352170117s" totalImagesPullingTime="781.947482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:06:12.350780159 +0000 UTC m=+254.285061268" watchObservedRunningTime="2026-06-07 08:06:12.352170117 +0000 UTC m=+254.286451204" Jun 07 08:06:12.432026 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:12.431990 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:12.532614 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:12.532563 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:13.327460 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:13.327428 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:13.389648 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:13.389577 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:13.564772 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:13.564721 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:15.824361 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:15.824310 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:16.153422 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:16.153364 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:16.543997 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:16.543916 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:16.605466 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:16.605441 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:18.147767 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.147735 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:18.203914 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.203883 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:18.476506 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.476432 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:18.767674 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.767598 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:18.852224 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.852189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:18.876081 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.876049 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp"] Jun 07 08:06:18.878109 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.878080 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bbsrb"] Jun 07 08:06:18.878249 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.878226 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:18.880170 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.880153 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:18.881253 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.881235 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 07 08:06:18.881350 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.881240 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 07 08:06:18.881350 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.881241 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 07 08:06:18.881489 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.881471 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 07 08:06:18.882629 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.882610 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 07 08:06:18.882725 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.882641 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nctdw\"" Jun 07 08:06:18.882725 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.882682 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 07 08:06:18.882831 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.882741 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 07 08:06:18.882904 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.882890 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 07 08:06:18.882954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.882926 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 07 08:06:18.883004 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.882985 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-88vtd\"" Jun 07 08:06:18.891629 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.891607 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp"] Jun 07 08:06:18.932360 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.932327 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:18.955657 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.955627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:18.955657 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.955667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7e63f769-af4e-47ed-83ef-547f62fa8012-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:18.955799 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.955718 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:18.955799 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.955750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e63f769-af4e-47ed-83ef-547f62fa8012-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:18.955799 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.955776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:18.955799 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:18.955795 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srx6j\" (UniqueName: \"kubernetes.io/projected/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-api-access-srx6j\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.025783 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.025716 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:19.056308 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056286 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.056364 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056315 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-tls\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.056364 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056354 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e63f769-af4e-47ed-83ef-547f62fa8012-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.056470 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.056470 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-textfile\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.056470 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flvz7\" (UniqueName: \"kubernetes.io/projected/726d9b78-5a7d-47f7-b49e-3b147447e773-kube-api-access-flvz7\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.056470 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:06:19.056446 2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 07 08:06:19.056470 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056460 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srx6j\" (UniqueName: \"kubernetes.io/projected/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-api-access-srx6j\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.056709 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:06:19.056519 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-state-metrics-tls podName:7e63f769-af4e-47ed-83ef-547f62fa8012 nodeName:}" failed. No retries permitted until 2026-06-07 08:06:19.556498185 +0000 UTC m=+261.490779263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-w6xtp" (UID: "7e63f769-af4e-47ed-83ef-547f62fa8012") : secret "kube-state-metrics-tls" not found Jun 07 08:06:19.056709 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056593 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/726d9b78-5a7d-47f7-b49e-3b147447e773-root\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.056709 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/726d9b78-5a7d-47f7-b49e-3b147447e773-sys\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.056709 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-accelerators-collector-config\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.056915 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.056915 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056771 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7e63f769-af4e-47ed-83ef-547f62fa8012-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.056915 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-wtmp\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.056915 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.056915 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.056881 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726d9b78-5a7d-47f7-b49e-3b147447e773-metrics-client-ca\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.057188 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.057139 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.057188 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.057145 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7e63f769-af4e-47ed-83ef-547f62fa8012-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.057188 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.057153 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e63f769-af4e-47ed-83ef-547f62fa8012-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.058973 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.058943 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.065763 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.065744 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srx6j\" (UniqueName: \"kubernetes.io/projected/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-api-access-srx6j\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.124873 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.124851 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:19.157217 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157194 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-wtmp\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157491 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157222 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157491 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157245 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726d9b78-5a7d-47f7-b49e-3b147447e773-metrics-client-ca\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157491 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157330 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-tls\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157491 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-textfile\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157491 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157376 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-wtmp\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157491 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flvz7\" (UniqueName: \"kubernetes.io/projected/726d9b78-5a7d-47f7-b49e-3b147447e773-kube-api-access-flvz7\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157491 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157435 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/726d9b78-5a7d-47f7-b49e-3b147447e773-root\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157491 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/726d9b78-5a7d-47f7-b49e-3b147447e773-sys\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157857 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157507 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-accelerators-collector-config\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157857 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157582 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/726d9b78-5a7d-47f7-b49e-3b147447e773-root\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157857 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/726d9b78-5a7d-47f7-b49e-3b147447e773-sys\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157857 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157740 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-textfile\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.157857 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726d9b78-5a7d-47f7-b49e-3b147447e773-metrics-client-ca\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.158032 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.157986 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-accelerators-collector-config\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.159584 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.159562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-tls\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.159634 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.159580 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/726d9b78-5a7d-47f7-b49e-3b147447e773-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.165737 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.165720 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flvz7\" (UniqueName: \"kubernetes.io/projected/726d9b78-5a7d-47f7-b49e-3b147447e773-kube-api-access-flvz7\") pod \"node-exporter-bbsrb\" (UID: \"726d9b78-5a7d-47f7-b49e-3b147447e773\") " pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.194333 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.194313 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bbsrb" Jun 07 08:06:19.203275 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:06:19.203254 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726d9b78_5a7d_47f7_b49e_3b147447e773.slice/crio-f2ed550cd52fe5032b48e698a34e6a7ce55b1f077925f042effb648d3bb48aac WatchSource:0}: Error finding container f2ed550cd52fe5032b48e698a34e6a7ce55b1f077925f042effb648d3bb48aac: Status 404 returned error can't find the container with id f2ed550cd52fe5032b48e698a34e6a7ce55b1f077925f042effb648d3bb48aac Jun 07 08:06:19.225275 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.225254 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:19.328883 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.328828 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:19.361179 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.361155 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bbsrb" event={"ID":"726d9b78-5a7d-47f7-b49e-3b147447e773","Type":"ContainerStarted","Data":"f2ed550cd52fe5032b48e698a34e6a7ce55b1f077925f042effb648d3bb48aac"} Jun 07 08:06:19.560682 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.560646 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.563088 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.563065 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e63f769-af4e-47ed-83ef-547f62fa8012-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-w6xtp\" (UID: \"7e63f769-af4e-47ed-83ef-547f62fa8012\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.657812 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.657745 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:19.757595 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.757554 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:19.789023 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.788990 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" Jun 07 08:06:19.849643 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.849609 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:19.964265 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:19.964202 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:20.095733 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:20.095701 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp"] Jun 07 08:06:20.097966 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:06:20.097935 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e63f769_af4e_47ed_83ef_547f62fa8012.slice/crio-27a25884fce1253f617eeb104d101583017fab99e32782e9bcb6df298f5f6a25 WatchSource:0}: Error finding container 27a25884fce1253f617eeb104d101583017fab99e32782e9bcb6df298f5f6a25: Status 404 returned error can't find the container with id 27a25884fce1253f617eeb104d101583017fab99e32782e9bcb6df298f5f6a25 Jun 07 08:06:20.365141 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:20.365033 2559 generic.go:356] "Generic (PLEG): container finished" podID="726d9b78-5a7d-47f7-b49e-3b147447e773" containerID="63b7b13d322479510972a29ab4cf0b2e34ca3a3321be74d00c5d81e364657656" exitCode=0 Jun 07 08:06:20.365557 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:20.365140 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bbsrb" event={"ID":"726d9b78-5a7d-47f7-b49e-3b147447e773","Type":"ContainerDied","Data":"63b7b13d322479510972a29ab4cf0b2e34ca3a3321be74d00c5d81e364657656"} Jun 07 08:06:20.366310 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:20.366287 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" event={"ID":"7e63f769-af4e-47ed-83ef-547f62fa8012","Type":"ContainerStarted","Data":"27a25884fce1253f617eeb104d101583017fab99e32782e9bcb6df298f5f6a25"} Jun 07 08:06:21.157973 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:21.157931 2559 patch_prober.go:28] interesting pod/image-registry-f7dbd49db-wl4kr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 08:06:21.158167 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:21.157985 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" podUID="7b1040d1-ebbb-4935-a6ca-8c8585949274" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 08:06:21.372472 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:21.372438 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bbsrb" event={"ID":"726d9b78-5a7d-47f7-b49e-3b147447e773","Type":"ContainerStarted","Data":"06943052a9f6001611b11866ad0a83b66f01a489410fb13ca192ac93cf51038b"} Jun 07 08:06:21.372908 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:21.372494 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bbsrb" event={"ID":"726d9b78-5a7d-47f7-b49e-3b147447e773","Type":"ContainerStarted","Data":"19de64633992b6eb5d1376acfaf59062ac9fc4743198cc62d7204a62ed366cd7"} Jun 07 08:06:21.393319 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:21.393274 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bbsrb" podStartSLOduration=2.54433511 podStartE2EDuration="3.393258087s" totalImagesPullingTime="787.021111ms" totalInitContainerRuntime="61.901866ms" isStatefulPod=true podCreationTimestamp="2026-06-07 08:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:06:21.391799175 +0000 UTC m=+263.326080262" watchObservedRunningTime="2026-06-07 08:06:21.393258087 +0000 UTC m=+263.327539177" Jun 07 08:06:21.632833 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:21.632799 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:21.731098 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:21.731019 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:21.865178 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:21.865150 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:22.378157 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:22.378097 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" event={"ID":"7e63f769-af4e-47ed-83ef-547f62fa8012","Type":"ContainerStarted","Data":"9eabe9c714518c422d00573bba68d0b7ea0382fc7b32074f8d8cff335d7ed19f"} Jun 07 08:06:22.378610 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:22.378174 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" event={"ID":"7e63f769-af4e-47ed-83ef-547f62fa8012","Type":"ContainerStarted","Data":"c65262961f6ea64259d566d1013a0c68fe4dc805ff6688041834486c349d9fab"} Jun 07 08:06:22.378610 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:22.378193 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" event={"ID":"7e63f769-af4e-47ed-83ef-547f62fa8012","Type":"ContainerStarted","Data":"03e2c9c6feb31d64b072ce76d5287eff0ea3e1877db9d430ab6c37b6efeb844d"} Jun 07 08:06:22.397033 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:22.396985 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6xtp" podStartSLOduration=3.060068126 podStartE2EDuration="4.396965685s" totalImagesPullingTime="1.336897559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:06:22.395639214 +0000 UTC m=+264.329920302" watchObservedRunningTime="2026-06-07 08:06:22.396965685 +0000 UTC m=+264.331246772" Jun 07 08:06:22.558533 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:22.558508 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:23.311753 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:23.311722 2559 patch_prober.go:28] interesting pod/image-registry-f7dbd49db-wl4kr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 08:06:23.311903 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:23.311769 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" podUID="7b1040d1-ebbb-4935-a6ca-8c8585949274" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 08:06:23.537451 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:23.537424 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:23.603930 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:23.603852 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:23.717823 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:23.717789 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:24.915083 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:24.915046 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:25.244794 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:25.244708 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:31.157341 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:31.157304 2559 patch_prober.go:28] interesting pod/image-registry-f7dbd49db-wl4kr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 08:06:31.157727 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:31.157353 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" podUID="7b1040d1-ebbb-4935-a6ca-8c8585949274" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 08:06:33.311020 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:33.310983 2559 patch_prober.go:28] interesting pod/image-registry-f7dbd49db-wl4kr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 08:06:33.311481 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:33.311041 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" podUID="7b1040d1-ebbb-4935-a6ca-8c8585949274" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 08:06:34.877412 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:34.877376 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:34.978377 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:34.978344 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:39.054600 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:06:39.054538 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2qj4k" podUID="a900da45-2f59-4457-b120-e3c0046f6332" Jun 07 08:06:39.434782 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:39.434745 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2qj4k" Jun 07 08:06:41.157595 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:41.157563 2559 patch_prober.go:28] interesting pod/image-registry-f7dbd49db-wl4kr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 08:06:41.158012 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:41.157611 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" podUID="7b1040d1-ebbb-4935-a6ca-8c8585949274" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 08:06:41.158012 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:41.157647 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:41.158170 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:41.158059 2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"aade49465c52faf8a0dea13632d7ee4128eef35c65259a4378004656be7a54e3"} pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" containerMessage="Container registry failed liveness probe, will be restarted" Jun 07 08:06:41.161619 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:41.161596 2559 patch_prober.go:28] interesting pod/image-registry-f7dbd49db-wl4kr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 08:06:41.161725 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:41.161634 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" podUID="7b1040d1-ebbb-4935-a6ca-8c8585949274" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 08:06:42.825152 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:42.825117 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:06:42.827344 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:42.827323 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a900da45-2f59-4457-b120-e3c0046f6332-metrics-tls\") pod \"dns-default-2qj4k\" (UID: \"a900da45-2f59-4457-b120-e3c0046f6332\") " pod="openshift-dns/dns-default-2qj4k" Jun 07 08:06:43.037765 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:43.037734 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f7smc\"" Jun 07 08:06:43.045749 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:43.045731 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2qj4k" Jun 07 08:06:43.166596 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:43.166573 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2qj4k"] Jun 07 08:06:43.169234 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:06:43.169209 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda900da45_2f59_4457_b120_e3c0046f6332.slice/crio-8c01acf456b0e0ccd67ed85bb49b99f642b7260147be49d2401b7582a363070a WatchSource:0}: Error finding container 8c01acf456b0e0ccd67ed85bb49b99f642b7260147be49d2401b7582a363070a: Status 404 returned error can't find the container with id 8c01acf456b0e0ccd67ed85bb49b99f642b7260147be49d2401b7582a363070a Jun 07 08:06:43.449168 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:43.449139 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2qj4k" event={"ID":"a900da45-2f59-4457-b120-e3c0046f6332","Type":"ContainerStarted","Data":"8c01acf456b0e0ccd67ed85bb49b99f642b7260147be49d2401b7582a363070a"} Jun 07 08:06:44.433346 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:44.433312 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:45.462846 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:45.462815 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2qj4k" event={"ID":"a900da45-2f59-4457-b120-e3c0046f6332","Type":"ContainerStarted","Data":"f02a54fcbf9d20955ac66ae58ded0d248be84a0b83e95dca82738a33c7b49d73"} Jun 07 08:06:45.463234 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:45.462863 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2qj4k" event={"ID":"a900da45-2f59-4457-b120-e3c0046f6332","Type":"ContainerStarted","Data":"bc5dfad33792cdb0936af7946bdb500cd5d0a578d826ee6118f23c4e1c8fc3e3"} Jun 07 08:06:45.463234 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:45.462903 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2qj4k" Jun 07 08:06:45.488629 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:45.488581 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2qj4k" podStartSLOduration=251.973207058 podStartE2EDuration="4m13.488567213s" totalImagesPullingTime="1.515360155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:06:45.487009256 +0000 UTC m=+287.421290367" watchObservedRunningTime="2026-06-07 08:06:45.488567213 +0000 UTC m=+287.422848298" Jun 07 08:06:45.559171 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:45.559143 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:46.537831 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:46.537796 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:46.596726 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:46.596698 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:48.720463 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:48.720424 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" podUID="629bfbb7-dd56-4394-9a93-b6fc09f78035" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 07 08:06:50.400116 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:50.400059 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:50.447758 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:50.447720 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:51.162587 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:51.162560 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:06:51.276883 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:51.276855 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:51.329188 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:51.329160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:51.409555 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:51.409530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:51.510260 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:51.510174 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:51.944819 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:51.944786 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:52.045083 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:52.045054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:52.095428 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:52.095396 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:52.857926 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:52.857889 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:06:55.468328 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:55.468296 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2qj4k" Jun 07 08:06:58.489762 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:58.489733 2559 kubelet.go:1648] "Image garbage collection succeeded" Jun 07 08:06:58.720690 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:06:58.720661 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" podUID="629bfbb7-dd56-4394-9a93-b6fc09f78035" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 07 08:07:00.010371 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:00.010335 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:00.111081 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:00.111054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:01.109576 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:01.109542 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:01.209836 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:01.209796 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:04.683290 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:04.683238 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:04.783045 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:04.783010 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:06.176942 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:06.176892 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" podUID="7b1040d1-ebbb-4935-a6ca-8c8585949274" containerName="registry" containerID="cri-o://aade49465c52faf8a0dea13632d7ee4128eef35c65259a4378004656be7a54e3" gracePeriod=30 Jun 07 08:07:07.535276 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:07.535192 2559 generic.go:356] "Generic (PLEG): container finished" podID="7b1040d1-ebbb-4935-a6ca-8c8585949274" containerID="aade49465c52faf8a0dea13632d7ee4128eef35c65259a4378004656be7a54e3" exitCode=0 Jun 07 08:07:07.535276 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:07.535265 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" event={"ID":"7b1040d1-ebbb-4935-a6ca-8c8585949274","Type":"ContainerDied","Data":"aade49465c52faf8a0dea13632d7ee4128eef35c65259a4378004656be7a54e3"} Jun 07 08:07:07.535676 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:07.535300 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" event={"ID":"7b1040d1-ebbb-4935-a6ca-8c8585949274","Type":"ContainerStarted","Data":"56a9d29ef1b73a4199be4fae006785bb9f9ce9725efdb2cd2eadd9f986af1363"} Jun 07 08:07:07.535676 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:07.535368 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:07:07.937294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:07.937257 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:07.993520 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:07.993495 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:08.720602 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:08.720554 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" podUID="629bfbb7-dd56-4394-9a93-b6fc09f78035" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 07 08:07:08.721032 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:08.720637 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" Jun 07 08:07:08.721032 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:08.721027 2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"35d98e2370d8d0ca59980d62aaebd61b7afcea3aebcbadf350611b363cd655a9"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 07 08:07:08.721143 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:08.721060 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" podUID="629bfbb7-dd56-4394-9a93-b6fc09f78035" containerName="service-proxy" containerID="cri-o://35d98e2370d8d0ca59980d62aaebd61b7afcea3aebcbadf350611b363cd655a9" gracePeriod=30 Jun 07 08:07:09.543807 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:09.543771 2559 generic.go:356] "Generic (PLEG): container finished" podID="629bfbb7-dd56-4394-9a93-b6fc09f78035" containerID="35d98e2370d8d0ca59980d62aaebd61b7afcea3aebcbadf350611b363cd655a9" exitCode=2 Jun 07 08:07:09.543999 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:09.543846 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" event={"ID":"629bfbb7-dd56-4394-9a93-b6fc09f78035","Type":"ContainerDied","Data":"35d98e2370d8d0ca59980d62aaebd61b7afcea3aebcbadf350611b363cd655a9"} Jun 07 08:07:09.543999 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:09.543889 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7c4667dc-djtfv" event={"ID":"629bfbb7-dd56-4394-9a93-b6fc09f78035","Type":"ContainerStarted","Data":"32a9632251e6682ead69299469a8d7610e4301234dea39e3742b503eac074c8e"} Jun 07 08:07:13.651307 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:13.651270 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:13.713138 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:13.713083 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:15.014691 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:15.014653 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:15.114745 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:15.114710 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:28.543183 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:28.543151 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f7dbd49db-wl4kr" Jun 07 08:07:28.832819 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:28.832737 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:28.891462 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:28.891429 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:30.012431 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:30.012394 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:30.066351 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:30.066322 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:32.024693 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:32.024657 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:32.126194 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:32.126157 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:32.188903 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:32.188866 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:34.775060 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:34.775026 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:34.827927 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:34.827900 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:35.671555 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:35.671526 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:35.722698 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:35.722669 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:45.017369 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:45.017293 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:45.117029 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:45.116997 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:46.788247 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:46.788209 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:46.839481 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:46.839449 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:46.896372 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:46.896346 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:47.945094 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:47.945059 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:07:47.995851 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:07:47.995818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:08:00.056399 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:08:00.056365 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:08:00.155062 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:08:00.155032 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:08:57.891700 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:08:57.891667 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:08:57.988704 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:08:57.988669 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:06.805016 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:06.804985 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:30.718148 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:30.718085 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:31.616916 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:31.616880 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:34.330404 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:34.330362 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:34.430994 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:34.430965 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:35.618801 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:35.618761 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:35.721382 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:35.721350 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:39.123423 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:39.123396 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:39.505411 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:39.505376 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:41.150244 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:41.150211 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:41.254901 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:41.254847 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:44.697739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:44.697703 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:44.797641 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:44.797612 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:46.294698 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:46.294668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:50.021269 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:50.021231 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:51.530983 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:51.530950 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:51.627905 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:51.627873 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:53.557979 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.557950 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb"] Jun 07 08:09:53.563876 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.563853 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb" Jun 07 08:09:53.566351 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.566328 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 07 08:09:53.566486 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.566337 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9bp24\"" Jun 07 08:09:53.567470 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.567445 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 07 08:09:53.568733 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.568712 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb"] Jun 07 08:09:53.690872 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.690845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxfsl\" (UniqueName: \"kubernetes.io/projected/cb90dccf-c547-47df-a3af-dc9325591472-kube-api-access-cxfsl\") pod \"openshift-lws-operator-fd8ccff4c-fzpfb\" (UID: \"cb90dccf-c547-47df-a3af-dc9325591472\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb" Jun 07 08:09:53.691007 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.690908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb90dccf-c547-47df-a3af-dc9325591472-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fzpfb\" (UID: \"cb90dccf-c547-47df-a3af-dc9325591472\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb" Jun 07 08:09:53.791388 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.791365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb90dccf-c547-47df-a3af-dc9325591472-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fzpfb\" (UID: \"cb90dccf-c547-47df-a3af-dc9325591472\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb" Jun 07 08:09:53.791514 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.791403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxfsl\" (UniqueName: \"kubernetes.io/projected/cb90dccf-c547-47df-a3af-dc9325591472-kube-api-access-cxfsl\") pod \"openshift-lws-operator-fd8ccff4c-fzpfb\" (UID: \"cb90dccf-c547-47df-a3af-dc9325591472\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb" Jun 07 08:09:53.791748 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.791727 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb90dccf-c547-47df-a3af-dc9325591472-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fzpfb\" (UID: \"cb90dccf-c547-47df-a3af-dc9325591472\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb" Jun 07 08:09:53.799683 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.799653 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxfsl\" (UniqueName: \"kubernetes.io/projected/cb90dccf-c547-47df-a3af-dc9325591472-kube-api-access-cxfsl\") pod \"openshift-lws-operator-fd8ccff4c-fzpfb\" (UID: \"cb90dccf-c547-47df-a3af-dc9325591472\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb" Jun 07 08:09:53.872839 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.872786 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb" Jun 07 08:09:53.990529 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.990503 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb"] Jun 07 08:09:53.993755 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:09:53.993731 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb90dccf_c547_47df_a3af_dc9325591472.slice/crio-d3645c96576555830ead7215572136fc2f1ce9a8827fb11b8a2c955a86e121dc WatchSource:0}: Error finding container d3645c96576555830ead7215572136fc2f1ce9a8827fb11b8a2c955a86e121dc: Status 404 returned error can't find the container with id d3645c96576555830ead7215572136fc2f1ce9a8827fb11b8a2c955a86e121dc Jun 07 08:09:53.995154 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:53.995138 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 08:09:54.072559 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:54.072527 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb" event={"ID":"cb90dccf-c547-47df-a3af-dc9325591472","Type":"ContainerStarted","Data":"d3645c96576555830ead7215572136fc2f1ce9a8827fb11b8a2c955a86e121dc"} Jun 07 08:09:57.087295 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:57.087260 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb" event={"ID":"cb90dccf-c547-47df-a3af-dc9325591472","Type":"ContainerStarted","Data":"1b54c60fd6b23ab83860159d9e927ee06ac15f670a1295dec5815a5412ff2376"} Jun 07 08:09:57.102993 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:57.102939 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fzpfb" podStartSLOduration=1.569972859 podStartE2EDuration="4.102918365s" totalImagesPullingTime="2.532945506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:09:57.101317217 +0000 UTC m=+479.035598303" watchObservedRunningTime="2026-06-07 08:09:57.102918365 +0000 UTC m=+479.037199452" Jun 07 08:09:57.785087 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:57.785054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:57.883008 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:57.882978 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:09:59.820975 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:09:59.820947 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:13.329838 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:13.329805 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:13.423438 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:13.423413 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:13.948906 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:13.948872 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:14.130942 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.130911 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:14.219572 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.219505 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:14.318953 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.318919 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:14.397894 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.397866 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw"] Jun 07 08:10:14.400875 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.400856 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.403684 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.403662 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 07 08:10:14.403805 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.403788 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 07 08:10:14.405670 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.405643 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 07 08:10:14.405763 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.405713 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 07 08:10:14.405865 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.405848 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mjgzs\"" Jun 07 08:10:14.426360 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.426331 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw"] Jun 07 08:10:14.545132 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.545045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/014c6b41-fdf9-4485-befe-1266cf8fe21e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.545132 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.545089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/014c6b41-fdf9-4485-befe-1266cf8fe21e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.545350 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.545163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkkhf\" (UniqueName: \"kubernetes.io/projected/014c6b41-fdf9-4485-befe-1266cf8fe21e-kube-api-access-wkkhf\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.545350 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.545236 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/014c6b41-fdf9-4485-befe-1266cf8fe21e-tmp\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.545350 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.545288 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/014c6b41-fdf9-4485-befe-1266cf8fe21e-manifests\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.646427 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.646397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/014c6b41-fdf9-4485-befe-1266cf8fe21e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.646592 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.646440 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/014c6b41-fdf9-4485-befe-1266cf8fe21e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.646592 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.646477 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkkhf\" (UniqueName: \"kubernetes.io/projected/014c6b41-fdf9-4485-befe-1266cf8fe21e-kube-api-access-wkkhf\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.646592 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.646508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/014c6b41-fdf9-4485-befe-1266cf8fe21e-tmp\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.646592 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.646533 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/014c6b41-fdf9-4485-befe-1266cf8fe21e-manifests\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.646989 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.646968 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/014c6b41-fdf9-4485-befe-1266cf8fe21e-manifests\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.648940 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.648910 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/014c6b41-fdf9-4485-befe-1266cf8fe21e-tmp\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.649061 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.648992 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/014c6b41-fdf9-4485-befe-1266cf8fe21e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.649140 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.649059 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/014c6b41-fdf9-4485-befe-1266cf8fe21e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.657149 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.657124 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkkhf\" (UniqueName: \"kubernetes.io/projected/014c6b41-fdf9-4485-befe-1266cf8fe21e-kube-api-access-wkkhf\") pod \"opendatahub-operator-controller-manager-5d459f6d9f-pwznw\" (UID: \"014c6b41-fdf9-4485-befe-1266cf8fe21e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.705479 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.705452 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:14.711385 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.711358 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:14.802013 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.801938 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:14.838501 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.838378 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw"] Jun 07 08:10:14.841220 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:10:14.841197 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod014c6b41_fdf9_4485_befe_1266cf8fe21e.slice/crio-f54614f6c8a66dc40d6deb0795a7d88aca93870daa83892cb3b2025bdee44983 WatchSource:0}: Error finding container f54614f6c8a66dc40d6deb0795a7d88aca93870daa83892cb3b2025bdee44983: Status 404 returned error can't find the container with id f54614f6c8a66dc40d6deb0795a7d88aca93870daa83892cb3b2025bdee44983 Jun 07 08:10:14.901742 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:14.901714 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:15.021266 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:15.021239 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:15.129558 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:15.129475 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:15.152226 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:15.152197 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" event={"ID":"014c6b41-fdf9-4485-befe-1266cf8fe21e","Type":"ContainerStarted","Data":"f54614f6c8a66dc40d6deb0795a7d88aca93870daa83892cb3b2025bdee44983"} Jun 07 08:10:15.228863 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:15.228833 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:15.329362 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:15.329334 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:19.171781 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:19.171752 2559 generic.go:356] "Generic (PLEG): container finished" podID="014c6b41-fdf9-4485-befe-1266cf8fe21e" containerID="9606f587729232ad520477d373414491889f88652385bea58c0939ee6bad945e" exitCode=0 Jun 07 08:10:19.172125 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:19.171810 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" event={"ID":"014c6b41-fdf9-4485-befe-1266cf8fe21e","Type":"ContainerDied","Data":"9606f587729232ad520477d373414491889f88652385bea58c0939ee6bad945e"} Jun 07 08:10:20.178048 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:20.178008 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" event={"ID":"014c6b41-fdf9-4485-befe-1266cf8fe21e","Type":"ContainerStarted","Data":"2eb6dcbc8d542dd339db4dfc48cce67bb764a8e6e6ac7c6e622007d89fb57340"} Jun 07 08:10:20.178471 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:20.178152 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:20.198736 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:20.198684 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" podStartSLOduration=1.603020527 podStartE2EDuration="6.198664791s" totalImagesPullingTime="3.619359591s" totalInitContainerRuntime="976.284673ms" isStatefulPod=false podCreationTimestamp="2026-06-07 08:10:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:10:20.197648884 +0000 UTC m=+502.131929970" watchObservedRunningTime="2026-06-07 08:10:20.198664791 +0000 UTC m=+502.132945879" Jun 07 08:10:25.753653 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:25.753617 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:25.843589 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:25.843561 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:31.183507 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:31.183474 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d459f6d9f-pwznw" Jun 07 08:10:34.105284 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:34.105241 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:34.224754 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:34.224706 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:34.725722 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:34.725688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:34.812824 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:34.812788 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:34.921005 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:34.920970 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-fmpfd"] Jun 07 08:10:34.928522 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:34.928496 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" Jun 07 08:10:34.931058 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:34.931040 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-h92ts\"" Jun 07 08:10:34.931172 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:34.931040 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 07 08:10:34.939026 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:34.939001 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-fmpfd"] Jun 07 08:10:34.961653 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:34.961624 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:35.001798 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.001714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tblv2\" (UniqueName: \"kubernetes.io/projected/0507ba98-af56-445c-9bd0-10cd29e878e7-kube-api-access-tblv2\") pod \"odh-model-controller-6dc94f689f-fmpfd\" (UID: \"0507ba98-af56-445c-9bd0-10cd29e878e7\") " pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" Jun 07 08:10:35.001798 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.001790 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0507ba98-af56-445c-9bd0-10cd29e878e7-cert\") pod \"odh-model-controller-6dc94f689f-fmpfd\" (UID: \"0507ba98-af56-445c-9bd0-10cd29e878e7\") " pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" Jun 07 08:10:35.070313 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.070274 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:35.091895 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.091861 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq"] Jun 07 08:10:35.095152 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.095126 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" Jun 07 08:10:35.098166 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.098145 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gbpj6\"" Jun 07 08:10:35.098294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.098254 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 07 08:10:35.098418 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.098397 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 07 08:10:35.098723 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.098705 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 07 08:10:35.098876 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.098856 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 07 08:10:35.102375 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.102352 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0507ba98-af56-445c-9bd0-10cd29e878e7-cert\") pod \"odh-model-controller-6dc94f689f-fmpfd\" (UID: \"0507ba98-af56-445c-9bd0-10cd29e878e7\") " pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" Jun 07 08:10:35.102489 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.102397 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67742d72-1c14-4554-9321-1f7cb3531560-tls-certs\") pod \"kube-auth-proxy-76fcdb986d-84jsq\" (UID: \"67742d72-1c14-4554-9321-1f7cb3531560\") " pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" Jun 07 08:10:35.102489 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.102454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67742d72-1c14-4554-9321-1f7cb3531560-tmp\") pod \"kube-auth-proxy-76fcdb986d-84jsq\" (UID: \"67742d72-1c14-4554-9321-1f7cb3531560\") " pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" Jun 07 08:10:35.102489 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.102484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tblv2\" (UniqueName: \"kubernetes.io/projected/0507ba98-af56-445c-9bd0-10cd29e878e7-kube-api-access-tblv2\") pod \"odh-model-controller-6dc94f689f-fmpfd\" (UID: \"0507ba98-af56-445c-9bd0-10cd29e878e7\") " pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" Jun 07 08:10:35.102640 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.102520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wggk\" (UniqueName: \"kubernetes.io/projected/67742d72-1c14-4554-9321-1f7cb3531560-kube-api-access-2wggk\") pod \"kube-auth-proxy-76fcdb986d-84jsq\" (UID: \"67742d72-1c14-4554-9321-1f7cb3531560\") " pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" Jun 07 08:10:35.104998 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.104978 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0507ba98-af56-445c-9bd0-10cd29e878e7-cert\") pod \"odh-model-controller-6dc94f689f-fmpfd\" (UID: \"0507ba98-af56-445c-9bd0-10cd29e878e7\") " pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" Jun 07 08:10:35.109033 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.109002 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq"] Jun 07 08:10:35.122830 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.122805 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tblv2\" (UniqueName: \"kubernetes.io/projected/0507ba98-af56-445c-9bd0-10cd29e878e7-kube-api-access-tblv2\") pod \"odh-model-controller-6dc94f689f-fmpfd\" (UID: \"0507ba98-af56-445c-9bd0-10cd29e878e7\") " pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" Jun 07 08:10:35.203163 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.203118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67742d72-1c14-4554-9321-1f7cb3531560-tmp\") pod \"kube-auth-proxy-76fcdb986d-84jsq\" (UID: \"67742d72-1c14-4554-9321-1f7cb3531560\") " pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" Jun 07 08:10:35.203163 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.203168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wggk\" (UniqueName: \"kubernetes.io/projected/67742d72-1c14-4554-9321-1f7cb3531560-kube-api-access-2wggk\") pod \"kube-auth-proxy-76fcdb986d-84jsq\" (UID: \"67742d72-1c14-4554-9321-1f7cb3531560\") " pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" Jun 07 08:10:35.203393 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.203214 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67742d72-1c14-4554-9321-1f7cb3531560-tls-certs\") pod \"kube-auth-proxy-76fcdb986d-84jsq\" (UID: \"67742d72-1c14-4554-9321-1f7cb3531560\") " pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" Jun 07 08:10:35.205307 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.205284 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67742d72-1c14-4554-9321-1f7cb3531560-tmp\") pod \"kube-auth-proxy-76fcdb986d-84jsq\" (UID: \"67742d72-1c14-4554-9321-1f7cb3531560\") " pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" Jun 07 08:10:35.205579 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.205558 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67742d72-1c14-4554-9321-1f7cb3531560-tls-certs\") pod \"kube-auth-proxy-76fcdb986d-84jsq\" (UID: \"67742d72-1c14-4554-9321-1f7cb3531560\") " pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" Jun 07 08:10:35.222294 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.222265 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wggk\" (UniqueName: \"kubernetes.io/projected/67742d72-1c14-4554-9321-1f7cb3531560-kube-api-access-2wggk\") pod \"kube-auth-proxy-76fcdb986d-84jsq\" (UID: \"67742d72-1c14-4554-9321-1f7cb3531560\") " pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" Jun 07 08:10:35.231167 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.231128 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:35.237816 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.237797 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" Jun 07 08:10:35.324948 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.324923 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:35.364494 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.364405 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-fmpfd"] Jun 07 08:10:35.366682 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:10:35.366656 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0507ba98_af56_445c_9bd0_10cd29e878e7.slice/crio-f53af2afbdf14a48c2d6e43d3e359cb513092574277a545a522c4c78818251e6 WatchSource:0}: Error finding container f53af2afbdf14a48c2d6e43d3e359cb513092574277a545a522c4c78818251e6: Status 404 returned error can't find the container with id f53af2afbdf14a48c2d6e43d3e359cb513092574277a545a522c4c78818251e6 Jun 07 08:10:35.407615 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.407582 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" Jun 07 08:10:35.539887 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.539861 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq"] Jun 07 08:10:35.542332 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:10:35.542302 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67742d72_1c14_4554_9321_1f7cb3531560.slice/crio-ae2bfc392845dbac1dcc53152f396bd96f30c1cb2e98aaafa8d95624841c297d WatchSource:0}: Error finding container ae2bfc392845dbac1dcc53152f396bd96f30c1cb2e98aaafa8d95624841c297d: Status 404 returned error can't find the container with id ae2bfc392845dbac1dcc53152f396bd96f30c1cb2e98aaafa8d95624841c297d Jun 07 08:10:35.728171 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.728114 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-m2f54"] Jun 07 08:10:35.732609 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.732591 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-m2f54" Jun 07 08:10:35.736480 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.736463 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 07 08:10:35.745932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.745909 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-m2f54"] Jun 07 08:10:35.751331 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.751286 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:35.808347 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.808246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c69bfdd4-8fed-4082-b0ed-5d1aa4884166-tls-certs\") pod \"model-serving-api-5dd488fc48-m2f54\" (UID: \"c69bfdd4-8fed-4082-b0ed-5d1aa4884166\") " pod="opendatahub/model-serving-api-5dd488fc48-m2f54" Jun 07 08:10:35.808347 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.808293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv4rz\" (UniqueName: \"kubernetes.io/projected/c69bfdd4-8fed-4082-b0ed-5d1aa4884166-kube-api-access-bv4rz\") pod \"model-serving-api-5dd488fc48-m2f54\" (UID: \"c69bfdd4-8fed-4082-b0ed-5d1aa4884166\") " pod="opendatahub/model-serving-api-5dd488fc48-m2f54" Jun 07 08:10:35.909014 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.908984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv4rz\" (UniqueName: \"kubernetes.io/projected/c69bfdd4-8fed-4082-b0ed-5d1aa4884166-kube-api-access-bv4rz\") pod \"model-serving-api-5dd488fc48-m2f54\" (UID: \"c69bfdd4-8fed-4082-b0ed-5d1aa4884166\") " pod="opendatahub/model-serving-api-5dd488fc48-m2f54" Jun 07 08:10:35.909184 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.909047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c69bfdd4-8fed-4082-b0ed-5d1aa4884166-tls-certs\") pod \"model-serving-api-5dd488fc48-m2f54\" (UID: \"c69bfdd4-8fed-4082-b0ed-5d1aa4884166\") " pod="opendatahub/model-serving-api-5dd488fc48-m2f54" Jun 07 08:10:35.909184 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:10:35.909157 2559 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 07 08:10:35.909278 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:10:35.909211 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69bfdd4-8fed-4082-b0ed-5d1aa4884166-tls-certs podName:c69bfdd4-8fed-4082-b0ed-5d1aa4884166 nodeName:}" failed. No retries permitted until 2026-06-07 08:10:36.409194385 +0000 UTC m=+518.343475449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c69bfdd4-8fed-4082-b0ed-5d1aa4884166-tls-certs") pod "model-serving-api-5dd488fc48-m2f54" (UID: "c69bfdd4-8fed-4082-b0ed-5d1aa4884166") : secret "model-serving-api-tls" not found Jun 07 08:10:35.917547 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:35.917524 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv4rz\" (UniqueName: \"kubernetes.io/projected/c69bfdd4-8fed-4082-b0ed-5d1aa4884166-kube-api-access-bv4rz\") pod \"model-serving-api-5dd488fc48-m2f54\" (UID: \"c69bfdd4-8fed-4082-b0ed-5d1aa4884166\") " pod="opendatahub/model-serving-api-5dd488fc48-m2f54" Jun 07 08:10:36.226543 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:36.226363 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:36.245444 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:36.245361 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" event={"ID":"67742d72-1c14-4554-9321-1f7cb3531560","Type":"ContainerStarted","Data":"ae2bfc392845dbac1dcc53152f396bd96f30c1cb2e98aaafa8d95624841c297d"} Jun 07 08:10:36.247382 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:36.247314 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" event={"ID":"0507ba98-af56-445c-9bd0-10cd29e878e7","Type":"ContainerStarted","Data":"f53af2afbdf14a48c2d6e43d3e359cb513092574277a545a522c4c78818251e6"} Jun 07 08:10:36.414336 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:36.413745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c69bfdd4-8fed-4082-b0ed-5d1aa4884166-tls-certs\") pod \"model-serving-api-5dd488fc48-m2f54\" (UID: \"c69bfdd4-8fed-4082-b0ed-5d1aa4884166\") " pod="opendatahub/model-serving-api-5dd488fc48-m2f54" Jun 07 08:10:36.430984 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:36.430927 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c69bfdd4-8fed-4082-b0ed-5d1aa4884166-tls-certs\") pod \"model-serving-api-5dd488fc48-m2f54\" (UID: \"c69bfdd4-8fed-4082-b0ed-5d1aa4884166\") " pod="opendatahub/model-serving-api-5dd488fc48-m2f54" Jun 07 08:10:36.643610 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:36.643523 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-m2f54" Jun 07 08:10:36.862066 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:36.862027 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-m2f54"] Jun 07 08:10:36.871851 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:10:36.871821 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69bfdd4_8fed_4082_b0ed_5d1aa4884166.slice/crio-05595f0655adede2865c333e94cb37f8ac66a992b6b279919f1149e315e7d6aa WatchSource:0}: Error finding container 05595f0655adede2865c333e94cb37f8ac66a992b6b279919f1149e315e7d6aa: Status 404 returned error can't find the container with id 05595f0655adede2865c333e94cb37f8ac66a992b6b279919f1149e315e7d6aa Jun 07 08:10:37.253928 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:37.253880 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-m2f54" event={"ID":"c69bfdd4-8fed-4082-b0ed-5d1aa4884166","Type":"ContainerStarted","Data":"05595f0655adede2865c333e94cb37f8ac66a992b6b279919f1149e315e7d6aa"} Jun 07 08:10:41.273006 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:41.272972 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" event={"ID":"67742d72-1c14-4554-9321-1f7cb3531560","Type":"ContainerStarted","Data":"bbecedb26f7148d397eb7e069e083a7f6d6e18335e7bc56cc761ba6a224b2bc6"} Jun 07 08:10:41.274619 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:41.274593 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-m2f54" event={"ID":"c69bfdd4-8fed-4082-b0ed-5d1aa4884166","Type":"ContainerStarted","Data":"3eb2396dab9ea0a5d0cf1051f812e4b3a9b4d8b663d7b15a1584727002ccf11b"} Jun 07 08:10:41.274773 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:41.274649 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-m2f54" Jun 07 08:10:41.276136 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:41.276090 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" event={"ID":"0507ba98-af56-445c-9bd0-10cd29e878e7","Type":"ContainerStarted","Data":"81bd4323656ccfcb6ad4ec362f243746ddb7713f4a85a645fa3d4619c3d962ef"} Jun 07 08:10:41.276233 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:41.276166 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" Jun 07 08:10:41.289519 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:41.289466 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-76fcdb986d-84jsq" podStartSLOduration=1.4442329520000001 podStartE2EDuration="6.289447972s" totalImagesPullingTime="4.84521502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:10:41.287455274 +0000 UTC m=+523.221736362" watchObservedRunningTime="2026-06-07 08:10:41.289447972 +0000 UTC m=+523.223729039" Jun 07 08:10:41.302527 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:41.302480 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" podStartSLOduration=2.265069934 podStartE2EDuration="7.302465864s" totalImagesPullingTime="5.03739593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:10:41.301528439 +0000 UTC m=+523.235809526" watchObservedRunningTime="2026-06-07 08:10:41.302465864 +0000 UTC m=+523.236746978" Jun 07 08:10:41.319012 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:41.318956 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-m2f54" podStartSLOduration=2.794488662 podStartE2EDuration="6.318934504s" totalImagesPullingTime="3.524445842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:10:41.31717709 +0000 UTC m=+523.251458199" watchObservedRunningTime="2026-06-07 08:10:41.318934504 +0000 UTC m=+523.253215597" Jun 07 08:10:45.432436 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.432392 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:45.495994 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.495955 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dn4tc"] Jun 07 08:10:45.499231 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.499213 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" Jun 07 08:10:45.503133 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.503115 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qjw98\"" Jun 07 08:10:45.503462 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.503448 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 07 08:10:45.509351 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.509324 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r"] Jun 07 08:10:45.512621 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.512602 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" Jun 07 08:10:45.513023 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.513002 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dn4tc"] Jun 07 08:10:45.517322 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.517303 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ch97c\"" Jun 07 08:10:45.517568 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.517541 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 07 08:10:45.527844 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.527824 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r"] Jun 07 08:10:45.531909 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.531888 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:45.590733 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.590703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae454b3e-2379-4d20-b0b9-bb8200baa3db-cert\") pod \"kserve-controller-manager-69fc866d76-dn4tc\" (UID: \"ae454b3e-2379-4d20-b0b9-bb8200baa3db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" Jun 07 08:10:45.590733 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.590733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/840663e8-d6a4-428e-bbb8-aa071812d184-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-69k2r\" (UID: \"840663e8-d6a4-428e-bbb8-aa071812d184\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" Jun 07 08:10:45.590973 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.590764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m6wn\" (UniqueName: \"kubernetes.io/projected/ae454b3e-2379-4d20-b0b9-bb8200baa3db-kube-api-access-9m6wn\") pod \"kserve-controller-manager-69fc866d76-dn4tc\" (UID: \"ae454b3e-2379-4d20-b0b9-bb8200baa3db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" Jun 07 08:10:45.590973 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.590879 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbv7t\" (UniqueName: \"kubernetes.io/projected/840663e8-d6a4-428e-bbb8-aa071812d184-kube-api-access-nbv7t\") pod \"llmisvc-controller-manager-864bfd7bc9-69k2r\" (UID: \"840663e8-d6a4-428e-bbb8-aa071812d184\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" Jun 07 08:10:45.692136 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.692034 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae454b3e-2379-4d20-b0b9-bb8200baa3db-cert\") pod \"kserve-controller-manager-69fc866d76-dn4tc\" (UID: \"ae454b3e-2379-4d20-b0b9-bb8200baa3db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" Jun 07 08:10:45.692136 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.692066 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/840663e8-d6a4-428e-bbb8-aa071812d184-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-69k2r\" (UID: \"840663e8-d6a4-428e-bbb8-aa071812d184\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" Jun 07 08:10:45.692136 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.692098 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m6wn\" (UniqueName: \"kubernetes.io/projected/ae454b3e-2379-4d20-b0b9-bb8200baa3db-kube-api-access-9m6wn\") pod \"kserve-controller-manager-69fc866d76-dn4tc\" (UID: \"ae454b3e-2379-4d20-b0b9-bb8200baa3db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" Jun 07 08:10:45.692420 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.692159 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbv7t\" (UniqueName: \"kubernetes.io/projected/840663e8-d6a4-428e-bbb8-aa071812d184-kube-api-access-nbv7t\") pod \"llmisvc-controller-manager-864bfd7bc9-69k2r\" (UID: \"840663e8-d6a4-428e-bbb8-aa071812d184\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" Jun 07 08:10:45.692420 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:10:45.692232 2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 07 08:10:45.692420 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:10:45.692304 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae454b3e-2379-4d20-b0b9-bb8200baa3db-cert podName:ae454b3e-2379-4d20-b0b9-bb8200baa3db nodeName:}" failed. No retries permitted until 2026-06-07 08:10:46.192282763 +0000 UTC m=+528.126563836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ae454b3e-2379-4d20-b0b9-bb8200baa3db-cert") pod "kserve-controller-manager-69fc866d76-dn4tc" (UID: "ae454b3e-2379-4d20-b0b9-bb8200baa3db") : secret "kserve-webhook-server-cert" not found Jun 07 08:10:45.693257 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.693225 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:45.694640 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.694611 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/840663e8-d6a4-428e-bbb8-aa071812d184-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-69k2r\" (UID: \"840663e8-d6a4-428e-bbb8-aa071812d184\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" Jun 07 08:10:45.704873 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.704851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbv7t\" (UniqueName: \"kubernetes.io/projected/840663e8-d6a4-428e-bbb8-aa071812d184-kube-api-access-nbv7t\") pod \"llmisvc-controller-manager-864bfd7bc9-69k2r\" (UID: \"840663e8-d6a4-428e-bbb8-aa071812d184\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" Jun 07 08:10:45.709344 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.709324 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m6wn\" (UniqueName: \"kubernetes.io/projected/ae454b3e-2379-4d20-b0b9-bb8200baa3db-kube-api-access-9m6wn\") pod \"kserve-controller-manager-69fc866d76-dn4tc\" (UID: \"ae454b3e-2379-4d20-b0b9-bb8200baa3db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" Jun 07 08:10:45.821891 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.821858 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" Jun 07 08:10:45.982487 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:45.981714 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r"] Jun 07 08:10:45.984744 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:10:45.984718 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod840663e8_d6a4_428e_bbb8_aa071812d184.slice/crio-7d34ffbe4007936e4c43919dbe00f985a0f9ff8565d964b7c023acdacf8a317f WatchSource:0}: Error finding container 7d34ffbe4007936e4c43919dbe00f985a0f9ff8565d964b7c023acdacf8a317f: Status 404 returned error can't find the container with id 7d34ffbe4007936e4c43919dbe00f985a0f9ff8565d964b7c023acdacf8a317f Jun 07 08:10:46.011056 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:46.011034 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:46.195941 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:46.195909 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae454b3e-2379-4d20-b0b9-bb8200baa3db-cert\") pod \"kserve-controller-manager-69fc866d76-dn4tc\" (UID: \"ae454b3e-2379-4d20-b0b9-bb8200baa3db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" Jun 07 08:10:46.198285 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:46.198265 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae454b3e-2379-4d20-b0b9-bb8200baa3db-cert\") pod \"kserve-controller-manager-69fc866d76-dn4tc\" (UID: \"ae454b3e-2379-4d20-b0b9-bb8200baa3db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" Jun 07 08:10:46.294229 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:46.294151 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" event={"ID":"840663e8-d6a4-428e-bbb8-aa071812d184","Type":"ContainerStarted","Data":"7d34ffbe4007936e4c43919dbe00f985a0f9ff8565d964b7c023acdacf8a317f"} Jun 07 08:10:46.408856 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:46.408826 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" Jun 07 08:10:46.538892 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:10:46.538851 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae454b3e_2379_4d20_b0b9_bb8200baa3db.slice/crio-2af7d5b7da604295adf9eb0ce956b9e108b04fffaccdbab4b4c60e1ad6c91752 WatchSource:0}: Error finding container 2af7d5b7da604295adf9eb0ce956b9e108b04fffaccdbab4b4c60e1ad6c91752: Status 404 returned error can't find the container with id 2af7d5b7da604295adf9eb0ce956b9e108b04fffaccdbab4b4c60e1ad6c91752 Jun 07 08:10:46.539614 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:46.539598 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dn4tc"] Jun 07 08:10:46.731744 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:46.731717 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:46.837877 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:46.837804 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:47.298779 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:47.298751 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" event={"ID":"ae454b3e-2379-4d20-b0b9-bb8200baa3db","Type":"ContainerStarted","Data":"2af7d5b7da604295adf9eb0ce956b9e108b04fffaccdbab4b4c60e1ad6c91752"} Jun 07 08:10:50.313498 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:50.313464 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" event={"ID":"ae454b3e-2379-4d20-b0b9-bb8200baa3db","Type":"ContainerStarted","Data":"e7c86b6ff9424076957692a5e5bc09a41055c0464898b9c16df608a0f12571fd"} Jun 07 08:10:50.314026 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:50.313524 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" Jun 07 08:10:50.319970 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:50.319939 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" event={"ID":"840663e8-d6a4-428e-bbb8-aa071812d184","Type":"ContainerStarted","Data":"1cec6cf646391173726d65d47a9940ad3b3ba6954fd6159c4237d5331affffab"} Jun 07 08:10:50.320096 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:50.320025 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" Jun 07 08:10:50.330432 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:50.330392 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" podStartSLOduration=2.282107119 podStartE2EDuration="5.330378044s" totalImagesPullingTime="3.048270925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:10:50.32831997 +0000 UTC m=+532.262601061" watchObservedRunningTime="2026-06-07 08:10:50.330378044 +0000 UTC m=+532.264659129" Jun 07 08:10:50.343784 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:50.343739 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" podStartSLOduration=1.742606655 podStartE2EDuration="5.343726185s" totalImagesPullingTime="3.60111953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:10:50.34286305 +0000 UTC m=+532.277144137" watchObservedRunningTime="2026-06-07 08:10:50.343726185 +0000 UTC m=+532.278007271" Jun 07 08:10:52.008913 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:52.008882 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:52.112091 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:52.112053 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:52.282010 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:52.281923 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-fmpfd" Jun 07 08:10:52.284114 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:52.284087 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-m2f54" Jun 07 08:10:52.761275 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:52.761234 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:53.222956 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:53.222921 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:53.349424 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:53.349389 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:53.952291 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:53.952261 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:54.113359 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.113328 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:54.580553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.580520 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:10:54.769707 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.769674 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-z27c7"] Jun 07 08:10:54.778844 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.778812 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" Jun 07 08:10:54.781984 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.781958 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 07 08:10:54.781984 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.781974 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-g4bh7\"" Jun 07 08:10:54.782206 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.781959 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 07 08:10:54.796590 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.796562 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-z27c7"] Jun 07 08:10:54.861087 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.860996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1d6d25ba-9c87-483a-a97d-e117dca7de00-operator-config\") pod \"servicemesh-operator3-57f65f65fb-z27c7\" (UID: \"1d6d25ba-9c87-483a-a97d-e117dca7de00\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" Jun 07 08:10:54.861087 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.861051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d79xx\" (UniqueName: \"kubernetes.io/projected/1d6d25ba-9c87-483a-a97d-e117dca7de00-kube-api-access-d79xx\") pod \"servicemesh-operator3-57f65f65fb-z27c7\" (UID: \"1d6d25ba-9c87-483a-a97d-e117dca7de00\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" Jun 07 08:10:54.961477 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.961443 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d79xx\" (UniqueName: \"kubernetes.io/projected/1d6d25ba-9c87-483a-a97d-e117dca7de00-kube-api-access-d79xx\") pod \"servicemesh-operator3-57f65f65fb-z27c7\" (UID: \"1d6d25ba-9c87-483a-a97d-e117dca7de00\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" Jun 07 08:10:54.961630 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.961534 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1d6d25ba-9c87-483a-a97d-e117dca7de00-operator-config\") pod \"servicemesh-operator3-57f65f65fb-z27c7\" (UID: \"1d6d25ba-9c87-483a-a97d-e117dca7de00\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" Jun 07 08:10:54.963993 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.963975 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1d6d25ba-9c87-483a-a97d-e117dca7de00-operator-config\") pod \"servicemesh-operator3-57f65f65fb-z27c7\" (UID: \"1d6d25ba-9c87-483a-a97d-e117dca7de00\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" Jun 07 08:10:54.971866 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:54.971841 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d79xx\" (UniqueName: \"kubernetes.io/projected/1d6d25ba-9c87-483a-a97d-e117dca7de00-kube-api-access-d79xx\") pod \"servicemesh-operator3-57f65f65fb-z27c7\" (UID: \"1d6d25ba-9c87-483a-a97d-e117dca7de00\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" Jun 07 08:10:55.088804 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:55.088757 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" Jun 07 08:10:55.215122 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:55.215076 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-z27c7"] Jun 07 08:10:55.218053 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:10:55.218032 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6d25ba_9c87_483a_a97d_e117dca7de00.slice/crio-af3c45fbfbcb4d50ecfe4ae54bd486e73e137ab7fa50c708f0b6e39c9c435048 WatchSource:0}: Error finding container af3c45fbfbcb4d50ecfe4ae54bd486e73e137ab7fa50c708f0b6e39c9c435048: Status 404 returned error can't find the container with id af3c45fbfbcb4d50ecfe4ae54bd486e73e137ab7fa50c708f0b6e39c9c435048 Jun 07 08:10:55.342531 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:55.342494 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" event={"ID":"1d6d25ba-9c87-483a-a97d-e117dca7de00","Type":"ContainerStarted","Data":"af3c45fbfbcb4d50ecfe4ae54bd486e73e137ab7fa50c708f0b6e39c9c435048"} Jun 07 08:10:58.359555 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:58.359509 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" event={"ID":"1d6d25ba-9c87-483a-a97d-e117dca7de00","Type":"ContainerStarted","Data":"06ccc05be823d231394c25288f74d1c20c6e1fd170e3c49c9ad7d36534459205"} Jun 07 08:10:58.360030 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:58.359595 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" Jun 07 08:10:58.381318 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:10:58.381269 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" podStartSLOduration=2.122638466 podStartE2EDuration="4.381254256s" totalImagesPullingTime="2.25861579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:10:58.379092499 +0000 UTC m=+540.313373584" watchObservedRunningTime="2026-06-07 08:10:58.381254256 +0000 UTC m=+540.315535341" Jun 07 08:11:00.664321 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:00.664288 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:04.843243 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:04.843209 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:04.943292 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:04.943262 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:05.202739 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:05.202703 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:05.252439 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:05.252412 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:07.461677 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:07.461644 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:07.560911 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:07.560875 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:09.366234 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:09.366206 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z27c7" Jun 07 08:11:10.817503 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:10.817466 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-9bbd88d68-7jlb8"] Jun 07 08:11:10.825078 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:10.825056 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-9bbd88d68-7jlb8" Jun 07 08:11:10.827904 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:10.827881 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-q466k\"" Jun 07 08:11:10.828019 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:10.827890 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 07 08:11:10.837966 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:10.837937 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-9bbd88d68-7jlb8"] Jun 07 08:11:10.874958 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:10.874929 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:10.887663 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:10.887636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmcq8\" (UniqueName: \"kubernetes.io/projected/abd31cb2-4a44-475a-bc4c-0be33b8a247e-kube-api-access-hmcq8\") pod \"dashboard-redirect-9bbd88d68-7jlb8\" (UID: \"abd31cb2-4a44-475a-bc4c-0be33b8a247e\") " pod="opendatahub/dashboard-redirect-9bbd88d68-7jlb8" Jun 07 08:11:10.887783 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:10.887676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/abd31cb2-4a44-475a-bc4c-0be33b8a247e-redirect-config\") pod \"dashboard-redirect-9bbd88d68-7jlb8\" (UID: \"abd31cb2-4a44-475a-bc4c-0be33b8a247e\") " pod="opendatahub/dashboard-redirect-9bbd88d68-7jlb8" Jun 07 08:11:10.988758 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:10.988731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcq8\" (UniqueName: \"kubernetes.io/projected/abd31cb2-4a44-475a-bc4c-0be33b8a247e-kube-api-access-hmcq8\") pod \"dashboard-redirect-9bbd88d68-7jlb8\" (UID: \"abd31cb2-4a44-475a-bc4c-0be33b8a247e\") " pod="opendatahub/dashboard-redirect-9bbd88d68-7jlb8" Jun 07 08:11:10.988899 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:10.988765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/abd31cb2-4a44-475a-bc4c-0be33b8a247e-redirect-config\") pod \"dashboard-redirect-9bbd88d68-7jlb8\" (UID: \"abd31cb2-4a44-475a-bc4c-0be33b8a247e\") " pod="opendatahub/dashboard-redirect-9bbd88d68-7jlb8" Jun 07 08:11:10.989389 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:10.989372 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/abd31cb2-4a44-475a-bc4c-0be33b8a247e-redirect-config\") pod \"dashboard-redirect-9bbd88d68-7jlb8\" (UID: \"abd31cb2-4a44-475a-bc4c-0be33b8a247e\") " pod="opendatahub/dashboard-redirect-9bbd88d68-7jlb8" Jun 07 08:11:11.001581 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:11.001559 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmcq8\" (UniqueName: \"kubernetes.io/projected/abd31cb2-4a44-475a-bc4c-0be33b8a247e-kube-api-access-hmcq8\") pod \"dashboard-redirect-9bbd88d68-7jlb8\" (UID: \"abd31cb2-4a44-475a-bc4c-0be33b8a247e\") " pod="opendatahub/dashboard-redirect-9bbd88d68-7jlb8" Jun 07 08:11:11.135326 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:11.135240 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-9bbd88d68-7jlb8" Jun 07 08:11:11.261833 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:11.261804 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-9bbd88d68-7jlb8"] Jun 07 08:11:11.265169 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:11:11.265144 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd31cb2_4a44_475a_bc4c_0be33b8a247e.slice/crio-7d49f7385d27e7c7d2d3d1038747670be064fe045eba386b8bae01efbe1f929d WatchSource:0}: Error finding container 7d49f7385d27e7c7d2d3d1038747670be064fe045eba386b8bae01efbe1f929d: Status 404 returned error can't find the container with id 7d49f7385d27e7c7d2d3d1038747670be064fe045eba386b8bae01efbe1f929d Jun 07 08:11:11.416973 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:11.416945 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-9bbd88d68-7jlb8" event={"ID":"abd31cb2-4a44-475a-bc4c-0be33b8a247e","Type":"ContainerStarted","Data":"7d49f7385d27e7c7d2d3d1038747670be064fe045eba386b8bae01efbe1f929d"} Jun 07 08:11:14.429482 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:14.429449 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-9bbd88d68-7jlb8" event={"ID":"abd31cb2-4a44-475a-bc4c-0be33b8a247e","Type":"ContainerStarted","Data":"a4830658055ac664ad04c2dbbf1d4886d0d8d7c56de57a37f70b122e4e739eb2"} Jun 07 08:11:14.445001 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:14.444953 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-9bbd88d68-7jlb8" podStartSLOduration=2.037114218 podStartE2EDuration="4.444937356s" totalImagesPullingTime="2.407823138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:11:14.443687367 +0000 UTC m=+556.377968453" watchObservedRunningTime="2026-06-07 08:11:14.444937356 +0000 UTC m=+556.379218442" Jun 07 08:11:21.326496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:21.326465 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-69k2r" Jun 07 08:11:21.329889 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:21.329867 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-dn4tc" Jun 07 08:11:22.863587 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.863552 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:22.868292 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.868265 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh"] Jun 07 08:11:22.873449 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.873428 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:22.875964 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.875943 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 07 08:11:22.876067 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.875946 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 07 08:11:22.876067 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.875989 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hsrwx\"" Jun 07 08:11:22.876889 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.876875 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 07 08:11:22.876970 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.876881 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 07 08:11:22.883839 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.883818 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh"] Jun 07 08:11:22.932826 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.932797 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:22.990057 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.990035 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acd18e83-0101-4fd5-8d96-5a879486ccb9-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:22.990166 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.990066 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x8lk\" (UniqueName: \"kubernetes.io/projected/acd18e83-0101-4fd5-8d96-5a879486ccb9-kube-api-access-7x8lk\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:22.990166 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.990090 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd18e83-0101-4fd5-8d96-5a879486ccb9-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:22.990234 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.990165 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd18e83-0101-4fd5-8d96-5a879486ccb9-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:22.990234 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.990185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/acd18e83-0101-4fd5-8d96-5a879486ccb9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:22.990234 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.990207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/acd18e83-0101-4fd5-8d96-5a879486ccb9-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:22.990334 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:22.990248 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/acd18e83-0101-4fd5-8d96-5a879486ccb9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.090883 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.090840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/acd18e83-0101-4fd5-8d96-5a879486ccb9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.091049 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.090930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acd18e83-0101-4fd5-8d96-5a879486ccb9-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.091049 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.090964 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x8lk\" (UniqueName: \"kubernetes.io/projected/acd18e83-0101-4fd5-8d96-5a879486ccb9-kube-api-access-7x8lk\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.091049 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.090993 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd18e83-0101-4fd5-8d96-5a879486ccb9-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.091049 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.091033 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd18e83-0101-4fd5-8d96-5a879486ccb9-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.091296 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.091064 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/acd18e83-0101-4fd5-8d96-5a879486ccb9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.091296 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.091129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/acd18e83-0101-4fd5-8d96-5a879486ccb9-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.091795 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.091739 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/acd18e83-0101-4fd5-8d96-5a879486ccb9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.093483 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.093454 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd18e83-0101-4fd5-8d96-5a879486ccb9-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.093785 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.093764 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/acd18e83-0101-4fd5-8d96-5a879486ccb9-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.093908 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.093836 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acd18e83-0101-4fd5-8d96-5a879486ccb9-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.093980 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.093952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/acd18e83-0101-4fd5-8d96-5a879486ccb9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.098568 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.098546 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd18e83-0101-4fd5-8d96-5a879486ccb9-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.098802 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.098785 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x8lk\" (UniqueName: \"kubernetes.io/projected/acd18e83-0101-4fd5-8d96-5a879486ccb9-kube-api-access-7x8lk\") pod \"istiod-openshift-gateway-75c67f8887-fdxkh\" (UID: \"acd18e83-0101-4fd5-8d96-5a879486ccb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.183640 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.183607 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:23.317030 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.317002 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh"] Jun 07 08:11:23.318996 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:11:23.318970 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd18e83_0101_4fd5_8d96_5a879486ccb9.slice/crio-5e5671089115fa5ee2d33aeefc33da39db1d5beffa5aa17ffc358e0c4cabca63 WatchSource:0}: Error finding container 5e5671089115fa5ee2d33aeefc33da39db1d5beffa5aa17ffc358e0c4cabca63: Status 404 returned error can't find the container with id 5e5671089115fa5ee2d33aeefc33da39db1d5beffa5aa17ffc358e0c4cabca63 Jun 07 08:11:23.409246 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.409169 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:23.466298 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:23.466224 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" event={"ID":"acd18e83-0101-4fd5-8d96-5a879486ccb9","Type":"ContainerStarted","Data":"5e5671089115fa5ee2d33aeefc33da39db1d5beffa5aa17ffc358e0c4cabca63"} Jun 07 08:11:25.648897 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:25.648861 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 07 08:11:25.649188 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:25.648926 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 07 08:11:26.487334 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:26.487299 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" event={"ID":"acd18e83-0101-4fd5-8d96-5a879486ccb9","Type":"ContainerStarted","Data":"3fe8c0c38de056c61835e825457a5efd6d0b3d0359e494572bad62489fd22106"} Jun 07 08:11:26.487526 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:26.487434 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:26.489064 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:26.489038 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-fdxkh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 07 08:11:26.489210 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:26.489085 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" podUID="acd18e83-0101-4fd5-8d96-5a879486ccb9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 08:11:26.508663 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:26.508621 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" podStartSLOduration=2.180964499 podStartE2EDuration="4.508608551s" totalImagesPullingTime="2.327644052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:11:26.506633977 +0000 UTC m=+568.440915063" watchObservedRunningTime="2026-06-07 08:11:26.508608551 +0000 UTC m=+568.442889637" Jun 07 08:11:26.842440 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:26.842348 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:26.899096 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:26.899060 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:27.123773 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:27.123638 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:27.314838 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:27.314799 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:27.434641 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:27.434610 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:27.492945 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:27.492919 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fdxkh" Jun 07 08:11:27.733333 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:27.733251 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:34.605299 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:34.605267 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:34.705600 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:34.705568 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:34.805958 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:34.805924 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:35.370513 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:35.370481 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:35.419569 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:35.419538 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:35.705160 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:35.705087 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:35.803064 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:35.803032 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:35.914149 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:35.914116 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:36.639391 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:36.639355 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:36.845997 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:36.845965 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:45.910211 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:45.910179 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:46.900618 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:46.900586 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:11:56.346849 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:11:56.346814 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:03.889736 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:03.889703 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:04.489269 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:04.489233 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:07.855049 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:07.855012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:10.522058 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:10.522022 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:13.742264 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:13.742231 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:14.102360 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:14.102286 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:15.538736 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:15.538683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:16.912246 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:16.912211 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:18.188403 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:18.188362 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:21.353990 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:21.353958 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:22.907302 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:22.907271 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:23.007595 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:23.007567 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:23.322969 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:23.322899 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:23.432698 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:23.432667 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:26.932844 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:26.932809 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:27.032891 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:27.032863 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:29.618645 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:29.618613 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:29.716654 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:29.716629 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:30.199353 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:30.199321 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:30.620657 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:30.620575 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:30.722893 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:30.722865 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:30.826745 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:30.826715 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:34.274534 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:34.274503 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:34.372478 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:34.372448 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:40.216667 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.216632 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl"] Jun 07 08:12:40.219679 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.219663 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:40.222918 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.222894 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 08:12:40.223088 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.223069 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 08:12:40.223187 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.223072 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z2tqw\"" Jun 07 08:12:40.236852 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.236829 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl"] Jun 07 08:12:40.289581 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.289551 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31170091-173e-477b-bfb6-8d1c46d2ed04-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xldgl\" (UID: \"31170091-173e-477b-bfb6-8d1c46d2ed04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:40.289736 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.289587 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99pxj\" (UniqueName: \"kubernetes.io/projected/31170091-173e-477b-bfb6-8d1c46d2ed04-kube-api-access-99pxj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xldgl\" (UID: \"31170091-173e-477b-bfb6-8d1c46d2ed04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:40.390622 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.390592 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31170091-173e-477b-bfb6-8d1c46d2ed04-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xldgl\" (UID: \"31170091-173e-477b-bfb6-8d1c46d2ed04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:40.390774 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.390628 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99pxj\" (UniqueName: \"kubernetes.io/projected/31170091-173e-477b-bfb6-8d1c46d2ed04-kube-api-access-99pxj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xldgl\" (UID: \"31170091-173e-477b-bfb6-8d1c46d2ed04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:40.390964 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.390943 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31170091-173e-477b-bfb6-8d1c46d2ed04-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xldgl\" (UID: \"31170091-173e-477b-bfb6-8d1c46d2ed04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:40.401627 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.401600 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99pxj\" (UniqueName: \"kubernetes.io/projected/31170091-173e-477b-bfb6-8d1c46d2ed04-kube-api-access-99pxj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xldgl\" (UID: \"31170091-173e-477b-bfb6-8d1c46d2ed04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:40.529899 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.529821 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:40.669978 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.669955 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl"] Jun 07 08:12:40.672464 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:12:40.672438 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31170091_173e_477b_bfb6_8d1c46d2ed04.slice/crio-76e98cbcb0efcc5c32bd788919e0f4b437e4a4a9d864581fc738cd28eaa12a48 WatchSource:0}: Error finding container 76e98cbcb0efcc5c32bd788919e0f4b437e4a4a9d864581fc738cd28eaa12a48: Status 404 returned error can't find the container with id 76e98cbcb0efcc5c32bd788919e0f4b437e4a4a9d864581fc738cd28eaa12a48 Jun 07 08:12:40.797877 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.797795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" event={"ID":"31170091-173e-477b-bfb6-8d1c46d2ed04","Type":"ContainerStarted","Data":"76e98cbcb0efcc5c32bd788919e0f4b437e4a4a9d864581fc738cd28eaa12a48"} Jun 07 08:12:40.889660 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.889629 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl"] Jun 07 08:12:40.896912 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.896883 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl"] Jun 07 08:12:40.911875 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.911846 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd"] Jun 07 08:12:40.916038 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.916016 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" Jun 07 08:12:40.929762 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.929729 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd"] Jun 07 08:12:40.996179 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.996139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31c336ac-4437-4684-82ce-ad565786f60c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2wtpd\" (UID: \"31c336ac-4437-4684-82ce-ad565786f60c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" Jun 07 08:12:40.996367 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:40.996209 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqx5p\" (UniqueName: \"kubernetes.io/projected/31c336ac-4437-4684-82ce-ad565786f60c-kube-api-access-zqx5p\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2wtpd\" (UID: \"31c336ac-4437-4684-82ce-ad565786f60c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" Jun 07 08:12:41.097135 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:41.097045 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31c336ac-4437-4684-82ce-ad565786f60c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2wtpd\" (UID: \"31c336ac-4437-4684-82ce-ad565786f60c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" Jun 07 08:12:41.097135 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:41.097125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqx5p\" (UniqueName: \"kubernetes.io/projected/31c336ac-4437-4684-82ce-ad565786f60c-kube-api-access-zqx5p\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2wtpd\" (UID: \"31c336ac-4437-4684-82ce-ad565786f60c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" Jun 07 08:12:41.097506 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:41.097477 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31c336ac-4437-4684-82ce-ad565786f60c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2wtpd\" (UID: \"31c336ac-4437-4684-82ce-ad565786f60c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" Jun 07 08:12:41.105741 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:41.105712 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqx5p\" (UniqueName: \"kubernetes.io/projected/31c336ac-4437-4684-82ce-ad565786f60c-kube-api-access-zqx5p\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2wtpd\" (UID: \"31c336ac-4437-4684-82ce-ad565786f60c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" Jun 07 08:12:41.227804 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:41.227759 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" Jun 07 08:12:41.371388 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:41.371230 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd"] Jun 07 08:12:41.616963 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:12:41.616923 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c336ac_4437_4684_82ce_ad565786f60c.slice/crio-7d97236ddebb7e78e54bb548b01e4122ce0c0944d72b9d51533c20b9eabb9213 WatchSource:0}: Error finding container 7d97236ddebb7e78e54bb548b01e4122ce0c0944d72b9d51533c20b9eabb9213: Status 404 returned error can't find the container with id 7d97236ddebb7e78e54bb548b01e4122ce0c0944d72b9d51533c20b9eabb9213 Jun 07 08:12:41.804463 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:41.804423 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" event={"ID":"31c336ac-4437-4684-82ce-ad565786f60c","Type":"ContainerStarted","Data":"7d97236ddebb7e78e54bb548b01e4122ce0c0944d72b9d51533c20b9eabb9213"} Jun 07 08:12:42.099506 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:42.099474 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:42.200632 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:42.200595 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:42.505384 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:42.505346 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:42.608843 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:42.608803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:45.104768 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:45.104740 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:45.204780 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:45.204746 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:45.825863 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:45.825827 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" podUID="31170091-173e-477b-bfb6-8d1c46d2ed04" containerName="manager" containerID="cri-o://3a0f79b701e5ea030f596a3a8a6098a022266ebfd4ab669bd369ce8ee8055c94" gracePeriod=2 Jun 07 08:12:45.827515 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:45.827485 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" event={"ID":"31c336ac-4437-4684-82ce-ad565786f60c","Type":"ContainerStarted","Data":"b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca"} Jun 07 08:12:45.827658 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:45.827635 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" Jun 07 08:12:45.850792 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:45.850710 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" podStartSLOduration=2.501025121 podStartE2EDuration="5.850691084s" totalImagesPullingTime="3.349665963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:12:45.848658556 +0000 UTC m=+647.782939646" watchObservedRunningTime="2026-06-07 08:12:45.850691084 +0000 UTC m=+647.784972174" Jun 07 08:12:46.065989 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.065964 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:46.068281 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:12:46.068255 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xldgl\" is forbidden: User \"system:node:ip-10-0-142-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-99.ec2.internal' and this object" podUID="31170091-173e-477b-bfb6-8d1c46d2ed04" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:46.143541 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.143478 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31170091-173e-477b-bfb6-8d1c46d2ed04-extensions-socket-volume\") pod \"31170091-173e-477b-bfb6-8d1c46d2ed04\" (UID: \"31170091-173e-477b-bfb6-8d1c46d2ed04\") " Jun 07 08:12:46.143541 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.143520 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99pxj\" (UniqueName: \"kubernetes.io/projected/31170091-173e-477b-bfb6-8d1c46d2ed04-kube-api-access-99pxj\") pod \"31170091-173e-477b-bfb6-8d1c46d2ed04\" (UID: \"31170091-173e-477b-bfb6-8d1c46d2ed04\") " Jun 07 08:12:46.143942 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.143767 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31170091-173e-477b-bfb6-8d1c46d2ed04-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "31170091-173e-477b-bfb6-8d1c46d2ed04" (UID: "31170091-173e-477b-bfb6-8d1c46d2ed04"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 08:12:46.145643 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.145624 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31170091-173e-477b-bfb6-8d1c46d2ed04-kube-api-access-99pxj" (OuterVolumeSpecName: "kube-api-access-99pxj") pod "31170091-173e-477b-bfb6-8d1c46d2ed04" (UID: "31170091-173e-477b-bfb6-8d1c46d2ed04"). InnerVolumeSpecName "kube-api-access-99pxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 08:12:46.244218 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.244180 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31170091-173e-477b-bfb6-8d1c46d2ed04-extensions-socket-volume\") on node \"ip-10-0-142-99.ec2.internal\" DevicePath \"\"" Jun 07 08:12:46.244218 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.244214 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99pxj\" (UniqueName: \"kubernetes.io/projected/31170091-173e-477b-bfb6-8d1c46d2ed04-kube-api-access-99pxj\") on node \"ip-10-0-142-99.ec2.internal\" DevicePath \"\"" Jun 07 08:12:46.539512 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.539483 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31170091-173e-477b-bfb6-8d1c46d2ed04" path="/var/lib/kubelet/pods/31170091-173e-477b-bfb6-8d1c46d2ed04/volumes" Jun 07 08:12:46.833705 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.833627 2559 generic.go:356] "Generic (PLEG): container finished" podID="31170091-173e-477b-bfb6-8d1c46d2ed04" containerID="3a0f79b701e5ea030f596a3a8a6098a022266ebfd4ab669bd369ce8ee8055c94" exitCode=2 Jun 07 08:12:46.833705 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.833682 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:46.833880 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.833722 2559 scope.go:117] "RemoveContainer" containerID="3a0f79b701e5ea030f596a3a8a6098a022266ebfd4ab669bd369ce8ee8055c94" Jun 07 08:12:46.838338 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:12:46.838310 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xldgl\" is forbidden: User \"system:node:ip-10-0-142-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-99.ec2.internal' and this object" podUID="31170091-173e-477b-bfb6-8d1c46d2ed04" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:46.843018 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.843001 2559 scope.go:117] "RemoveContainer" containerID="3a0f79b701e5ea030f596a3a8a6098a022266ebfd4ab669bd369ce8ee8055c94" Jun 07 08:12:46.843291 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:12:46.843269 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a0f79b701e5ea030f596a3a8a6098a022266ebfd4ab669bd369ce8ee8055c94\": container with ID starting with 3a0f79b701e5ea030f596a3a8a6098a022266ebfd4ab669bd369ce8ee8055c94 not found: ID does not exist" containerID="3a0f79b701e5ea030f596a3a8a6098a022266ebfd4ab669bd369ce8ee8055c94" Jun 07 08:12:46.843348 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:46.843300 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a0f79b701e5ea030f596a3a8a6098a022266ebfd4ab669bd369ce8ee8055c94"} err="failed to get container status \"3a0f79b701e5ea030f596a3a8a6098a022266ebfd4ab669bd369ce8ee8055c94\": rpc error: code = NotFound desc = could not find container \"3a0f79b701e5ea030f596a3a8a6098a022266ebfd4ab669bd369ce8ee8055c94\": container with ID starting with 3a0f79b701e5ea030f596a3a8a6098a022266ebfd4ab669bd369ce8ee8055c94 not found: ID does not exist" Jun 07 08:12:48.537439 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:12:48.537399 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xldgl\" is forbidden: User \"system:node:ip-10-0-142-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-99.ec2.internal' and this object" podUID="31170091-173e-477b-bfb6-8d1c46d2ed04" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xldgl" Jun 07 08:12:50.308531 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:50.308498 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:50.435620 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:50.435589 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:53.895002 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:53.894971 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:53.998642 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:53.998612 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:54.832188 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:54.832157 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:12:56.836746 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:12:56.836720 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" Jun 07 08:13:09.405022 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.404991 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd"] Jun 07 08:13:09.406160 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.405225 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" podUID="31c336ac-4437-4684-82ce-ad565786f60c" containerName="manager" containerID="cri-o://b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca" gracePeriod=10 Jun 07 08:13:09.653523 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.653499 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" Jun 07 08:13:09.736529 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.736443 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31c336ac-4437-4684-82ce-ad565786f60c-extensions-socket-volume\") pod \"31c336ac-4437-4684-82ce-ad565786f60c\" (UID: \"31c336ac-4437-4684-82ce-ad565786f60c\") " Jun 07 08:13:09.736695 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.736561 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqx5p\" (UniqueName: \"kubernetes.io/projected/31c336ac-4437-4684-82ce-ad565786f60c-kube-api-access-zqx5p\") pod \"31c336ac-4437-4684-82ce-ad565786f60c\" (UID: \"31c336ac-4437-4684-82ce-ad565786f60c\") " Jun 07 08:13:09.736867 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.736840 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c336ac-4437-4684-82ce-ad565786f60c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "31c336ac-4437-4684-82ce-ad565786f60c" (UID: "31c336ac-4437-4684-82ce-ad565786f60c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 08:13:09.738547 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.738523 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c336ac-4437-4684-82ce-ad565786f60c-kube-api-access-zqx5p" (OuterVolumeSpecName: "kube-api-access-zqx5p") pod "31c336ac-4437-4684-82ce-ad565786f60c" (UID: "31c336ac-4437-4684-82ce-ad565786f60c"). InnerVolumeSpecName "kube-api-access-zqx5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 08:13:09.837527 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.837499 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqx5p\" (UniqueName: \"kubernetes.io/projected/31c336ac-4437-4684-82ce-ad565786f60c-kube-api-access-zqx5p\") on node \"ip-10-0-142-99.ec2.internal\" DevicePath \"\"" Jun 07 08:13:09.837527 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.837521 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31c336ac-4437-4684-82ce-ad565786f60c-extensions-socket-volume\") on node \"ip-10-0-142-99.ec2.internal\" DevicePath \"\"" Jun 07 08:13:09.937672 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.937635 2559 generic.go:356] "Generic (PLEG): container finished" podID="31c336ac-4437-4684-82ce-ad565786f60c" containerID="b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca" exitCode=0 Jun 07 08:13:09.937771 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.937695 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" Jun 07 08:13:09.937771 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.937724 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" event={"ID":"31c336ac-4437-4684-82ce-ad565786f60c","Type":"ContainerDied","Data":"b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca"} Jun 07 08:13:09.937840 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.937821 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd" event={"ID":"31c336ac-4437-4684-82ce-ad565786f60c","Type":"ContainerDied","Data":"7d97236ddebb7e78e54bb548b01e4122ce0c0944d72b9d51533c20b9eabb9213"} Jun 07 08:13:09.937873 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.937847 2559 scope.go:117] "RemoveContainer" containerID="b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca" Jun 07 08:13:09.946394 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.946375 2559 scope.go:117] "RemoveContainer" containerID="b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca" Jun 07 08:13:09.946630 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:13:09.946613 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca\": container with ID starting with b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca not found: ID does not exist" containerID="b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca" Jun 07 08:13:09.946676 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.946638 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca"} err="failed to get container status \"b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca\": rpc error: code = NotFound desc = could not find container \"b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca\": container with ID starting with b484cd327eb7ac0c4fc4ff3debefa55aaca8647da26aad036583fb6eeb8d2aca not found: ID does not exist" Jun 07 08:13:09.976525 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.976496 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd"] Jun 07 08:13:09.998925 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:09.998868 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2wtpd"] Jun 07 08:13:10.538989 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:10.538955 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31c336ac-4437-4684-82ce-ad565786f60c" path="/var/lib/kubelet/pods/31c336ac-4437-4684-82ce-ad565786f60c/volumes" Jun 07 08:13:13.232571 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:13.232539 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:13:13.288337 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:13.288305 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:13:14.443552 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:14.443501 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:13:16.478335 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:16.478307 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:13:29.187821 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.187784 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxljr"] Jun 07 08:13:29.188234 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.188070 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31170091-173e-477b-bfb6-8d1c46d2ed04" containerName="manager" Jun 07 08:13:29.188234 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.188082 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="31170091-173e-477b-bfb6-8d1c46d2ed04" containerName="manager" Jun 07 08:13:29.188234 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.188092 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31c336ac-4437-4684-82ce-ad565786f60c" containerName="manager" Jun 07 08:13:29.188234 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.188098 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c336ac-4437-4684-82ce-ad565786f60c" containerName="manager" Jun 07 08:13:29.188234 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.188164 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="31c336ac-4437-4684-82ce-ad565786f60c" containerName="manager" Jun 07 08:13:29.188234 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.188172 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="31170091-173e-477b-bfb6-8d1c46d2ed04" containerName="manager" Jun 07 08:13:29.189917 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.189878 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:13:29.191082 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.191067 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" Jun 07 08:13:29.193479 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.193447 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 08:13:29.193589 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.193508 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 08:13:29.194459 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.194441 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 07 08:13:29.194459 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.194448 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tzrlk\"" Jun 07 08:13:29.200744 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.200717 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxljr"] Jun 07 08:13:29.288285 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.288245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpqtb\" (UniqueName: \"kubernetes.io/projected/aa507336-b29f-4486-8595-12015bfc40ca-kube-api-access-cpqtb\") pod \"limitador-limitador-64c94fd64f-fxljr\" (UID: \"aa507336-b29f-4486-8595-12015bfc40ca\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" Jun 07 08:13:29.288443 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.288300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa507336-b29f-4486-8595-12015bfc40ca-config-file\") pod \"limitador-limitador-64c94fd64f-fxljr\" (UID: \"aa507336-b29f-4486-8595-12015bfc40ca\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" Jun 07 08:13:29.289037 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.289008 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxljr"] Jun 07 08:13:29.296463 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.296406 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:13:29.389310 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.389280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpqtb\" (UniqueName: \"kubernetes.io/projected/aa507336-b29f-4486-8595-12015bfc40ca-kube-api-access-cpqtb\") pod \"limitador-limitador-64c94fd64f-fxljr\" (UID: \"aa507336-b29f-4486-8595-12015bfc40ca\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" Jun 07 08:13:29.389460 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.389320 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa507336-b29f-4486-8595-12015bfc40ca-config-file\") pod \"limitador-limitador-64c94fd64f-fxljr\" (UID: \"aa507336-b29f-4486-8595-12015bfc40ca\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" Jun 07 08:13:29.389991 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.389969 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa507336-b29f-4486-8595-12015bfc40ca-config-file\") pod \"limitador-limitador-64c94fd64f-fxljr\" (UID: \"aa507336-b29f-4486-8595-12015bfc40ca\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" Jun 07 08:13:29.395263 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.395240 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:13:29.397666 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.397642 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpqtb\" (UniqueName: \"kubernetes.io/projected/aa507336-b29f-4486-8595-12015bfc40ca-kube-api-access-cpqtb\") pod \"limitador-limitador-64c94fd64f-fxljr\" (UID: \"aa507336-b29f-4486-8595-12015bfc40ca\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" Jun 07 08:13:29.501533 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.501460 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" Jun 07 08:13:29.512669 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.512647 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c5kmc"] Jun 07 08:13:29.516851 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.516753 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" Jun 07 08:13:29.525866 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.525839 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c5kmc"] Jun 07 08:13:29.538156 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.538129 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c5kmc"] Jun 07 08:13:29.635783 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.635608 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxljr"] Jun 07 08:13:29.637959 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:13:29.637927 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa507336_b29f_4486_8595_12015bfc40ca.slice/crio-69ff87d764ba1654acaa03bfd8d53647fa51acfef49e305b08ac38255c05a55e WatchSource:0}: Error finding container 69ff87d764ba1654acaa03bfd8d53647fa51acfef49e305b08ac38255c05a55e: Status 404 returned error can't find the container with id 69ff87d764ba1654acaa03bfd8d53647fa51acfef49e305b08ac38255c05a55e Jun 07 08:13:29.692316 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.692293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpmxj\" (UniqueName: \"kubernetes.io/projected/9f99260d-e4bf-4889-b036-12e7f1aef968-kube-api-access-zpmxj\") pod \"limitador-limitador-54d6d988d5-c5kmc\" (UID: \"9f99260d-e4bf-4889-b036-12e7f1aef968\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" Jun 07 08:13:29.692430 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.692337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9f99260d-e4bf-4889-b036-12e7f1aef968-config-file\") pod \"limitador-limitador-54d6d988d5-c5kmc\" (UID: \"9f99260d-e4bf-4889-b036-12e7f1aef968\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" Jun 07 08:13:29.793607 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.793531 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9f99260d-e4bf-4889-b036-12e7f1aef968-config-file\") pod \"limitador-limitador-54d6d988d5-c5kmc\" (UID: \"9f99260d-e4bf-4889-b036-12e7f1aef968\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" Jun 07 08:13:29.793752 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.793625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpmxj\" (UniqueName: \"kubernetes.io/projected/9f99260d-e4bf-4889-b036-12e7f1aef968-kube-api-access-zpmxj\") pod \"limitador-limitador-54d6d988d5-c5kmc\" (UID: \"9f99260d-e4bf-4889-b036-12e7f1aef968\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" Jun 07 08:13:29.794171 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.794150 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9f99260d-e4bf-4889-b036-12e7f1aef968-config-file\") pod \"limitador-limitador-54d6d988d5-c5kmc\" (UID: \"9f99260d-e4bf-4889-b036-12e7f1aef968\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" Jun 07 08:13:29.801238 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.801220 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpmxj\" (UniqueName: \"kubernetes.io/projected/9f99260d-e4bf-4889-b036-12e7f1aef968-kube-api-access-zpmxj\") pod \"limitador-limitador-54d6d988d5-c5kmc\" (UID: \"9f99260d-e4bf-4889-b036-12e7f1aef968\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" Jun 07 08:13:29.838551 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.838529 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" Jun 07 08:13:29.963812 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:29.963788 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c5kmc"] Jun 07 08:13:29.965726 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:13:29.965689 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f99260d_e4bf_4889_b036_12e7f1aef968.slice/crio-77d17945af072ee4ec38df0662e7140b625ce8cb89240d46bd1a9fe3257ce1b7 WatchSource:0}: Error finding container 77d17945af072ee4ec38df0662e7140b625ce8cb89240d46bd1a9fe3257ce1b7: Status 404 returned error can't find the container with id 77d17945af072ee4ec38df0662e7140b625ce8cb89240d46bd1a9fe3257ce1b7 Jun 07 08:13:30.026932 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:30.026905 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" event={"ID":"9f99260d-e4bf-4889-b036-12e7f1aef968","Type":"ContainerStarted","Data":"77d17945af072ee4ec38df0662e7140b625ce8cb89240d46bd1a9fe3257ce1b7"} Jun 07 08:13:30.027063 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:30.026902 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:13:30.027976 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:30.027956 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" event={"ID":"aa507336-b29f-4486-8595-12015bfc40ca","Type":"ContainerStarted","Data":"69ff87d764ba1654acaa03bfd8d53647fa51acfef49e305b08ac38255c05a55e"} Jun 07 08:13:30.090593 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:30.090530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:13:33.046473 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:33.046365 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" event={"ID":"9f99260d-e4bf-4889-b036-12e7f1aef968","Type":"ContainerStarted","Data":"dfe9a42e72d446098d0cf4042b328ff3cf30228afce127e2e1ba5f963b8eb1d3"} Jun 07 08:13:33.046473 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:33.046456 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" Jun 07 08:13:33.047861 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:33.047838 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" event={"ID":"aa507336-b29f-4486-8595-12015bfc40ca","Type":"ContainerStarted","Data":"f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad"} Jun 07 08:13:33.047963 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:33.047921 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" Jun 07 08:13:33.065817 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:33.065765 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" podStartSLOduration=1.374803076 podStartE2EDuration="4.065747429s" totalImagesPullingTime="2.690944353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:13:33.062718128 +0000 UTC m=+694.996999215" watchObservedRunningTime="2026-06-07 08:13:33.065747429 +0000 UTC m=+695.000028520" Jun 07 08:13:33.078553 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:33.078507 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" podStartSLOduration=1.066802494 podStartE2EDuration="4.078495092s" totalImagesPullingTime="3.011692598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:13:33.077743106 +0000 UTC m=+695.012024192" watchObservedRunningTime="2026-06-07 08:13:33.078495092 +0000 UTC m=+695.012776189" Jun 07 08:13:44.053663 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:44.053625 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-c5kmc" Jun 07 08:13:44.054145 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:44.053717 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" Jun 07 08:13:44.110120 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:44.110080 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxljr"] Jun 07 08:13:44.110268 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:44.110250 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" podUID="aa507336-b29f-4486-8595-12015bfc40ca" containerName="limitador" containerID="cri-o://f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad" gracePeriod=30 Jun 07 08:13:44.666534 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:44.666508 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" Jun 07 08:13:44.697220 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:44.697154 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpqtb\" (UniqueName: \"kubernetes.io/projected/aa507336-b29f-4486-8595-12015bfc40ca-kube-api-access-cpqtb\") pod \"aa507336-b29f-4486-8595-12015bfc40ca\" (UID: \"aa507336-b29f-4486-8595-12015bfc40ca\") " Jun 07 08:13:44.697220 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:44.697208 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa507336-b29f-4486-8595-12015bfc40ca-config-file\") pod \"aa507336-b29f-4486-8595-12015bfc40ca\" (UID: \"aa507336-b29f-4486-8595-12015bfc40ca\") " Jun 07 08:13:44.697570 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:44.697550 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa507336-b29f-4486-8595-12015bfc40ca-config-file" (OuterVolumeSpecName: "config-file") pod "aa507336-b29f-4486-8595-12015bfc40ca" (UID: "aa507336-b29f-4486-8595-12015bfc40ca"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 08:13:44.699140 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:44.699084 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa507336-b29f-4486-8595-12015bfc40ca-kube-api-access-cpqtb" (OuterVolumeSpecName: "kube-api-access-cpqtb") pod "aa507336-b29f-4486-8595-12015bfc40ca" (UID: "aa507336-b29f-4486-8595-12015bfc40ca"). InnerVolumeSpecName "kube-api-access-cpqtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 08:13:44.798182 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:44.798146 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpqtb\" (UniqueName: \"kubernetes.io/projected/aa507336-b29f-4486-8595-12015bfc40ca-kube-api-access-cpqtb\") on node \"ip-10-0-142-99.ec2.internal\" DevicePath \"\"" Jun 07 08:13:44.798182 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:44.798180 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa507336-b29f-4486-8595-12015bfc40ca-config-file\") on node \"ip-10-0-142-99.ec2.internal\" DevicePath \"\"" Jun 07 08:13:45.104489 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:45.104401 2559 generic.go:356] "Generic (PLEG): container finished" podID="aa507336-b29f-4486-8595-12015bfc40ca" containerID="f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad" exitCode=0 Jun 07 08:13:45.104489 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:45.104452 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" Jun 07 08:13:45.104903 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:45.104490 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" event={"ID":"aa507336-b29f-4486-8595-12015bfc40ca","Type":"ContainerDied","Data":"f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad"} Jun 07 08:13:45.104903 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:45.104577 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxljr" event={"ID":"aa507336-b29f-4486-8595-12015bfc40ca","Type":"ContainerDied","Data":"69ff87d764ba1654acaa03bfd8d53647fa51acfef49e305b08ac38255c05a55e"} Jun 07 08:13:45.104903 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:45.104606 2559 scope.go:117] "RemoveContainer" containerID="f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad" Jun 07 08:13:45.112854 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:45.112665 2559 scope.go:117] "RemoveContainer" containerID="f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad" Jun 07 08:13:45.112935 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:13:45.112917 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad\": container with ID starting with f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad not found: ID does not exist" containerID="f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad" Jun 07 08:13:45.112977 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:45.112944 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad"} err="failed to get container status \"f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad\": rpc error: code = NotFound desc = could not find container \"f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad\": container with ID starting with f03a3f051a13deae392bac7ca9e60067e4819052c8b2355331837434a7aba0ad not found: ID does not exist" Jun 07 08:13:45.125036 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:45.125013 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxljr"] Jun 07 08:13:45.128028 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:45.128000 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxljr"] Jun 07 08:13:46.539032 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:46.538998 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa507336-b29f-4486-8595-12015bfc40ca" path="/var/lib/kubelet/pods/aa507336-b29f-4486-8595-12015bfc40ca/volumes" Jun 07 08:13:48.820439 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:48.820407 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-9dcqc"] Jun 07 08:13:48.820788 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:48.820733 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa507336-b29f-4486-8595-12015bfc40ca" containerName="limitador" Jun 07 08:13:48.820788 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:48.820745 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa507336-b29f-4486-8595-12015bfc40ca" containerName="limitador" Jun 07 08:13:48.820860 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:48.820804 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa507336-b29f-4486-8595-12015bfc40ca" containerName="limitador" Jun 07 08:13:48.829806 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:48.829780 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-9dcqc" Jun 07 08:13:48.838297 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:48.838275 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 07 08:13:48.840045 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:48.840024 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-9dcqc"] Jun 07 08:13:48.868849 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:48.868819 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:13:48.930500 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:48.930472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2546de74-d194-4d34-9ed0-013748a65da3-data\") pod \"postgres-69fb4594cf-9dcqc\" (UID: \"2546de74-d194-4d34-9ed0-013748a65da3\") " pod="opendatahub/postgres-69fb4594cf-9dcqc" Jun 07 08:13:48.930611 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:48.930518 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtztc\" (UniqueName: \"kubernetes.io/projected/2546de74-d194-4d34-9ed0-013748a65da3-kube-api-access-mtztc\") pod \"postgres-69fb4594cf-9dcqc\" (UID: \"2546de74-d194-4d34-9ed0-013748a65da3\") " pod="opendatahub/postgres-69fb4594cf-9dcqc" Jun 07 08:13:49.031487 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:49.031465 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2546de74-d194-4d34-9ed0-013748a65da3-data\") pod \"postgres-69fb4594cf-9dcqc\" (UID: \"2546de74-d194-4d34-9ed0-013748a65da3\") " pod="opendatahub/postgres-69fb4594cf-9dcqc" Jun 07 08:13:49.031614 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:49.031502 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtztc\" (UniqueName: \"kubernetes.io/projected/2546de74-d194-4d34-9ed0-013748a65da3-kube-api-access-mtztc\") pod \"postgres-69fb4594cf-9dcqc\" (UID: \"2546de74-d194-4d34-9ed0-013748a65da3\") " pod="opendatahub/postgres-69fb4594cf-9dcqc" Jun 07 08:13:49.031906 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:49.031890 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2546de74-d194-4d34-9ed0-013748a65da3-data\") pod \"postgres-69fb4594cf-9dcqc\" (UID: \"2546de74-d194-4d34-9ed0-013748a65da3\") " pod="opendatahub/postgres-69fb4594cf-9dcqc" Jun 07 08:13:49.040051 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:49.040025 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtztc\" (UniqueName: \"kubernetes.io/projected/2546de74-d194-4d34-9ed0-013748a65da3-kube-api-access-mtztc\") pod \"postgres-69fb4594cf-9dcqc\" (UID: \"2546de74-d194-4d34-9ed0-013748a65da3\") " pod="opendatahub/postgres-69fb4594cf-9dcqc" Jun 07 08:13:49.140818 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:49.140749 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-9dcqc" Jun 07 08:13:49.263064 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:49.263038 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-9dcqc"] Jun 07 08:13:49.265577 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:13:49.265549 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2546de74_d194_4d34_9ed0_013748a65da3.slice/crio-8b8465a9e39a470a8c4f9d5aec0d93b32fd52cefdfd6f45a8ad9b74af661ed3d WatchSource:0}: Error finding container 8b8465a9e39a470a8c4f9d5aec0d93b32fd52cefdfd6f45a8ad9b74af661ed3d: Status 404 returned error can't find the container with id 8b8465a9e39a470a8c4f9d5aec0d93b32fd52cefdfd6f45a8ad9b74af661ed3d Jun 07 08:13:50.135250 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:50.135203 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-9dcqc" event={"ID":"2546de74-d194-4d34-9ed0-013748a65da3","Type":"ContainerStarted","Data":"8b8465a9e39a470a8c4f9d5aec0d93b32fd52cefdfd6f45a8ad9b74af661ed3d"} Jun 07 08:13:52.147064 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:52.147033 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-9dcqc" event={"ID":"2546de74-d194-4d34-9ed0-013748a65da3","Type":"ContainerStarted","Data":"e3523cea8b24648d63c014650e837ba55303d9eb38a89c46781de19d6cefd5b2"} Jun 07 08:13:52.147436 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:52.147121 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-9dcqc" Jun 07 08:13:52.164712 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:52.164666 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-9dcqc" podStartSLOduration=1.977905452 podStartE2EDuration="4.164652277s" totalImagesPullingTime="2.186746825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:13:52.163702066 +0000 UTC m=+714.097983153" watchObservedRunningTime="2026-06-07 08:13:52.164652277 +0000 UTC m=+714.098933364" Jun 07 08:13:58.185856 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:58.185822 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-9dcqc" Jun 07 08:13:58.498666 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:58.498576 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:13:58.588866 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:58.588836 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:13:58.775394 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:13:58.775321 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:14:22.876802 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:22.876768 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:14:22.930475 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:22.930447 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:14:53.361087 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:53.361051 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:14:53.490144 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:53.490115 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:14:58.824246 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:58.824212 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b94c8c555-f2cv9"] Jun 07 08:14:58.826619 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:58.826589 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b94c8c555-f2cv9" Jun 07 08:14:58.829196 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:58.829168 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 07 08:14:58.829323 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:58.829205 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b74zl\"" Jun 07 08:14:58.844393 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:58.844369 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b94c8c555-f2cv9"] Jun 07 08:14:58.863343 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:58.863318 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t45c8\" (UniqueName: \"kubernetes.io/projected/30ee9c25-2b45-46d3-a597-7a0516c5873e-kube-api-access-t45c8\") pod \"maas-controller-5b94c8c555-f2cv9\" (UID: \"30ee9c25-2b45-46d3-a597-7a0516c5873e\") " pod="opendatahub/maas-controller-5b94c8c555-f2cv9" Jun 07 08:14:58.964431 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:58.964399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t45c8\" (UniqueName: \"kubernetes.io/projected/30ee9c25-2b45-46d3-a597-7a0516c5873e-kube-api-access-t45c8\") pod \"maas-controller-5b94c8c555-f2cv9\" (UID: \"30ee9c25-2b45-46d3-a597-7a0516c5873e\") " pod="opendatahub/maas-controller-5b94c8c555-f2cv9" Jun 07 08:14:58.976853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:58.976828 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t45c8\" (UniqueName: \"kubernetes.io/projected/30ee9c25-2b45-46d3-a597-7a0516c5873e-kube-api-access-t45c8\") pod \"maas-controller-5b94c8c555-f2cv9\" (UID: \"30ee9c25-2b45-46d3-a597-7a0516c5873e\") " pod="opendatahub/maas-controller-5b94c8c555-f2cv9" Jun 07 08:14:59.136562 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:59.136469 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b94c8c555-f2cv9" Jun 07 08:14:59.260407 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:59.260379 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b94c8c555-f2cv9"] Jun 07 08:14:59.263785 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:14:59.263757 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ee9c25_2b45_46d3_a597_7a0516c5873e.slice/crio-77c891cda0a722bec531433e6583cd85f69027fa1cea8ca09e0289b1d8846f2f WatchSource:0}: Error finding container 77c891cda0a722bec531433e6583cd85f69027fa1cea8ca09e0289b1d8846f2f: Status 404 returned error can't find the container with id 77c891cda0a722bec531433e6583cd85f69027fa1cea8ca09e0289b1d8846f2f Jun 07 08:14:59.265479 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:59.265460 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 08:14:59.436498 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:14:59.436470 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b94c8c555-f2cv9" event={"ID":"30ee9c25-2b45-46d3-a597-7a0516c5873e","Type":"ContainerStarted","Data":"77c891cda0a722bec531433e6583cd85f69027fa1cea8ca09e0289b1d8846f2f"} Jun 07 08:15:01.876286 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:01.876256 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:15:01.982198 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:01.982081 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:15:02.452891 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:02.452856 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b94c8c555-f2cv9" event={"ID":"30ee9c25-2b45-46d3-a597-7a0516c5873e","Type":"ContainerStarted","Data":"7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8"} Jun 07 08:15:02.453125 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:02.452981 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b94c8c555-f2cv9" Jun 07 08:15:02.474177 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:02.474077 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b94c8c555-f2cv9" podStartSLOduration=2.051607937 podStartE2EDuration="4.47405974s" totalImagesPullingTime="2.422451803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:15:02.472352984 +0000 UTC m=+784.406634060" watchObservedRunningTime="2026-06-07 08:15:02.47405974 +0000 UTC m=+784.408340825" Jun 07 08:15:13.463530 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:13.463454 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b94c8c555-f2cv9" Jun 07 08:15:13.778181 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:13.778065 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b94c8c555-f2cv9"] Jun 07 08:15:13.778385 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:13.778358 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5b94c8c555-f2cv9" podUID="30ee9c25-2b45-46d3-a597-7a0516c5873e" containerName="manager" containerID="cri-o://7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8" gracePeriod=30 Jun 07 08:15:14.021921 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.021900 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b94c8c555-f2cv9" Jun 07 08:15:14.090585 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.090499 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t45c8\" (UniqueName: \"kubernetes.io/projected/30ee9c25-2b45-46d3-a597-7a0516c5873e-kube-api-access-t45c8\") pod \"30ee9c25-2b45-46d3-a597-7a0516c5873e\" (UID: \"30ee9c25-2b45-46d3-a597-7a0516c5873e\") " Jun 07 08:15:14.092680 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.092652 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30ee9c25-2b45-46d3-a597-7a0516c5873e-kube-api-access-t45c8" (OuterVolumeSpecName: "kube-api-access-t45c8") pod "30ee9c25-2b45-46d3-a597-7a0516c5873e" (UID: "30ee9c25-2b45-46d3-a597-7a0516c5873e"). InnerVolumeSpecName "kube-api-access-t45c8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 08:15:14.191753 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.191720 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t45c8\" (UniqueName: \"kubernetes.io/projected/30ee9c25-2b45-46d3-a597-7a0516c5873e-kube-api-access-t45c8\") on node \"ip-10-0-142-99.ec2.internal\" DevicePath \"\"" Jun 07 08:15:14.505077 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.505040 2559 generic.go:356] "Generic (PLEG): container finished" podID="30ee9c25-2b45-46d3-a597-7a0516c5873e" containerID="7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8" exitCode=0 Jun 07 08:15:14.505467 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.505093 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b94c8c555-f2cv9" Jun 07 08:15:14.505467 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.505130 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b94c8c555-f2cv9" event={"ID":"30ee9c25-2b45-46d3-a597-7a0516c5873e","Type":"ContainerDied","Data":"7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8"} Jun 07 08:15:14.505467 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.505221 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b94c8c555-f2cv9" event={"ID":"30ee9c25-2b45-46d3-a597-7a0516c5873e","Type":"ContainerDied","Data":"77c891cda0a722bec531433e6583cd85f69027fa1cea8ca09e0289b1d8846f2f"} Jun 07 08:15:14.505467 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.505251 2559 scope.go:117] "RemoveContainer" containerID="7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8" Jun 07 08:15:14.515364 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.515341 2559 scope.go:117] "RemoveContainer" containerID="7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8" Jun 07 08:15:14.515679 ip-10-0-142-99 kubenswrapper[2559]: E0607 08:15:14.515651 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8\": container with ID starting with 7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8 not found: ID does not exist" containerID="7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8" Jun 07 08:15:14.515760 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.515688 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8"} err="failed to get container status \"7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8\": rpc error: code = NotFound desc = could not find container \"7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8\": container with ID starting with 7c31817a1f75f59b079ffaad2a53de0a3c3e2337f8a31733c9fa3cf97c346eb8 not found: ID does not exist" Jun 07 08:15:14.527436 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.527414 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b94c8c555-f2cv9"] Jun 07 08:15:14.532789 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.532767 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b94c8c555-f2cv9"] Jun 07 08:15:14.538058 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:14.538039 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30ee9c25-2b45-46d3-a597-7a0516c5873e" path="/var/lib/kubelet/pods/30ee9c25-2b45-46d3-a597-7a0516c5873e/volumes" Jun 07 08:15:30.317951 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.317914 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:15:30.360796 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.360767 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-797df55cc4-vpmhn"] Jun 07 08:15:30.361081 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.361069 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ee9c25-2b45-46d3-a597-7a0516c5873e" containerName="manager" Jun 07 08:15:30.361150 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.361083 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ee9c25-2b45-46d3-a597-7a0516c5873e" containerName="manager" Jun 07 08:15:30.361189 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.361154 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ee9c25-2b45-46d3-a597-7a0516c5873e" containerName="manager" Jun 07 08:15:30.366030 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.366010 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-797df55cc4-vpmhn" Jun 07 08:15:30.368499 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.368476 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 07 08:15:30.368598 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.368558 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qnktx\"" Jun 07 08:15:30.384043 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.384019 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-797df55cc4-vpmhn"] Jun 07 08:15:30.426662 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.426633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66037b65-11e7-444a-aa54-722b72fa4e60-maas-api-tls\") pod \"maas-api-797df55cc4-vpmhn\" (UID: \"66037b65-11e7-444a-aa54-722b72fa4e60\") " pod="opendatahub/maas-api-797df55cc4-vpmhn" Jun 07 08:15:30.426769 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.426687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b26fd\" (UniqueName: \"kubernetes.io/projected/66037b65-11e7-444a-aa54-722b72fa4e60-kube-api-access-b26fd\") pod \"maas-api-797df55cc4-vpmhn\" (UID: \"66037b65-11e7-444a-aa54-722b72fa4e60\") " pod="opendatahub/maas-api-797df55cc4-vpmhn" Jun 07 08:15:30.527823 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.527788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b26fd\" (UniqueName: \"kubernetes.io/projected/66037b65-11e7-444a-aa54-722b72fa4e60-kube-api-access-b26fd\") pod \"maas-api-797df55cc4-vpmhn\" (UID: \"66037b65-11e7-444a-aa54-722b72fa4e60\") " pod="opendatahub/maas-api-797df55cc4-vpmhn" Jun 07 08:15:30.527982 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.527871 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66037b65-11e7-444a-aa54-722b72fa4e60-maas-api-tls\") pod \"maas-api-797df55cc4-vpmhn\" (UID: \"66037b65-11e7-444a-aa54-722b72fa4e60\") " pod="opendatahub/maas-api-797df55cc4-vpmhn" Jun 07 08:15:30.530232 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.530205 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66037b65-11e7-444a-aa54-722b72fa4e60-maas-api-tls\") pod \"maas-api-797df55cc4-vpmhn\" (UID: \"66037b65-11e7-444a-aa54-722b72fa4e60\") " pod="opendatahub/maas-api-797df55cc4-vpmhn" Jun 07 08:15:30.537120 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.537080 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b26fd\" (UniqueName: \"kubernetes.io/projected/66037b65-11e7-444a-aa54-722b72fa4e60-kube-api-access-b26fd\") pod \"maas-api-797df55cc4-vpmhn\" (UID: \"66037b65-11e7-444a-aa54-722b72fa4e60\") " pod="opendatahub/maas-api-797df55cc4-vpmhn" Jun 07 08:15:30.559773 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.559736 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:15:30.675804 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.675770 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-797df55cc4-vpmhn" Jun 07 08:15:30.694233 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.694203 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:15:30.806212 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.806188 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-797df55cc4-vpmhn"] Jun 07 08:15:30.808405 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:15:30.808377 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66037b65_11e7_444a_aa54_722b72fa4e60.slice/crio-f362439859749caa9c8db85e30c22ddb0cc465471509d5dd3477ebfeda96e73e WatchSource:0}: Error finding container f362439859749caa9c8db85e30c22ddb0cc465471509d5dd3477ebfeda96e73e: Status 404 returned error can't find the container with id f362439859749caa9c8db85e30c22ddb0cc465471509d5dd3477ebfeda96e73e Jun 07 08:15:30.839858 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:30.839829 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c5kmc"] Jun 07 08:15:31.582987 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:31.582952 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-797df55cc4-vpmhn" event={"ID":"66037b65-11e7-444a-aa54-722b72fa4e60","Type":"ContainerStarted","Data":"f362439859749caa9c8db85e30c22ddb0cc465471509d5dd3477ebfeda96e73e"} Jun 07 08:15:32.589625 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:32.589593 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-797df55cc4-vpmhn" event={"ID":"66037b65-11e7-444a-aa54-722b72fa4e60","Type":"ContainerStarted","Data":"8294e19da2aacd822c0972b212a13c4a29f75355ce241c586093bde315539d81"} Jun 07 08:15:32.589916 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:32.589710 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-797df55cc4-vpmhn" Jun 07 08:15:32.605391 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:32.605352 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-797df55cc4-vpmhn" podStartSLOduration=0.980189525 podStartE2EDuration="2.605338553s" totalImagesPullingTime="1.625149028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:15:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:15:32.605085107 +0000 UTC m=+814.539366194" watchObservedRunningTime="2026-06-07 08:15:32.605338553 +0000 UTC m=+814.539619639" Jun 07 08:15:38.599579 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:38.599546 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-797df55cc4-vpmhn" Jun 07 08:15:56.210532 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:56.210502 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:15:56.311172 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:15:56.311138 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:16:30.062991 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:16:30.062953 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:16:30.156498 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:16:30.156470 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:16:33.443372 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:16:33.443340 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:16:33.932908 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:16:33.932873 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c5kmc"] Jun 07 08:16:54.438400 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:16:54.438366 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:16:54.981194 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:16:54.981159 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c5kmc"] Jun 07 08:17:04.316496 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.316459 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7"] Jun 07 08:17:04.319762 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.319744 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.322958 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.322936 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sbvdg\"" Jun 07 08:17:04.323091 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.322971 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 07 08:17:04.323091 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.322970 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 07 08:17:04.323091 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.323049 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 07 08:17:04.330286 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.330264 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7"] Jun 07 08:17:04.367710 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.367676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab62aec7-4e6b-4945-b120-404a9517ad86-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.367858 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.367735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab62aec7-4e6b-4945-b120-404a9517ad86-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.367858 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.367768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab62aec7-4e6b-4945-b120-404a9517ad86-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.367858 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.367805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab62aec7-4e6b-4945-b120-404a9517ad86-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.367858 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.367841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab62aec7-4e6b-4945-b120-404a9517ad86-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.368008 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.367888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv4tz\" (UniqueName: \"kubernetes.io/projected/ab62aec7-4e6b-4945-b120-404a9517ad86-kube-api-access-lv4tz\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.405921 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.405886 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:17:04.468508 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.468478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab62aec7-4e6b-4945-b120-404a9517ad86-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.468508 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.468514 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab62aec7-4e6b-4945-b120-404a9517ad86-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.468690 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.468530 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab62aec7-4e6b-4945-b120-404a9517ad86-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.468690 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.468557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab62aec7-4e6b-4945-b120-404a9517ad86-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.468690 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.468588 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab62aec7-4e6b-4945-b120-404a9517ad86-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.468690 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.468613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv4tz\" (UniqueName: \"kubernetes.io/projected/ab62aec7-4e6b-4945-b120-404a9517ad86-kube-api-access-lv4tz\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.468944 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.468920 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab62aec7-4e6b-4945-b120-404a9517ad86-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.468989 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.468973 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab62aec7-4e6b-4945-b120-404a9517ad86-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.469072 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.469055 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab62aec7-4e6b-4945-b120-404a9517ad86-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.470799 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.470775 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab62aec7-4e6b-4945-b120-404a9517ad86-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.471042 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.471028 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab62aec7-4e6b-4945-b120-404a9517ad86-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.476230 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.476210 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv4tz\" (UniqueName: \"kubernetes.io/projected/ab62aec7-4e6b-4945-b120-404a9517ad86-kube-api-access-lv4tz\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7\" (UID: \"ab62aec7-4e6b-4945-b120-404a9517ad86\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.630300 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.630225 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:04.761352 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:04.761323 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7"] Jun 07 08:17:04.763915 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:17:04.763885 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab62aec7_4e6b_4945_b120_404a9517ad86.slice/crio-3c377538da528c53940ca0c2c4970814310c85585dfe10fb621e8e4fb8b1b383 WatchSource:0}: Error finding container 3c377538da528c53940ca0c2c4970814310c85585dfe10fb621e8e4fb8b1b383: Status 404 returned error can't find the container with id 3c377538da528c53940ca0c2c4970814310c85585dfe10fb621e8e4fb8b1b383 Jun 07 08:17:05.002259 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:05.002225 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" event={"ID":"ab62aec7-4e6b-4945-b120-404a9517ad86","Type":"ContainerStarted","Data":"3c377538da528c53940ca0c2c4970814310c85585dfe10fb621e8e4fb8b1b383"} Jun 07 08:17:05.385412 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:05.385332 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c5kmc"] Jun 07 08:17:09.024244 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:09.024160 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" event={"ID":"ab62aec7-4e6b-4945-b120-404a9517ad86","Type":"ContainerStarted","Data":"7dcc637962185019eb387dfa6aa834613f5c442f9e7555091134711224fdb94f"} Jun 07 08:17:11.034456 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:11.034425 2559 generic.go:356] "Generic (PLEG): container finished" podID="ab62aec7-4e6b-4945-b120-404a9517ad86" containerID="7dcc637962185019eb387dfa6aa834613f5c442f9e7555091134711224fdb94f" exitCode=0 Jun 07 08:17:11.034801 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:11.034501 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" event={"ID":"ab62aec7-4e6b-4945-b120-404a9517ad86","Type":"ContainerDied","Data":"7dcc637962185019eb387dfa6aa834613f5c442f9e7555091134711224fdb94f"} Jun 07 08:17:13.046218 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:13.046172 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" event={"ID":"ab62aec7-4e6b-4945-b120-404a9517ad86","Type":"ContainerStarted","Data":"cd44037712c656c363dbbd68f3f61d56e7a3e5f51b31374cd35ab01d61a7415b"} Jun 07 08:17:13.064764 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:13.064716 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" podStartSLOduration=2.7712365930000002 podStartE2EDuration="9.064700072s" totalImagesPullingTime="4.972537314s" totalInitContainerRuntime="1.320926165s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:17:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:17:13.063173889 +0000 UTC m=+914.997454973" watchObservedRunningTime="2026-06-07 08:17:13.064700072 +0000 UTC m=+914.998981158" Jun 07 08:17:14.631302 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:14.631266 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:14.631675 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:14.631326 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:14.644142 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:14.644114 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:15.068743 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:15.068712 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7" Jun 07 08:17:21.419694 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:21.419651 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:17:21.520962 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:21.520919 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:17:35.971022 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:35.970959 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:17:37.088377 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:37.088330 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c5kmc"] Jun 07 08:17:42.116224 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.116193 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5"] Jun 07 08:17:42.133954 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.133922 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5"] Jun 07 08:17:42.134128 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.134019 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.136537 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.136514 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 07 08:17:42.141693 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.141665 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:17:42.280199 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.280164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.280458 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.280427 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvd6s\" (UniqueName: \"kubernetes.io/projected/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-kube-api-access-tvd6s\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.280597 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.280501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.280597 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.280565 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.280726 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.280606 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.280726 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.280681 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.382052 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.381983 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.382052 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.382021 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.382052 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.382045 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.382319 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.382077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.382319 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.382133 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.382319 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.382161 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvd6s\" (UniqueName: \"kubernetes.io/projected/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-kube-api-access-tvd6s\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.382468 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.382445 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.382523 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.382499 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.382608 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.382587 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.384256 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.384228 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.384532 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.384515 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.389687 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.389670 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvd6s\" (UniqueName: \"kubernetes.io/projected/ff4072d6-aae2-4bd6-aeba-a8121478d7c5-kube-api-access-tvd6s\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5\" (UID: \"ff4072d6-aae2-4bd6-aeba-a8121478d7c5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.444462 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.444436 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:17:42.573993 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:42.573851 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5"] Jun 07 08:17:42.576155 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:17:42.576128 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4072d6_aae2_4bd6_aeba_a8121478d7c5.slice/crio-44d3a949d0032b7c4e7a05bc22f2cffea3884aeca2e376183faa2d71cfa67435 WatchSource:0}: Error finding container 44d3a949d0032b7c4e7a05bc22f2cffea3884aeca2e376183faa2d71cfa67435: Status 404 returned error can't find the container with id 44d3a949d0032b7c4e7a05bc22f2cffea3884aeca2e376183faa2d71cfa67435 Jun 07 08:17:43.185567 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:43.185529 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" event={"ID":"ff4072d6-aae2-4bd6-aeba-a8121478d7c5","Type":"ContainerStarted","Data":"0725ef930c73dc5feac8115ead4363147c0b8783f5aa60f5e797c2c31ef07290"} Jun 07 08:17:43.185963 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:43.185608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" event={"ID":"ff4072d6-aae2-4bd6-aeba-a8121478d7c5","Type":"ContainerStarted","Data":"44d3a949d0032b7c4e7a05bc22f2cffea3884aeca2e376183faa2d71cfa67435"} Jun 07 08:17:43.389724 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:43.389685 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c5kmc"] Jun 07 08:17:52.991855 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:52.991825 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6"] Jun 07 08:17:52.996355 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:52.996324 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:52.998809 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:52.998786 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 07 08:17:53.007721 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.007299 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6"] Jun 07 08:17:53.030243 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.030220 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:17:53.171233 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.171198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7bc2635-d865-47ab-acfe-b4f67252d89c-home\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.171378 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.171334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7bc2635-d865-47ab-acfe-b4f67252d89c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.171451 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.171431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7bc2635-d865-47ab-acfe-b4f67252d89c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.171492 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.171477 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7bc2635-d865-47ab-acfe-b4f67252d89c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.171535 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.171504 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8ct9\" (UniqueName: \"kubernetes.io/projected/d7bc2635-d865-47ab-acfe-b4f67252d89c-kube-api-access-d8ct9\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.171571 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.171540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7bc2635-d865-47ab-acfe-b4f67252d89c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.272334 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.272247 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7bc2635-d865-47ab-acfe-b4f67252d89c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.272334 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.272316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7bc2635-d865-47ab-acfe-b4f67252d89c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.272561 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.272358 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7bc2635-d865-47ab-acfe-b4f67252d89c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.272561 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.272383 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8ct9\" (UniqueName: \"kubernetes.io/projected/d7bc2635-d865-47ab-acfe-b4f67252d89c-kube-api-access-d8ct9\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.272561 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.272508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7bc2635-d865-47ab-acfe-b4f67252d89c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.272699 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.272567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7bc2635-d865-47ab-acfe-b4f67252d89c-home\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.272800 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.272779 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7bc2635-d865-47ab-acfe-b4f67252d89c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.272896 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.272875 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7bc2635-d865-47ab-acfe-b4f67252d89c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.272936 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.272912 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7bc2635-d865-47ab-acfe-b4f67252d89c-home\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.274611 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.274591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7bc2635-d865-47ab-acfe-b4f67252d89c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.274751 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.274736 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7bc2635-d865-47ab-acfe-b4f67252d89c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.279941 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.279919 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8ct9\" (UniqueName: \"kubernetes.io/projected/d7bc2635-d865-47ab-acfe-b4f67252d89c-kube-api-access-d8ct9\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6\" (UID: \"d7bc2635-d865-47ab-acfe-b4f67252d89c\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.309847 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.309826 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" Jun 07 08:17:53.446658 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:53.446629 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6"] Jun 07 08:17:53.448735 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:17:53.448703 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bc2635_d865_47ab_acfe_b4f67252d89c.slice/crio-23a21c775ead08c4b5ab521719ac469e4fbf694b03bf41248595047124391772 WatchSource:0}: Error finding container 23a21c775ead08c4b5ab521719ac469e4fbf694b03bf41248595047124391772: Status 404 returned error can't find the container with id 23a21c775ead08c4b5ab521719ac469e4fbf694b03bf41248595047124391772 Jun 07 08:17:54.242874 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:54.242838 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" event={"ID":"d7bc2635-d865-47ab-acfe-b4f67252d89c","Type":"ContainerStarted","Data":"459a592e90d6d134448949d531467016ad96e57b2320d9bff6c2b7c63b384552"} Jun 07 08:17:54.242874 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:54.242881 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6" event={"ID":"d7bc2635-d865-47ab-acfe-b4f67252d89c","Type":"ContainerStarted","Data":"23a21c775ead08c4b5ab521719ac469e4fbf694b03bf41248595047124391772"} Jun 07 08:17:54.983429 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:17:54.983393 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c5kmc"] Jun 07 08:18:19.711438 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:18:19.711356 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:18:43.936154 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:18:43.936112 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:18:44.035853 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:18:44.035822 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:19:16.670194 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:19:16.670160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:19:29.135760 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:19:29.135726 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:19:29.676542 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:19:29.676511 2559 generic.go:356] "Generic (PLEG): container finished" podID="ff4072d6-aae2-4bd6-aeba-a8121478d7c5" containerID="0725ef930c73dc5feac8115ead4363147c0b8783f5aa60f5e797c2c31ef07290" exitCode=0 Jun 07 08:19:29.676661 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:19:29.676567 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" event={"ID":"ff4072d6-aae2-4bd6-aeba-a8121478d7c5","Type":"ContainerDied","Data":"0725ef930c73dc5feac8115ead4363147c0b8783f5aa60f5e797c2c31ef07290"} Jun 07 08:19:30.682956 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:19:30.682926 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" event={"ID":"ff4072d6-aae2-4bd6-aeba-a8121478d7c5","Type":"ContainerStarted","Data":"bc61abf339cf7cda8fbe72300c49afee27b5b886b6639a21bade236510831b9f"} Jun 07 08:19:30.724839 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:19:30.724796 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" podStartSLOduration=1.480382977 podStartE2EDuration="1m48.724781958s" totalImagesPullingTime="227.750216ms" totalInitContainerRuntime="1m47.016648765s" isStatefulPod=false podCreationTimestamp="2026-06-07 08:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:19:30.724690173 +0000 UTC m=+1052.658971260" watchObservedRunningTime="2026-06-07 08:19:30.724781958 +0000 UTC m=+1052.659063022" Jun 07 08:19:32.444983 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:19:32.444949 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:19:32.445393 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:19:32.444999 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:19:32.457340 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:19:32.457319 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:19:32.703295 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:19:32.703222 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5" Jun 07 08:24:13.580590 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:13.580490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:24:14.610565 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:14.610525 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:24:34.325224 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:34.325187 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6_d7bc2635-d865-47ab-acfe-b4f67252d89c/storage-initializer/0.log" Jun 07 08:24:39.707059 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:39.707031 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-9bbd88d68-7jlb8_abd31cb2-4a44-475a-bc4c-0be33b8a247e/nginx/0.log" Jun 07 08:24:39.943858 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:39.943828 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-dn4tc_ae454b3e-2379-4d20-b0b9-bb8200baa3db/manager/0.log" Jun 07 08:24:40.064075 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:40.063977 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-69k2r_840663e8-d6a4-428e-bbb8-aa071812d184/manager/0.log" Jun 07 08:24:40.175471 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:40.175441 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-797df55cc4-vpmhn_66037b65-11e7-444a-aa54-722b72fa4e60/maas-api/0.log" Jun 07 08:24:40.400422 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:40.400393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-m2f54_c69bfdd4-8fed-4082-b0ed-5d1aa4884166/server/0.log" Jun 07 08:24:40.514281 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:40.514252 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-fmpfd_0507ba98-af56-445c-9bd0-10cd29e878e7/manager/0.log" Jun 07 08:24:40.635661 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:40.635627 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d459f6d9f-pwznw_014c6b41-fdf9-4485-befe-1266cf8fe21e/copy-manifests/0.log" Jun 07 08:24:40.649538 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:40.649518 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d459f6d9f-pwznw_014c6b41-fdf9-4485-befe-1266cf8fe21e/manager/0.log" Jun 07 08:24:41.001427 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:41.001394 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-9dcqc_2546de74-d194-4d34-9ed0-013748a65da3/postgres/0.log" Jun 07 08:24:42.934610 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:42.934582 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-c5kmc_9f99260d-e4bf-4889-b036-12e7f1aef968/limitador/0.log" Jun 07 08:24:43.514594 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:43.514567 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fdxkh_acd18e83-0101-4fd5-8d96-5a879486ccb9/discovery/0.log" Jun 07 08:24:43.624511 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:43.624482 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76fcdb986d-84jsq_67742d72-1c14-4554-9321-1f7cb3531560/kube-auth-proxy/0.log" Jun 07 08:24:44.641261 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:44.641229 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7_ab62aec7-4e6b-4945-b120-404a9517ad86/storage-initializer/0.log" Jun 07 08:24:44.649335 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:44.649315 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-6w4r7_ab62aec7-4e6b-4945-b120-404a9517ad86/main/0.log" Jun 07 08:24:44.870709 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:44.870680 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5_ff4072d6-aae2-4bd6-aeba-a8121478d7c5/storage-initializer/0.log" Jun 07 08:24:44.877283 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:44.877258 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-5fpc5_ff4072d6-aae2-4bd6-aeba-a8121478d7c5/main/0.log" Jun 07 08:24:44.987212 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:44.987189 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5745bb64b6-jwbh6_d7bc2635-d865-47ab-acfe-b4f67252d89c/storage-initializer/0.log" Jun 07 08:24:49.335055 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:49.335020 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:24:49.434014 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:49.433980 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" limit=1024 Jun 07 08:24:52.447052 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:52.447018 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nj4q2_7a03170d-f27f-46f7-bad8-4573b640eb20/global-pull-secret-syncer/0.log" Jun 07 08:24:52.528667 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:52.528638 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2zkpp_d994b6c2-9d2a-449b-8f17-6fba9d02c76a/konnectivity-agent/0.log" Jun 07 08:24:52.729249 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:52.729174 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-99.ec2.internal_3aa9dc2982fae84a7139add606c8bc21/haproxy/0.log" Jun 07 08:24:55.693081 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:55.693039 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-z27c7_1d6d25ba-9c87-483a-a97d-e117dca7de00/sail-operator/0.log" Jun 07 08:24:57.113488 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:57.113458 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-c5kmc_9f99260d-e4bf-4889-b036-12e7f1aef968/limitador/0.log" Jun 07 08:24:59.368913 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:59.368879 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-w6xtp_7e63f769-af4e-47ed-83ef-547f62fa8012/kube-state-metrics/0.log" Jun 07 08:24:59.390338 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:59.390310 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-w6xtp_7e63f769-af4e-47ed-83ef-547f62fa8012/kube-rbac-proxy-main/0.log" Jun 07 08:24:59.412267 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:59.412237 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-w6xtp_7e63f769-af4e-47ed-83ef-547f62fa8012/kube-rbac-proxy-self/0.log" Jun 07 08:24:59.593710 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:59.593690 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bbsrb_726d9b78-5a7d-47f7-b49e-3b147447e773/node-exporter/0.log" Jun 07 08:24:59.617967 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:59.617947 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bbsrb_726d9b78-5a7d-47f7-b49e-3b147447e773/kube-rbac-proxy/0.log" Jun 07 08:24:59.649160 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:24:59.649141 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bbsrb_726d9b78-5a7d-47f7-b49e-3b147447e773/init-textfile/0.log" Jun 07 08:25:04.346480 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.346446 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz"] Jun 07 08:25:04.349340 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.349317 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.351622 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.351597 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2tttd\"/\"kube-root-ca.crt\"" Jun 07 08:25:04.351765 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.351630 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2tttd\"/\"openshift-service-ca.crt\"" Jun 07 08:25:04.352480 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.352464 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2tttd\"/\"default-dockercfg-vc5ll\"" Jun 07 08:25:04.359304 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.359280 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz"] Jun 07 08:25:04.403579 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.403541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4999723-235d-4e6a-a367-16d3f79c1771-sys\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.403784 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.403591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4999723-235d-4e6a-a367-16d3f79c1771-lib-modules\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.403784 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.403661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4999723-235d-4e6a-a367-16d3f79c1771-podres\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.403784 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.403741 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4999723-235d-4e6a-a367-16d3f79c1771-proc\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.403784 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.403781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs6b6\" (UniqueName: \"kubernetes.io/projected/e4999723-235d-4e6a-a367-16d3f79c1771-kube-api-access-cs6b6\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.504905 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.504861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4999723-235d-4e6a-a367-16d3f79c1771-proc\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.504905 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.504912 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs6b6\" (UniqueName: \"kubernetes.io/projected/e4999723-235d-4e6a-a367-16d3f79c1771-kube-api-access-cs6b6\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.505211 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.504960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4999723-235d-4e6a-a367-16d3f79c1771-sys\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.505211 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.504987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4999723-235d-4e6a-a367-16d3f79c1771-lib-modules\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.505211 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.504990 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4999723-235d-4e6a-a367-16d3f79c1771-proc\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.505211 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.505010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4999723-235d-4e6a-a367-16d3f79c1771-podres\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.505211 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.505071 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4999723-235d-4e6a-a367-16d3f79c1771-sys\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.505211 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.505159 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4999723-235d-4e6a-a367-16d3f79c1771-lib-modules\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.505211 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.505160 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4999723-235d-4e6a-a367-16d3f79c1771-podres\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.512649 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.512625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs6b6\" (UniqueName: \"kubernetes.io/projected/e4999723-235d-4e6a-a367-16d3f79c1771-kube-api-access-cs6b6\") pod \"perf-node-gather-daemonset-zg9fz\" (UID: \"e4999723-235d-4e6a-a367-16d3f79c1771\") " pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.660638 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.660606 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:04.788770 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:04.788745 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz"] Jun 07 08:25:04.791050 ip-10-0-142-99 kubenswrapper[2559]: W0607 08:25:04.791025 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode4999723_235d_4e6a_a367_16d3f79c1771.slice/crio-1be043f24afcf7c86973f748349db32305e7d16f0e60df73a8f53512db950843 WatchSource:0}: Error finding container 1be043f24afcf7c86973f748349db32305e7d16f0e60df73a8f53512db950843: Status 404 returned error can't find the container with id 1be043f24afcf7c86973f748349db32305e7d16f0e60df73a8f53512db950843 Jun 07 08:25:05.200336 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:05.200294 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" event={"ID":"e4999723-235d-4e6a-a367-16d3f79c1771","Type":"ContainerStarted","Data":"f9171a510b318da80e7bc81d3e35c3534a70d9e9987cb594d1a6adfe2e9973e3"} Jun 07 08:25:05.200526 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:05.200355 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" event={"ID":"e4999723-235d-4e6a-a367-16d3f79c1771","Type":"ContainerStarted","Data":"1be043f24afcf7c86973f748349db32305e7d16f0e60df73a8f53512db950843"} Jun 07 08:25:05.200526 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:05.200433 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:05.223251 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:05.223202 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" podStartSLOduration=1.223188615 podStartE2EDuration="1.223188615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 08:25:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 08:25:05.219036796 +0000 UTC m=+1387.153317881" watchObservedRunningTime="2026-06-07 08:25:05.223188615 +0000 UTC m=+1387.157469700" Jun 07 08:25:05.338226 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:05.338195 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2qj4k_a900da45-2f59-4457-b120-e3c0046f6332/dns/0.log" Jun 07 08:25:05.360205 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:05.360178 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2qj4k_a900da45-2f59-4457-b120-e3c0046f6332/kube-rbac-proxy/0.log" Jun 07 08:25:05.488498 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:05.488403 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ds8pq_9645848d-2127-444b-a1d7-f9b3900d73f9/dns-node-resolver/0.log" Jun 07 08:25:06.089884 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:06.089844 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f7dbd49db-wl4kr_7b1040d1-ebbb-4935-a6ca-8c8585949274/registry/0.log" Jun 07 08:25:06.093911 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:06.093889 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f7dbd49db-wl4kr_7b1040d1-ebbb-4935-a6ca-8c8585949274/registry/1.log" Jun 07 08:25:06.113252 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:06.113230 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g6wbj_a9dc3174-a326-46e3-a685-4ccafa45b1fd/node-ca/0.log" Jun 07 08:25:07.195601 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:07.195568 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fdxkh_acd18e83-0101-4fd5-8d96-5a879486ccb9/discovery/0.log" Jun 07 08:25:07.217705 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:07.217678 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76fcdb986d-84jsq_67742d72-1c14-4554-9321-1f7cb3531560/kube-auth-proxy/0.log" Jun 07 08:25:07.949318 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:07.949288 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-296jh_88d66177-6372-411b-be13-63a8d12b2f35/serve-healthcheck-canary/0.log" Jun 07 08:25:08.602466 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:08.602439 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-992qd_9fb5c2a7-ca60-42b7-bd32-ba42aec895d0/kube-rbac-proxy/0.log" Jun 07 08:25:08.624577 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:08.624558 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-992qd_9fb5c2a7-ca60-42b7-bd32-ba42aec895d0/exporter/0.log" Jun 07 08:25:08.654042 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:08.654018 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-992qd_9fb5c2a7-ca60-42b7-bd32-ba42aec895d0/extractor/0.log" Jun 07 08:25:10.983026 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:10.982988 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-9bbd88d68-7jlb8_abd31cb2-4a44-475a-bc4c-0be33b8a247e/nginx/0.log" Jun 07 08:25:11.031062 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:11.031041 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-dn4tc_ae454b3e-2379-4d20-b0b9-bb8200baa3db/manager/0.log" Jun 07 08:25:11.064861 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:11.064840 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-69k2r_840663e8-d6a4-428e-bbb8-aa071812d184/manager/0.log" Jun 07 08:25:11.084248 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:11.084223 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-797df55cc4-vpmhn_66037b65-11e7-444a-aa54-722b72fa4e60/maas-api/0.log" Jun 07 08:25:11.129347 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:11.129330 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-m2f54_c69bfdd4-8fed-4082-b0ed-5d1aa4884166/server/0.log" Jun 07 08:25:11.179645 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:11.179627 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-fmpfd_0507ba98-af56-445c-9bd0-10cd29e878e7/manager/0.log" Jun 07 08:25:11.215216 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:11.215194 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2tttd/perf-node-gather-daemonset-zg9fz" Jun 07 08:25:11.258497 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:11.258424 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d459f6d9f-pwznw_014c6b41-fdf9-4485-befe-1266cf8fe21e/manager/0.log" Jun 07 08:25:11.280380 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:11.280357 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d459f6d9f-pwznw_014c6b41-fdf9-4485-befe-1266cf8fe21e/copy-manifests/0.log" Jun 07 08:25:11.432625 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:11.432599 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-9dcqc_2546de74-d194-4d34-9ed0-013748a65da3/postgres/0.log" Jun 07 08:25:13.016969 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:13.016945 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-fzpfb_cb90dccf-c547-47df-a3af-dc9325591472/openshift-lws-operator/0.log" Jun 07 08:25:18.376377 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:18.376344 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fdxkh_acd18e83-0101-4fd5-8d96-5a879486ccb9/discovery/0.log" Jun 07 08:25:18.388634 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:18.388604 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76fcdb986d-84jsq_67742d72-1c14-4554-9321-1f7cb3531560/kube-auth-proxy/0.log" Jun 07 08:25:19.610489 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:19.610440 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fdxkh_acd18e83-0101-4fd5-8d96-5a879486ccb9/discovery/0.log" Jun 07 08:25:19.621223 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:19.621181 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76fcdb986d-84jsq_67742d72-1c14-4554-9321-1f7cb3531560/kube-auth-proxy/0.log" Jun 07 08:25:20.432308 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:20.432280 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5k6l4_b1b11930-3f95-4b89-9074-f0314179a14c/kube-multus/0.log" Jun 07 08:25:20.777467 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:20.777435 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z8gg4_c83c22f0-6f13-4b1c-b40b-6555159ea62f/kube-multus-additional-cni-plugins/0.log" Jun 07 08:25:20.797684 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:20.797656 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z8gg4_c83c22f0-6f13-4b1c-b40b-6555159ea62f/egress-router-binary-copy/0.log" Jun 07 08:25:20.818614 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:20.818581 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z8gg4_c83c22f0-6f13-4b1c-b40b-6555159ea62f/cni-plugins/0.log" Jun 07 08:25:20.837865 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:20.837844 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z8gg4_c83c22f0-6f13-4b1c-b40b-6555159ea62f/bond-cni-plugin/0.log" Jun 07 08:25:20.859109 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:20.859088 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z8gg4_c83c22f0-6f13-4b1c-b40b-6555159ea62f/routeoverride-cni/0.log" Jun 07 08:25:20.880122 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:20.880083 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z8gg4_c83c22f0-6f13-4b1c-b40b-6555159ea62f/whereabouts-cni-bincopy/0.log" Jun 07 08:25:20.901428 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:20.901383 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z8gg4_c83c22f0-6f13-4b1c-b40b-6555159ea62f/whereabouts-cni/0.log" Jun 07 08:25:21.065375 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:21.065284 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-txfv9_a0fbf718-ddd2-498e-bfdb-04cf8364884d/network-metrics-daemon/0.log" Jun 07 08:25:21.084778 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:21.084752 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-txfv9_a0fbf718-ddd2-498e-bfdb-04cf8364884d/kube-rbac-proxy/0.log" Jun 07 08:25:21.334156 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:21.334033 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fdxkh_acd18e83-0101-4fd5-8d96-5a879486ccb9/discovery/0.log" Jun 07 08:25:21.345317 ip-10-0-142-99 kubenswrapper[2559]: I0607 08:25:21.345291 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76fcdb986d-84jsq_67742d72-1c14-4554-9321-1f7cb3531560/kube-auth-proxy/0.log"