Jun 14 22:45:20.263519 ip-10-0-130-203 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 14 22:45:20.263534 ip-10-0-130-203 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 14 22:45:20.263543 ip-10-0-130-203 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 14 22:45:20.263891 ip-10-0-130-203 systemd[1]: Failed to start Kubernetes Kubelet. Jun 14 22:45:29.820866 ip-10-0-130-203 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 14 22:45:29.820881 ip-10-0-130-203 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1faf140df202465ca568fc4176ddda05 -- Jun 14 22:47:34.743208 ip-10-0-130-203 systemd[1]: Starting Kubernetes Kubelet... Jun 14 22:47:35.186351 ip-10-0-130-203 kubenswrapper[2548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 22:47:35.186351 ip-10-0-130-203 kubenswrapper[2548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 22:47:35.186351 ip-10-0-130-203 kubenswrapper[2548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 22:47:35.186351 ip-10-0-130-203 kubenswrapper[2548]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 22:47:35.186351 ip-10-0-130-203 kubenswrapper[2548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 22:47:35.188419 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.188350 2548 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 22:47:35.192332 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192318 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:47:35.192332 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192331 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192335 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192338 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192340 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192344 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192347 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192350 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192352 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192355 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192358 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192364 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192368 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192373 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192376 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192379 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192382 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192385 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192388 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192391 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:47:35.192395 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192393 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192396 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192399 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192401 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192404 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192409 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192412 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192415 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192418 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192420 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192423 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192426 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192429 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192432 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192434 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192437 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192439 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192442 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192444 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192447 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:47:35.192841 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192449 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192452 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192454 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192456 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192459 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192462 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192464 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192467 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192469 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192472 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192474 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192477 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192479 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192482 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192485 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192488 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192491 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192493 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192496 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192498 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:47:35.193325 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192501 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192505 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192509 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192514 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192517 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192520 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192523 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192526 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192528 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192531 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192535 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192537 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192540 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192543 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192545 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192548 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192550 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192553 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192556 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:47:35.193831 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192558 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192560 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192563 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192565 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192568 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192571 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192573 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192577 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192579 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192582 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192585 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192587 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192590 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192593 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192595 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192598 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192600 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192603 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192605 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.192608 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:47:35.194519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193316 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193323 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193327 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193330 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193334 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193337 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193340 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193343 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193346 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193349 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193351 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193354 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193357 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193359 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193362 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193364 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193367 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193370 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193373 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193376 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:47:35.195026 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193379 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193382 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193385 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193387 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193390 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193393 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193395 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193398 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193401 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193403 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193406 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193408 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193411 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193414 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193417 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193419 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193423 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193426 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193428 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:47:35.195508 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193431 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193433 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193436 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193439 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193441 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193444 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193446 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193449 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193452 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193454 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193457 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193460 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193463 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193466 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193469 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193472 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193474 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193477 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193480 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:47:35.196076 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193482 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193485 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193487 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193490 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193493 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193496 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193498 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193502 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193505 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193507 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193510 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193512 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193514 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193517 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193520 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193522 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193524 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193527 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193531 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193535 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:47:35.196543 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193538 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193540 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193543 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193546 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193549 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193552 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193555 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193557 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193560 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193564 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193566 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193570 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193574 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193578 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193581 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193584 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193588 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193590 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193593 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:47:35.197045 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193596 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.193599 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196670 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196681 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196685 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196689 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196693 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196696 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196698 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196702 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196704 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196707 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196709 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196712 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196715 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196717 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196720 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196723 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196725 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196728 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:47:35.197495 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196730 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196733 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196736 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196739 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196741 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196745 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196747 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196750 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196752 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196755 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196757 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196760 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196765 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196769 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196771 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196775 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196777 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196780 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196783 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196785 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:47:35.197986 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196789 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196793 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196796 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196798 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196802 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196805 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196807 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196810 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196812 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196815 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196817 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196820 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196822 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196825 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196827 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196830 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196832 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196835 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196837 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:47:35.198486 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196840 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196842 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196845 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196847 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196850 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196853 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196856 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196859 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196862 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196865 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196867 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196871 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196875 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196878 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196880 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196883 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196886 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196889 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196892 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196895 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:47:35.198956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196897 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196900 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196902 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196905 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196908 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196910 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196915 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196918 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196921 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196924 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196926 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196941 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196944 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196946 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196949 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196952 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196954 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196957 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196960 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:47:35.199469 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196963 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196966 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.196969 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197032 2548 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197042 2548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197048 2548 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197053 2548 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197057 2548 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197061 2548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197065 2548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197069 2548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197073 2548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197076 2548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197079 2548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197082 2548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197085 2548 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197088 2548 flags.go:64] FLAG: --cgroup-root="" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197091 2548 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197094 2548 flags.go:64] FLAG: --client-ca-file="" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197097 2548 flags.go:64] FLAG: --cloud-provider="external" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197100 2548 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197105 2548 flags.go:64] FLAG: --cluster-domain="" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197108 2548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197111 2548 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 22:47:35.199918 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197114 2548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197117 2548 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197121 2548 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197124 2548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197127 2548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197130 2548 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197133 2548 flags.go:64] FLAG: --contention-profiling="false" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197136 2548 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197139 2548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197143 2548 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197146 2548 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197150 2548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197153 2548 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197156 2548 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197159 2548 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197162 2548 flags.go:64] FLAG: --enable-server="true" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197165 2548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197169 2548 flags.go:64] FLAG: --event-burst="100" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197171 2548 flags.go:64] FLAG: --event-qps="50" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197174 2548 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197177 2548 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197180 2548 flags.go:64] FLAG: --eviction-hard="" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197184 2548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197186 2548 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197189 2548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 22:47:35.200504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197192 2548 flags.go:64] FLAG: --eviction-soft="" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197195 2548 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197198 2548 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197200 2548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197204 2548 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197207 2548 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197209 2548 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197212 2548 flags.go:64] FLAG: --feature-gates="" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197216 2548 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197219 2548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197221 2548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197225 2548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197227 2548 flags.go:64] FLAG: --healthz-port="10248" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197230 2548 flags.go:64] FLAG: --help="false" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197233 2548 flags.go:64] FLAG: --hostname-override="ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197237 2548 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197240 2548 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197243 2548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197247 2548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197251 2548 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197254 2548 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197256 2548 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197259 2548 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 22:47:35.201140 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197262 2548 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197266 2548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197269 2548 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197272 2548 flags.go:64] FLAG: --kube-reserved="" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197274 2548 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197277 2548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197280 2548 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197283 2548 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197286 2548 flags.go:64] FLAG: --lock-file="" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197288 2548 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197291 2548 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197294 2548 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197299 2548 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197302 2548 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197306 2548 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197308 2548 flags.go:64] FLAG: --logging-format="text" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197311 2548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197315 2548 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197318 2548 flags.go:64] FLAG: --manifest-url="" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197321 2548 flags.go:64] FLAG: --manifest-url-header="" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197325 2548 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197328 2548 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197332 2548 flags.go:64] FLAG: --max-pods="110" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197334 2548 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197337 2548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 22:47:35.201716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197340 2548 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197344 2548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197347 2548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197350 2548 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197352 2548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197358 2548 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197361 2548 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197364 2548 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197367 2548 flags.go:64] FLAG: --pod-cidr="" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197370 2548 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197377 2548 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197379 2548 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197383 2548 flags.go:64] FLAG: --pods-per-core="0" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197386 2548 flags.go:64] FLAG: --port="10250" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197389 2548 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197392 2548 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01fa70c577992ba05" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197395 2548 flags.go:64] FLAG: --qos-reserved="" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197398 2548 flags.go:64] FLAG: --read-only-port="10255" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197400 2548 flags.go:64] FLAG: --register-node="true" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197403 2548 flags.go:64] FLAG: --register-with-taints="" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197407 2548 flags.go:64] FLAG: --registry-burst="10" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197409 2548 flags.go:64] FLAG: --registry-qps="5" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197413 2548 flags.go:64] FLAG: --reserved-cpus="" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197415 2548 flags.go:64] FLAG: --reserved-memory="" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197419 2548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 22:47:35.202334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197422 2548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197425 2548 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197428 2548 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197430 2548 flags.go:64] FLAG: --runonce="false" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197433 2548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197436 2548 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197439 2548 flags.go:64] FLAG: --seccomp-default="false" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197444 2548 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197447 2548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197450 2548 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197452 2548 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197455 2548 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197458 2548 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197461 2548 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197463 2548 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197466 2548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197469 2548 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197472 2548 flags.go:64] FLAG: --system-cgroups="" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197475 2548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197480 2548 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197483 2548 flags.go:64] FLAG: --tls-cert-file="" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197489 2548 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197493 2548 flags.go:64] FLAG: --tls-min-version="" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197496 2548 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197499 2548 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 22:47:35.202966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197502 2548 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197505 2548 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197508 2548 flags.go:64] FLAG: --v="2" Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197512 2548 flags.go:64] FLAG: --version="false" Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197516 2548 flags.go:64] FLAG: --vmodule="" Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197520 2548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.197523 2548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197630 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197634 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197637 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197639 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197642 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197646 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197649 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197653 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197656 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197658 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197661 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197664 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197666 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197668 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197671 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:47:35.203561 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197674 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197676 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197679 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197681 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197684 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197686 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197690 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197693 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197696 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197698 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197701 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197703 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197706 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197708 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197711 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197714 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197717 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197720 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197722 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197725 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:47:35.204145 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197727 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197730 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197732 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197735 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197740 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197742 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197745 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197747 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197750 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197752 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197755 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197757 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197760 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197762 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197765 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197767 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197770 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197773 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197776 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197779 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:47:35.204649 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197781 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197784 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197787 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197789 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197792 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197795 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197797 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197800 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197803 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197806 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197808 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197811 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197813 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197816 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197818 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197821 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197824 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197827 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197830 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197832 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:47:35.205157 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197835 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197837 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197839 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197842 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197844 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197847 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197850 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197852 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197855 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197859 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197864 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197867 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197869 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197872 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197875 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197879 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197882 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197886 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:47:35.205640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197889 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197892 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197895 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197898 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197901 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.197904 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.198718 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.205298 2548 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.205393 2548 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.205413 2548 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.205418 2548 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205472 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205478 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205481 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205484 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:47:35.206090 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205487 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205490 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205493 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205496 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205499 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205501 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205504 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205507 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205510 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205512 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205515 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205517 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205520 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205522 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205525 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205528 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205530 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205533 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205535 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:47:35.206465 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205538 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205540 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205543 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205546 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205548 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205551 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205557 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205561 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205563 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205566 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205569 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205571 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205574 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205577 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205579 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205582 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205584 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205587 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205589 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205592 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:47:35.207041 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205595 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205598 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205600 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205603 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205606 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205608 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205611 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205614 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205616 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205619 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205621 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205624 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205626 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205629 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205633 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205636 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205639 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205642 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205647 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205650 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:47:35.207529 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205653 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205656 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205659 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205661 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205665 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205669 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205672 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205674 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205677 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205680 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205683 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205685 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205688 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205690 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205693 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205695 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205698 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205700 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205703 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:47:35.208021 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205706 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205709 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205711 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205714 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205716 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205719 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205721 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205724 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205726 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205729 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205731 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205735 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205737 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205741 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205743 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205746 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:47:35.208480 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205748 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.205753 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205861 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205866 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205869 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205872 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205874 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205877 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205880 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205883 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205885 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205888 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205891 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205894 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:47:35.208865 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205897 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205899 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205902 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205905 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205908 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205910 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205913 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205916 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205918 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205921 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205924 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205947 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205952 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205955 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205960 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205964 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205968 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205971 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:47:35.209218 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205975 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205978 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205981 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205983 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205986 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205989 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205992 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205995 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.205998 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206000 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206003 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206005 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206008 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206010 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206013 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206015 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206018 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206020 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206022 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206025 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:47:35.209647 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206028 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206031 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206033 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206036 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206039 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206041 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206044 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206047 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206049 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206052 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206054 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206058 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206060 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206063 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206067 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206070 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206073 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206076 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206078 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206081 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:47:35.210139 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206083 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206085 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206088 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206090 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206093 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206096 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206098 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206101 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206104 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206106 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206109 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206112 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206114 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206117 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206119 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206122 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206125 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206127 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206130 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206132 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:47:35.210640 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206135 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:47:35.211131 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206137 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:47:35.211131 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206140 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:47:35.211131 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206142 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:47:35.211131 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206146 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:47:35.211131 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206148 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:47:35.211131 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206151 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:47:35.211131 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206153 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:47:35.211131 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:35.206156 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:47:35.211131 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.206160 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 22:47:35.211131 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.206260 2548 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 22:47:35.211131 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.210219 2548 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 22:47:35.212019 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.211920 2548 server.go:1019] "Starting client certificate rotation" Jun 14 22:47:35.212136 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.212055 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 22:47:35.212136 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.212094 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 22:47:35.214872 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.214857 2548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 22:47:35.219970 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.219952 2548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 22:47:35.231152 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.231138 2548 log.go:25] "Validated CRI v1 runtime API" Jun 14 22:47:35.235966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.235948 2548 log.go:25] "Validated CRI v1 image API" Jun 14 22:47:35.236776 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.236761 2548 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 22:47:35.239620 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.239603 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 22:47:35.241743 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.241726 2548 fs.go:135] Filesystem UUIDs: map[43382fd1-cb2f-43fe-b94a-909bc206e6e2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 82955bc9-8c21-4838-a21b-59022b73cdb4:/dev/nvme0n1p3] Jun 14 22:47:35.241796 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.241743 2548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 22:47:35.246723 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.246618 2548 manager.go:216] Machine: {Timestamp:2026-06-14 22:47:35.245293615 +0000 UTC m=+0.375745951 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108078 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21a73f6f6b3b243de9f2825b4bb2f1 SystemUUID:ec21a73f-6f6b-3b24-3de9-f2825b4bb2f1 BootID:1faf140d-f202-465c-a568-fc4176ddda05 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:aa:3c:92:a3:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:aa:3c:92:a3:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:20:99:c4:a8:d3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 22:47:35.246723 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.246716 2548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 22:47:35.246832 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.246805 2548 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 22:47:35.250323 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.250300 2548 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 22:47:35.250445 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.250326 2548 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-203.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 22:47:35.251148 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.251139 2548 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 22:47:35.251186 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.251151 2548 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 22:47:35.251186 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.251159 2548 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 22:47:35.252031 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.252021 2548 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 22:47:35.253878 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.253868 2548 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 22:47:35.257225 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.257214 2548 state_mem.go:36] "Initialized new in-memory state store" Jun 14 22:47:35.257334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.257325 2548 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 22:47:35.257365 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.257355 2548 kubelet.go:486] "Attempting to sync node with API server" Jun 14 22:47:35.257397 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.257367 2548 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 22:47:35.257397 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.257384 2548 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 22:47:35.257397 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.257398 2548 kubelet.go:398] "Adding apiserver pod source" Jun 14 22:47:35.257508 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.257407 2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 22:47:35.257700 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.257690 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 22:47:35.257700 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.257707 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 22:47:35.260341 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.260309 2548 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 22:47:35.262705 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.262692 2548 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 22:47:35.262765 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.262722 2548 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 22:47:35.263500 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.263489 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 22:47:35.263539 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.263504 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 22:47:35.263539 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.263510 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 22:47:35.263539 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.263515 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 22:47:35.263539 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.263523 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 22:47:35.263539 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.263528 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 22:47:35.263670 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.263573 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 22:47:35.263670 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.263579 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 22:47:35.263670 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.263585 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 22:47:35.263670 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.263590 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 22:47:35.263670 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.263598 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 22:47:35.263670 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.263606 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 22:47:35.264482 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.264471 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 22:47:35.264513 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.264482 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 22:47:35.267597 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.267583 2548 server.go:1268] "Started kubelet" Jun 14 22:47:35.267755 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.267731 2548 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 22:47:35.267857 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.267844 2548 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 22:47:35.268001 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.267790 2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 22:47:35.268417 ip-10-0-130-203 systemd[1]: Started Kubernetes Kubelet. Jun 14 22:47:35.269057 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.269032 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-203.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 22:47:35.269119 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.269100 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 22:47:35.269119 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.269110 2548 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-203.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 22:47:35.270102 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.270076 2548 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 22:47:35.270638 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.270615 2548 server.go:310] "Adding debug handlers to kubelet server" Jun 14 22:47:35.273997 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.272875 2548 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-203.ec2.internal.18b9141fffa9150b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-203.ec2.internal,UID:ip-10-0-130-203.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-203.ec2.internal,},FirstTimestamp:2026-06-14 22:47:35.267554571 +0000 UTC m=+0.398006885,LastTimestamp:2026-06-14 22:47:35.267554571 +0000 UTC m=+0.398006885,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-203.ec2.internal,}" Jun 14 22:47:35.276981 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.276962 2548 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 22:47:35.278077 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.278060 2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 22:47:35.278173 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.278077 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 22:47:35.278173 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.278153 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:35.278802 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.278782 2548 factory.go:55] Registering systemd factory Jun 14 22:47:35.278802 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.278803 2548 factory.go:223] Registration of the systemd container factory successfully Jun 14 22:47:35.279992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.279002 2548 factory.go:153] Registering CRI-O factory Jun 14 22:47:35.279992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.279020 2548 factory.go:223] Registration of the crio container factory successfully Jun 14 22:47:35.279992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.279066 2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 22:47:35.279992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.279090 2548 factory.go:103] Registering Raw factory Jun 14 22:47:35.279992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.279106 2548 manager.go:1196] Started watching for new ooms in manager Jun 14 22:47:35.279992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.279144 2548 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 22:47:35.279992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.279199 2548 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 22:47:35.279992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.279211 2548 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 22:47:35.279992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.279330 2548 reconstruct.go:97] "Volume reconstruction finished" Jun 14 22:47:35.279992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.279340 2548 reconciler.go:29] "Reconciler: start to sync state" Jun 14 22:47:35.279992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.279524 2548 manager.go:349] Starting recovery of all containers Jun 14 22:47:35.280702 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.280111 2548 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-203.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 22:47:35.280702 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.280212 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 22:47:35.283216 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.283197 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-glfnw" Jun 14 22:47:35.285815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.285775 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 22:47:35.290314 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.290296 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-glfnw" Jun 14 22:47:35.291124 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.291112 2548 manager.go:354] Recovery completed Jun 14 22:47:35.295208 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.295195 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:35.297030 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.297015 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:35.297117 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.297044 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:35.297117 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.297058 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:35.297599 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.297583 2548 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 22:47:35.297599 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.297596 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:35.297713 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.297598 2548 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 22:47:35.297713 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.297663 2548 state_mem.go:36] "Initialized new in-memory state store" Jun 14 22:47:35.298291 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.298278 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:35.298359 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.298304 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:35.298359 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.298319 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:35.298659 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.298644 2548 policy_none.go:49] "None policy: Start" Jun 14 22:47:35.298659 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.298659 2548 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 22:47:35.298749 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.298669 2548 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 22:47:35.299553 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.299544 2548 policy_none.go:47] "Start" Jun 14 22:47:35.339522 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.339506 2548 manager.go:337] "Starting Device Plugin manager" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.339548 2548 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.339557 2548 server.go:87] "Starting device plugin registration server" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.339759 2548 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.339768 2548 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.339839 2548 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.340222 2548 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.340233 2548 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.340272 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.340306 2548 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.340329 2548 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.340397 2548 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.341325 2548 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.341429 2548 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:35.346496 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.343035 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:47:35.440004 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.439956 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:35.440761 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.440742 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:35.440825 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.440772 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:35.440825 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.440782 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:35.440825 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.440805 2548 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.441331 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.440533 2548 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-203.ec2.internal"] Jun 14 22:47:35.441378 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.441369 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:35.443234 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.443216 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:35.443301 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.443247 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:35.443301 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.443262 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:35.445457 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.445445 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:35.445594 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.445565 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.445643 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.445601 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:35.447657 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.447642 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:35.447657 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.447651 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:35.447797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.447670 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:35.447797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.447675 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:35.447797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.447683 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:35.447797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.447688 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:35.449734 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.449718 2548 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.449795 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.449738 2548 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-203.ec2.internal\": node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:35.450052 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.450038 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.450126 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.450066 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:35.452076 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.452059 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:35.452159 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.452088 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:35.452159 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.452104 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:35.466441 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.466420 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-203.ec2.internal\" not found" node="ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.471428 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.471415 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-203.ec2.internal\" not found" node="ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.473199 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.473186 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:35.479951 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.479918 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/738d6f7c5f4c9f5c3c78855ee0695e2a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-203.ec2.internal\" (UID: \"738d6f7c5f4c9f5c3c78855ee0695e2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.480036 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.479966 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90ecc437d443a4ce8460ea8261c859b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal\" (UID: \"90ecc437d443a4ce8460ea8261c859b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.480036 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.479990 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90ecc437d443a4ce8460ea8261c859b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal\" (UID: \"90ecc437d443a4ce8460ea8261c859b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.574160 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.574141 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:35.580491 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.580471 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/738d6f7c5f4c9f5c3c78855ee0695e2a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-203.ec2.internal\" (UID: \"738d6f7c5f4c9f5c3c78855ee0695e2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.580543 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.580495 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90ecc437d443a4ce8460ea8261c859b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal\" (UID: \"90ecc437d443a4ce8460ea8261c859b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.580543 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.580513 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90ecc437d443a4ce8460ea8261c859b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal\" (UID: \"90ecc437d443a4ce8460ea8261c859b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.580607 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.580548 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90ecc437d443a4ce8460ea8261c859b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal\" (UID: \"90ecc437d443a4ce8460ea8261c859b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.580607 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.580569 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/738d6f7c5f4c9f5c3c78855ee0695e2a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-203.ec2.internal\" (UID: \"738d6f7c5f4c9f5c3c78855ee0695e2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.580607 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.580582 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90ecc437d443a4ce8460ea8261c859b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal\" (UID: \"90ecc437d443a4ce8460ea8261c859b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.674598 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.674574 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:35.770286 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.770238 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.775122 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.774900 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:35.776012 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:35.775996 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-203.ec2.internal" Jun 14 22:47:35.875881 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.875858 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:35.976395 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:35.976366 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:36.076969 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:36.076906 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:36.169443 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.169424 2548 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:47:36.177547 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:36.177526 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:36.211096 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.210976 2548 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 22:47:36.211600 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.211217 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 22:47:36.211600 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.211247 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 22:47:36.270967 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:36.270922 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ecc437d443a4ce8460ea8261c859b7.slice/crio-91a6ad7a2cf4dfec3767db1523273678b8af67e21f9dd63758c147903590b994 WatchSource:0}: Error finding container 91a6ad7a2cf4dfec3767db1523273678b8af67e21f9dd63758c147903590b994: Status 404 returned error can't find the container with id 91a6ad7a2cf4dfec3767db1523273678b8af67e21f9dd63758c147903590b994 Jun 14 22:47:36.272463 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:36.272437 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738d6f7c5f4c9f5c3c78855ee0695e2a.slice/crio-e4a6d28cef80f10704e2312390157f62da5ad7161c94fb61a6269e9c9920da66 WatchSource:0}: Error finding container e4a6d28cef80f10704e2312390157f62da5ad7161c94fb61a6269e9c9920da66: Status 404 returned error can't find the container with id e4a6d28cef80f10704e2312390157f62da5ad7161c94fb61a6269e9c9920da66 Jun 14 22:47:36.278460 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:36.278442 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:36.278545 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.278534 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 22:47:36.295635 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.295600 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 22:42:35 +0000 UTC" deadline="2028-01-06 10:50:18.089692733 +0000 UTC" Jun 14 22:47:36.295635 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.295634 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13692h2m41.794061733s" Jun 14 22:47:36.343728 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.343654 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" event={"ID":"90ecc437d443a4ce8460ea8261c859b7","Type":"ContainerStarted","Data":"91a6ad7a2cf4dfec3767db1523273678b8af67e21f9dd63758c147903590b994"} Jun 14 22:47:36.344629 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.344609 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-203.ec2.internal" event={"ID":"738d6f7c5f4c9f5c3c78855ee0695e2a","Type":"ContainerStarted","Data":"e4a6d28cef80f10704e2312390157f62da5ad7161c94fb61a6269e9c9920da66"} Jun 14 22:47:36.378810 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:36.378783 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:36.479252 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:36.479223 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-203.ec2.internal\" not found" Jun 14 22:47:36.549737 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.549714 2548 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:47:36.578636 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.578618 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-203.ec2.internal" Jun 14 22:47:36.586210 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.586186 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 22:47:36.587282 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.587270 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" Jun 14 22:47:36.597663 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.597627 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 22:47:36.696646 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:36.696624 2548 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:47:37.258790 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.258761 2548 apiserver.go:52] "Watching apiserver" Jun 14 22:47:37.267416 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.267391 2548 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 22:47:37.267806 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.267777 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-9rzk7","openshift-multus/multus-additional-cni-plugins-pzmjl","openshift-multus/network-metrics-daemon-7znkl","openshift-network-diagnostics/network-check-target-dltzk","kube-system/global-pull-secret-syncer-xx4zd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g","openshift-dns/node-resolver-7n9hc","openshift-image-registry/node-ca-2sqmn","openshift-network-operator/iptables-alerter-4c8h7","openshift-ovn-kubernetes/ovnkube-node-c6wmz","kube-system/konnectivity-agent-78k5w","kube-system/kube-apiserver-proxy-ip-10-0-130-203.ec2.internal","openshift-cluster-node-tuning-operator/tuned-6p85r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal"] Jun 14 22:47:37.270315 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.270296 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7n9hc" Jun 14 22:47:37.272490 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.272444 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.272874 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.272856 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 22:47:37.273015 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.272985 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5ls4d\"" Jun 14 22:47:37.273087 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.273072 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 22:47:37.274650 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.274628 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:47:37.275270 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.274873 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kp258\"" Jun 14 22:47:37.275760 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.275594 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:37.275760 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.275653 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 22:47:37.275760 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.275685 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:47:37.277691 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.277252 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:37.277691 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.277325 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:47:37.278518 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.278498 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 22:47:37.279558 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.279536 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:37.279655 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.279610 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:47:37.281831 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.281812 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.284204 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.284172 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4c8h7" Jun 14 22:47:37.284294 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.284257 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 22:47:37.284355 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.284310 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 22:47:37.284511 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.284495 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wrnvf\"" Jun 14 22:47:37.284562 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.284526 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 22:47:37.286696 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.286591 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.286696 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.286644 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7rccg\"" Jun 14 22:47:37.286696 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.286659 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:47:37.287213 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.287196 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 22:47:37.287213 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.287204 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 22:47:37.288582 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.288561 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 22:47:37.288818 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.288798 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m6snj\"" Jun 14 22:47:37.288818 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.288815 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 22:47:37.288973 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.288951 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 22:47:37.289034 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289026 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.289091 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289076 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 22:47:37.289326 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289304 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0e5475a9-0484-4dff-b9ae-20547c97da47-hosts-file\") pod \"node-resolver-7n9hc\" (UID: \"0e5475a9-0484-4dff-b9ae-20547c97da47\") " pod="openshift-dns/node-resolver-7n9hc" Jun 14 22:47:37.289405 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289341 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-sysconfig\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.289405 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289365 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-systemd\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.289405 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289387 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad86b433-87b0-417b-81b0-5ab21f0e343c-tmp\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.289552 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289415 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:37.289552 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289452 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nhnl\" (UniqueName: \"kubernetes.io/projected/0e5475a9-0484-4dff-b9ae-20547c97da47-kube-api-access-9nhnl\") pod \"node-resolver-7n9hc\" (UID: \"0e5475a9-0484-4dff-b9ae-20547c97da47\") " pod="openshift-dns/node-resolver-7n9hc" Jun 14 22:47:37.289552 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289479 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-sysctl-conf\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.289552 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289502 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-run\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.289552 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289525 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-var-lib-kubelet\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.289765 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289672 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l5x2\" (UniqueName: \"kubernetes.io/projected/ad86b433-87b0-417b-81b0-5ab21f0e343c-kube-api-access-9l5x2\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.289765 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289700 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv279\" (UniqueName: \"kubernetes.io/projected/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-kube-api-access-dv279\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:37.289765 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289718 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57671521-d126-4c0a-9ac7-ef06884dac62-dbus\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:37.289765 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289735 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:37.289966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289813 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-sys\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.289966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289846 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-lib-modules\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.289966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289871 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-tuned\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.289966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289895 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e5475a9-0484-4dff-b9ae-20547c97da47-tmp-dir\") pod \"node-resolver-7n9hc\" (UID: \"0e5475a9-0484-4dff-b9ae-20547c97da47\") " pod="openshift-dns/node-resolver-7n9hc" Jun 14 22:47:37.289966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289917 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-modprobe-d\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.289966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289957 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-kubernetes\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.290236 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.289979 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-sysctl-d\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.290236 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.290002 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-host\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.290236 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.290047 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66td8\" (UniqueName: \"kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8\") pod \"network-check-target-dltzk\" (UID: \"e5a4162d-3927-444e-9ab1-ba7a7ea2ec75\") " pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:37.290236 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.290078 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57671521-d126-4c0a-9ac7-ef06884dac62-kubelet-config\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:37.291278 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.291259 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 22:47:37.291376 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.291312 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s88pl\"" Jun 14 22:47:37.291534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.291515 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 22:47:37.291621 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.291543 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.292025 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.292005 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 22:47:37.293483 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.293465 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 22:47:37.294082 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.294063 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-78k5w" Jun 14 22:47:37.294493 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.294471 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 22:47:37.294580 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.294530 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zf6tz\"" Jun 14 22:47:37.294640 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.294480 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 22:47:37.294789 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.294665 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 22:47:37.294789 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.294676 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 22:47:37.296019 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.296002 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 22:47:37.296114 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.296099 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wvpl7\"" Jun 14 22:47:37.296320 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.296286 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 22:47:37.296391 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.296343 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 22:47:37.296517 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.296502 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2sqmn" Jun 14 22:47:37.298439 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.298395 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 22:47:37.298540 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.298524 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ftcht\"" Jun 14 22:47:37.298602 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.298550 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 22:47:37.298657 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.298614 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 22:47:37.305544 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.305527 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wp94d" Jun 14 22:47:37.312277 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.312262 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wp94d" Jun 14 22:47:37.380369 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.380344 2548 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 22:47:37.390498 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390474 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad86b433-87b0-417b-81b0-5ab21f0e343c-tmp\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.390614 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390510 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6c4ad5dd-5283-404f-b55b-8ab360f24839-ovnkube-config\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.390614 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390537 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-run\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.390614 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390561 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-var-lib-kubelet\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.390614 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390585 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-kubelet\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.390614 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390608 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-var-lib-openvswitch\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.390849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390632 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c4ad5dd-5283-404f-b55b-8ab360f24839-ovn-node-metrics-cert\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.390849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390655 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5792s\" (UniqueName: \"kubernetes.io/projected/6c4ad5dd-5283-404f-b55b-8ab360f24839-kube-api-access-5792s\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.390849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390679 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b-host\") pod \"node-ca-2sqmn\" (UID: \"34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b\") " pod="openshift-image-registry/node-ca-2sqmn" Jun 14 22:47:37.390849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390700 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-run-ovn\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.390849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390722 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-sys\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.390849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390739 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ef50632-c406-4af6-8c83-2b11545bbbc5-cni-binary-copy\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.390849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390757 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-var-lib-cni-multus\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.390849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390776 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v9gv\" (UniqueName: \"kubernetes.io/projected/3ef50632-c406-4af6-8c83-2b11545bbbc5-kube-api-access-8v9gv\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.390849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390799 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-cni-netd\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.390849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390821 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-registration-dir\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.390849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390845 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57671521-d126-4c0a-9ac7-ef06884dac62-kubelet-config\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390869 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-run-netns\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390888 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab0cff7b-a262-4bd2-9fdb-35b311aa0646-agent-certs\") pod \"konnectivity-agent-78k5w\" (UID: \"ab0cff7b-a262-4bd2-9fdb-35b311aa0646\") " pod="kube-system/konnectivity-agent-78k5w" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390902 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-socket-dir\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390923 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-device-dir\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390965 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-sysconfig\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.390987 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-systemd\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391011 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391033 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l48rq\" (UniqueName: \"kubernetes.io/projected/84e1e86c-140d-4fdf-95f4-253050093b55-kube-api-access-l48rq\") pod \"iptables-alerter-4c8h7\" (UID: \"84e1e86c-140d-4fdf-95f4-253050093b55\") " pod="openshift-network-operator/iptables-alerter-4c8h7" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391066 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391143 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-sys\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391227 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57671521-d126-4c0a-9ac7-ef06884dac62-kubelet-config\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391253 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-run\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391271 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv279\" (UniqueName: \"kubernetes.io/projected/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-kube-api-access-dv279\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391280 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-var-lib-kubelet\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391286 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-systemd\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391302 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-sysconfig\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.391329 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391299 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.391323 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.391379 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391408 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-run-openvswitch\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391438 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-node-log\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391443 2548 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.391479 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs podName:b7f24fe8-cb38-4ac7-871f-f320c9e3393b nodeName:}" failed. No retries permitted until 2026-06-14 22:47:37.891439017 +0000 UTC m=+3.021891331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs") pod "network-metrics-daemon-7znkl" (UID: "b7f24fe8-cb38-4ac7-871f-f320c9e3393b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.391523 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret podName:57671521-d126-4c0a-9ac7-ef06884dac62 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:37.891502847 +0000 UTC m=+3.021955151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret") pod "global-pull-secret-syncer-xx4zd" (UID: "57671521-d126-4c0a-9ac7-ef06884dac62") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391552 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-run-ovn-kubernetes\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391587 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-cni-bin\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391619 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-os-release\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391646 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8b4l\" (UniqueName: \"kubernetes.io/projected/34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b-kube-api-access-g8b4l\") pod \"node-ca-2sqmn\" (UID: \"34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b\") " pod="openshift-image-registry/node-ca-2sqmn" Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391682 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-lib-modules\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391720 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-cnibin\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391773 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54pcm\" (UniqueName: \"kubernetes.io/projected/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-kube-api-access-54pcm\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391797 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-lib-modules\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.392048 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391808 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-kubernetes\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391832 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-cnibin\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391849 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-kubernetes\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391852 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-var-lib-cni-bin\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391885 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-log-socket\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391911 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-multus-socket-dir-parent\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391953 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-system-cni-dir\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.391981 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-run-k8s-cni-cncf-io\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392003 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-run-netns\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392026 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-hostroot\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392048 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-run-multus-certs\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392071 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-etc-kubernetes\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392094 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-systemd-units\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392117 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6c4ad5dd-5283-404f-b55b-8ab360f24839-env-overrides\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392139 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-etc-openvswitch\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392163 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6c4ad5dd-5283-404f-b55b-8ab360f24839-ovnkube-script-lib\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392196 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84e1e86c-140d-4fdf-95f4-253050093b55-iptables-alerter-script\") pod \"iptables-alerter-4c8h7\" (UID: \"84e1e86c-140d-4fdf-95f4-253050093b55\") " pod="openshift-network-operator/iptables-alerter-4c8h7" Jun 14 22:47:37.392815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392229 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84e1e86c-140d-4fdf-95f4-253050093b55-host-slash\") pod \"iptables-alerter-4c8h7\" (UID: \"84e1e86c-140d-4fdf-95f4-253050093b55\") " pod="openshift-network-operator/iptables-alerter-4c8h7" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392266 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392299 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-modprobe-d\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392322 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-sysctl-d\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392345 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-host\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392369 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-var-lib-kubelet\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392392 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-multus-conf-dir\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392414 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392422 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-host\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392438 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0e5475a9-0484-4dff-b9ae-20547c97da47-hosts-file\") pod \"node-resolver-7n9hc\" (UID: \"0e5475a9-0484-4dff-b9ae-20547c97da47\") " pod="openshift-dns/node-resolver-7n9hc" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392415 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-modprobe-d\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392454 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-run-systemd\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392473 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392483 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-sysctl-d\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392486 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0e5475a9-0484-4dff-b9ae-20547c97da47-hosts-file\") pod \"node-resolver-7n9hc\" (UID: \"0e5475a9-0484-4dff-b9ae-20547c97da47\") " pod="openshift-dns/node-resolver-7n9hc" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392489 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-system-cni-dir\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392527 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.393655 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392553 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhnl\" (UniqueName: \"kubernetes.io/projected/0e5475a9-0484-4dff-b9ae-20547c97da47-kube-api-access-9nhnl\") pod \"node-resolver-7n9hc\" (UID: \"0e5475a9-0484-4dff-b9ae-20547c97da47\") " pod="openshift-dns/node-resolver-7n9hc" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392575 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-sysctl-conf\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392600 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l5x2\" (UniqueName: \"kubernetes.io/projected/ad86b433-87b0-417b-81b0-5ab21f0e343c-kube-api-access-9l5x2\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392623 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57671521-d126-4c0a-9ac7-ef06884dac62-dbus\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392646 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-multus-cni-dir\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392668 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-os-release\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392690 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab0cff7b-a262-4bd2-9fdb-35b311aa0646-konnectivity-ca\") pod \"konnectivity-agent-78k5w\" (UID: \"ab0cff7b-a262-4bd2-9fdb-35b311aa0646\") " pod="kube-system/konnectivity-agent-78k5w" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392691 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-sysctl-conf\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392700 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57671521-d126-4c0a-9ac7-ef06884dac62-dbus\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392723 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjb72\" (UniqueName: \"kubernetes.io/projected/2b8032a6-26b4-4932-807a-9b2201d812c4-kube-api-access-cjb72\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392823 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-tuned\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392861 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ef50632-c406-4af6-8c83-2b11545bbbc5-multus-daemon-config\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392887 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-slash\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392908 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b-serviceca\") pod \"node-ca-2sqmn\" (UID: \"34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b\") " pod="openshift-image-registry/node-ca-2sqmn" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392948 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e5475a9-0484-4dff-b9ae-20547c97da47-tmp-dir\") pod \"node-resolver-7n9hc\" (UID: \"0e5475a9-0484-4dff-b9ae-20547c97da47\") " pod="openshift-dns/node-resolver-7n9hc" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.392987 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66td8\" (UniqueName: \"kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8\") pod \"network-check-target-dltzk\" (UID: \"e5a4162d-3927-444e-9ab1-ba7a7ea2ec75\") " pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.393024 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.394477 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.393049 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-sys-fs\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.395297 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.393073 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-cni-binary-copy\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.395297 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.393196 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e5475a9-0484-4dff-b9ae-20547c97da47-tmp-dir\") pod \"node-resolver-7n9hc\" (UID: \"0e5475a9-0484-4dff-b9ae-20547c97da47\") " pod="openshift-dns/node-resolver-7n9hc" Jun 14 22:47:37.395297 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.395183 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad86b433-87b0-417b-81b0-5ab21f0e343c-tmp\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.395297 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.395217 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad86b433-87b0-417b-81b0-5ab21f0e343c-etc-tuned\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.400150 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.400133 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:47:37.400230 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.400168 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:47:37.400230 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.400181 2548 projected.go:196] Error preparing data for projected volume kube-api-access-66td8 for pod openshift-network-diagnostics/network-check-target-dltzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:37.400323 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.400238 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8 podName:e5a4162d-3927-444e-9ab1-ba7a7ea2ec75 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:37.900222645 +0000 UTC m=+3.030674968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-66td8" (UniqueName: "kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8") pod "network-check-target-dltzk" (UID: "e5a4162d-3927-444e-9ab1-ba7a7ea2ec75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:37.402190 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.402164 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv279\" (UniqueName: \"kubernetes.io/projected/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-kube-api-access-dv279\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:37.402543 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.402494 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nhnl\" (UniqueName: \"kubernetes.io/projected/0e5475a9-0484-4dff-b9ae-20547c97da47-kube-api-access-9nhnl\") pod \"node-resolver-7n9hc\" (UID: \"0e5475a9-0484-4dff-b9ae-20547c97da47\") " pod="openshift-dns/node-resolver-7n9hc" Jun 14 22:47:37.402713 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.402696 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l5x2\" (UniqueName: \"kubernetes.io/projected/ad86b433-87b0-417b-81b0-5ab21f0e343c-kube-api-access-9l5x2\") pod \"tuned-6p85r\" (UID: \"ad86b433-87b0-417b-81b0-5ab21f0e343c\") " pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.493340 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493310 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-cnibin\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.493485 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493355 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54pcm\" (UniqueName: \"kubernetes.io/projected/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-kube-api-access-54pcm\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.493485 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493382 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-cnibin\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493485 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493390 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-cnibin\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.493485 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493407 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-var-lib-cni-bin\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493485 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493433 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-log-socket\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.493485 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493459 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-multus-socket-dir-parent\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493481 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-cnibin\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493494 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-var-lib-cni-bin\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493498 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-system-cni-dir\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493539 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-run-k8s-cni-cncf-io\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493558 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-system-cni-dir\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493576 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-run-netns\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493604 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-hostroot\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493610 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-log-socket\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493635 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-multus-socket-dir-parent\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493633 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-run-multus-certs\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493674 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-run-multus-certs\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493683 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-etc-kubernetes\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493657 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-run-netns\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493689 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-run-k8s-cni-cncf-io\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493714 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-systemd-units\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493717 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-hostroot\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493738 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-etc-kubernetes\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.493797 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493773 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6c4ad5dd-5283-404f-b55b-8ab360f24839-env-overrides\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493805 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-systemd-units\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493845 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-etc-openvswitch\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493869 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6c4ad5dd-5283-404f-b55b-8ab360f24839-ovnkube-script-lib\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493923 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84e1e86c-140d-4fdf-95f4-253050093b55-iptables-alerter-script\") pod \"iptables-alerter-4c8h7\" (UID: \"84e1e86c-140d-4fdf-95f4-253050093b55\") " pod="openshift-network-operator/iptables-alerter-4c8h7" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.493989 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84e1e86c-140d-4fdf-95f4-253050093b55-host-slash\") pod \"iptables-alerter-4c8h7\" (UID: \"84e1e86c-140d-4fdf-95f4-253050093b55\") " pod="openshift-network-operator/iptables-alerter-4c8h7" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494035 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494070 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-var-lib-kubelet\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494094 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-multus-conf-dir\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494119 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494142 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-run-systemd\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494170 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494194 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-system-cni-dir\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494223 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494255 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-multus-cni-dir\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494278 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-os-release\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494302 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab0cff7b-a262-4bd2-9fdb-35b311aa0646-konnectivity-ca\") pod \"konnectivity-agent-78k5w\" (UID: \"ab0cff7b-a262-4bd2-9fdb-35b311aa0646\") " pod="kube-system/konnectivity-agent-78k5w" Jun 14 22:47:37.494666 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494339 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjb72\" (UniqueName: \"kubernetes.io/projected/2b8032a6-26b4-4932-807a-9b2201d812c4-kube-api-access-cjb72\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494365 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ef50632-c406-4af6-8c83-2b11545bbbc5-multus-daemon-config\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494394 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494408 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-etc-openvswitch\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494431 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6c4ad5dd-5283-404f-b55b-8ab360f24839-ovnkube-script-lib\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494451 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-slash\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494432 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84e1e86c-140d-4fdf-95f4-253050093b55-host-slash\") pod \"iptables-alerter-4c8h7\" (UID: \"84e1e86c-140d-4fdf-95f4-253050093b55\") " pod="openshift-network-operator/iptables-alerter-4c8h7" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494534 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-var-lib-kubelet\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494546 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494584 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b-serviceca\") pod \"node-ca-2sqmn\" (UID: \"34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b\") " pod="openshift-image-registry/node-ca-2sqmn" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494615 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494630 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-sys-fs\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494646 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-cni-binary-copy\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494668 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6c4ad5dd-5283-404f-b55b-8ab360f24839-ovnkube-config\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494696 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-run-systemd\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494717 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-slash\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494748 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.495465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494892 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6c4ad5dd-5283-404f-b55b-8ab360f24839-env-overrides\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494926 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84e1e86c-140d-4fdf-95f4-253050093b55-iptables-alerter-script\") pod \"iptables-alerter-4c8h7\" (UID: \"84e1e86c-140d-4fdf-95f4-253050093b55\") " pod="openshift-network-operator/iptables-alerter-4c8h7" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.494995 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-os-release\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495003 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ef50632-c406-4af6-8c83-2b11545bbbc5-multus-daemon-config\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495030 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-multus-conf-dir\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495071 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495076 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-multus-cni-dir\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495122 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-system-cni-dir\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495181 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b-serviceca\") pod \"node-ca-2sqmn\" (UID: \"34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b\") " pod="openshift-image-registry/node-ca-2sqmn" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495404 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495413 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-sys-fs\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495457 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab0cff7b-a262-4bd2-9fdb-35b311aa0646-konnectivity-ca\") pod \"konnectivity-agent-78k5w\" (UID: \"ab0cff7b-a262-4bd2-9fdb-35b311aa0646\") " pod="kube-system/konnectivity-agent-78k5w" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495459 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-kubelet\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495491 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-cni-binary-copy\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495513 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-var-lib-openvswitch\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495541 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c4ad5dd-5283-404f-b55b-8ab360f24839-ovn-node-metrics-cert\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495551 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6c4ad5dd-5283-404f-b55b-8ab360f24839-ovnkube-config\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.496245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495555 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-var-lib-openvswitch\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495493 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-kubelet\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495568 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5792s\" (UniqueName: \"kubernetes.io/projected/6c4ad5dd-5283-404f-b55b-8ab360f24839-kube-api-access-5792s\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495597 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b-host\") pod \"node-ca-2sqmn\" (UID: \"34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b\") " pod="openshift-image-registry/node-ca-2sqmn" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495619 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-run-ovn\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495645 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ef50632-c406-4af6-8c83-2b11545bbbc5-cni-binary-copy\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495666 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-var-lib-cni-multus\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495691 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v9gv\" (UniqueName: \"kubernetes.io/projected/3ef50632-c406-4af6-8c83-2b11545bbbc5-kube-api-access-8v9gv\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495712 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-cni-netd\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495735 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-registration-dir\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495759 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-run-netns\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495783 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab0cff7b-a262-4bd2-9fdb-35b311aa0646-agent-certs\") pod \"konnectivity-agent-78k5w\" (UID: \"ab0cff7b-a262-4bd2-9fdb-35b311aa0646\") " pod="kube-system/konnectivity-agent-78k5w" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495801 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b-host\") pod \"node-ca-2sqmn\" (UID: \"34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b\") " pod="openshift-image-registry/node-ca-2sqmn" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495805 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-socket-dir\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495830 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-device-dir\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495838 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-run-ovn\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495869 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l48rq\" (UniqueName: \"kubernetes.io/projected/84e1e86c-140d-4fdf-95f4-253050093b55-kube-api-access-l48rq\") pod \"iptables-alerter-4c8h7\" (UID: \"84e1e86c-140d-4fdf-95f4-253050093b55\") " pod="openshift-network-operator/iptables-alerter-4c8h7" Jun 14 22:47:37.497010 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495889 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-run-netns\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.495893 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496000 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-registration-dir\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496041 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ef50632-c406-4af6-8c83-2b11545bbbc5-host-var-lib-cni-multus\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496064 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-socket-dir\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496102 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b8032a6-26b4-4932-807a-9b2201d812c4-device-dir\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496107 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-run-openvswitch\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496134 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-node-log\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496159 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-run-ovn-kubernetes\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496184 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-cni-bin\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496215 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-os-release\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496240 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8b4l\" (UniqueName: \"kubernetes.io/projected/34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b-kube-api-access-g8b4l\") pod \"node-ca-2sqmn\" (UID: \"34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b\") " pod="openshift-image-registry/node-ca-2sqmn" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496354 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496361 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ef50632-c406-4af6-8c83-2b11545bbbc5-cni-binary-copy\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496356 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-run-ovn-kubernetes\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496402 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-cni-bin\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496407 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-run-openvswitch\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.497534 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496427 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-os-release\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.498191 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496437 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-node-log\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.498191 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.496456 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6c4ad5dd-5283-404f-b55b-8ab360f24839-host-cni-netd\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.498191 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.497967 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c4ad5dd-5283-404f-b55b-8ab360f24839-ovn-node-metrics-cert\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.498610 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.498556 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab0cff7b-a262-4bd2-9fdb-35b311aa0646-agent-certs\") pod \"konnectivity-agent-78k5w\" (UID: \"ab0cff7b-a262-4bd2-9fdb-35b311aa0646\") " pod="kube-system/konnectivity-agent-78k5w" Jun 14 22:47:37.500527 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.500491 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54pcm\" (UniqueName: \"kubernetes.io/projected/5b3a225f-6eb8-47d9-a76e-2e46633fbc25-kube-api-access-54pcm\") pod \"multus-additional-cni-plugins-pzmjl\" (UID: \"5b3a225f-6eb8-47d9-a76e-2e46633fbc25\") " pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.502139 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.502058 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjb72\" (UniqueName: \"kubernetes.io/projected/2b8032a6-26b4-4932-807a-9b2201d812c4-kube-api-access-cjb72\") pod \"aws-ebs-csi-driver-node-vkq5g\" (UID: \"2b8032a6-26b4-4932-807a-9b2201d812c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.503178 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.503150 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5792s\" (UniqueName: \"kubernetes.io/projected/6c4ad5dd-5283-404f-b55b-8ab360f24839-kube-api-access-5792s\") pod \"ovnkube-node-c6wmz\" (UID: \"6c4ad5dd-5283-404f-b55b-8ab360f24839\") " pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.503245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.503156 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8b4l\" (UniqueName: \"kubernetes.io/projected/34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b-kube-api-access-g8b4l\") pod \"node-ca-2sqmn\" (UID: \"34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b\") " pod="openshift-image-registry/node-ca-2sqmn" Jun 14 22:47:37.503554 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.503532 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l48rq\" (UniqueName: \"kubernetes.io/projected/84e1e86c-140d-4fdf-95f4-253050093b55-kube-api-access-l48rq\") pod \"iptables-alerter-4c8h7\" (UID: \"84e1e86c-140d-4fdf-95f4-253050093b55\") " pod="openshift-network-operator/iptables-alerter-4c8h7" Jun 14 22:47:37.503690 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.503669 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v9gv\" (UniqueName: \"kubernetes.io/projected/3ef50632-c406-4af6-8c83-2b11545bbbc5-kube-api-access-8v9gv\") pod \"multus-9rzk7\" (UID: \"3ef50632-c406-4af6-8c83-2b11545bbbc5\") " pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.583762 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.583733 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7n9hc" Jun 14 22:47:37.588566 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.588142 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:47:37.591604 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.591589 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6p85r" Jun 14 22:47:37.600089 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.600068 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" Jun 14 22:47:37.606689 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.606673 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4c8h7" Jun 14 22:47:37.614230 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.614212 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9rzk7" Jun 14 22:47:37.621874 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.621853 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pzmjl" Jun 14 22:47:37.629532 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.629513 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:47:37.636080 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.636064 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-78k5w" Jun 14 22:47:37.641547 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.641529 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2sqmn" Jun 14 22:47:37.901071 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.899876 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:37.901071 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:37.899984 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:37.901071 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.900319 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:37.901071 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.900330 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:37.901071 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.900395 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs podName:b7f24fe8-cb38-4ac7-871f-f320c9e3393b nodeName:}" failed. No retries permitted until 2026-06-14 22:47:38.900374558 +0000 UTC m=+4.030826860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs") pod "network-metrics-daemon-7znkl" (UID: "b7f24fe8-cb38-4ac7-871f-f320c9e3393b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:37.901071 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:37.900423 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret podName:57671521-d126-4c0a-9ac7-ef06884dac62 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:38.900404153 +0000 UTC m=+4.030856461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret") pod "global-pull-secret-syncer-xx4zd" (UID: "57671521-d126-4c0a-9ac7-ef06884dac62") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:38.000393 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.000359 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66td8\" (UniqueName: \"kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8\") pod \"network-check-target-dltzk\" (UID: \"e5a4162d-3927-444e-9ab1-ba7a7ea2ec75\") " pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:38.000568 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:38.000506 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:47:38.000568 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:38.000524 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:47:38.000568 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:38.000534 2548 projected.go:196] Error preparing data for projected volume kube-api-access-66td8 for pod openshift-network-diagnostics/network-check-target-dltzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:38.000738 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:38.000591 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8 podName:e5a4162d-3927-444e-9ab1-ba7a7ea2ec75 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:39.000575394 +0000 UTC m=+4.131027738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-66td8" (UniqueName: "kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8") pod "network-check-target-dltzk" (UID: "e5a4162d-3927-444e-9ab1-ba7a7ea2ec75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:38.121118 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:38.121086 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34aabfa6_3e0f_4bb3_bff8_8af5a2ec013b.slice/crio-886c1e2a277973502443009eb9f5eb3605f88b4166f833c36af2237d6f63a736 WatchSource:0}: Error finding container 886c1e2a277973502443009eb9f5eb3605f88b4166f833c36af2237d6f63a736: Status 404 returned error can't find the container with id 886c1e2a277973502443009eb9f5eb3605f88b4166f833c36af2237d6f63a736 Jun 14 22:47:38.121956 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:38.121909 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e1e86c_140d_4fdf_95f4_253050093b55.slice/crio-bc64019fcbc881bdd97bed225438099d9c4e937a928a5322e5d4c8c0755ac1dc WatchSource:0}: Error finding container bc64019fcbc881bdd97bed225438099d9c4e937a928a5322e5d4c8c0755ac1dc: Status 404 returned error can't find the container with id bc64019fcbc881bdd97bed225438099d9c4e937a928a5322e5d4c8c0755ac1dc Jun 14 22:47:38.122784 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:38.122731 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4ad5dd_5283_404f_b55b_8ab360f24839.slice/crio-a82b245c769777239aa8ce57fc9d6d358ca621f5e8cf4f826c3c9fe1b17808d8 WatchSource:0}: Error finding container a82b245c769777239aa8ce57fc9d6d358ca621f5e8cf4f826c3c9fe1b17808d8: Status 404 returned error can't find the container with id a82b245c769777239aa8ce57fc9d6d358ca621f5e8cf4f826c3c9fe1b17808d8 Jun 14 22:47:38.125616 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:38.125596 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad86b433_87b0_417b_81b0_5ab21f0e343c.slice/crio-40a5df6b86f1ff38869163ac92f5b29650d72e7e19f2eea9bceb545e699660d5 WatchSource:0}: Error finding container 40a5df6b86f1ff38869163ac92f5b29650d72e7e19f2eea9bceb545e699660d5: Status 404 returned error can't find the container with id 40a5df6b86f1ff38869163ac92f5b29650d72e7e19f2eea9bceb545e699660d5 Jun 14 22:47:38.146166 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:38.146145 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8032a6_26b4_4932_807a_9b2201d812c4.slice/crio-92ba41161b1bacfc468ea64006e6041a74fb407914f86731f27d24fbc831d7a7 WatchSource:0}: Error finding container 92ba41161b1bacfc468ea64006e6041a74fb407914f86731f27d24fbc831d7a7: Status 404 returned error can't find the container with id 92ba41161b1bacfc468ea64006e6041a74fb407914f86731f27d24fbc831d7a7 Jun 14 22:47:38.146893 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:38.146871 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0cff7b_a262_4bd2_9fdb_35b311aa0646.slice/crio-ab31b000be89ab6668e2bcdc0c5c17026571a1b8c508b3928c3874c65f294a2c WatchSource:0}: Error finding container ab31b000be89ab6668e2bcdc0c5c17026571a1b8c508b3928c3874c65f294a2c: Status 404 returned error can't find the container with id ab31b000be89ab6668e2bcdc0c5c17026571a1b8c508b3928c3874c65f294a2c Jun 14 22:47:38.147661 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:38.147598 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e5475a9_0484_4dff_b9ae_20547c97da47.slice/crio-ef5ab40c68e91e11e20c78225d344b1cd68353e407778ac3f9adc9da71002322 WatchSource:0}: Error finding container ef5ab40c68e91e11e20c78225d344b1cd68353e407778ac3f9adc9da71002322: Status 404 returned error can't find the container with id ef5ab40c68e91e11e20c78225d344b1cd68353e407778ac3f9adc9da71002322 Jun 14 22:47:38.148375 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:38.148257 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef50632_c406_4af6_8c83_2b11545bbbc5.slice/crio-b6be3a70aca88d3b7c2e405b7214063b67ac79acfdffae168e7036269a36eb5f WatchSource:0}: Error finding container b6be3a70aca88d3b7c2e405b7214063b67ac79acfdffae168e7036269a36eb5f: Status 404 returned error can't find the container with id b6be3a70aca88d3b7c2e405b7214063b67ac79acfdffae168e7036269a36eb5f Jun 14 22:47:38.149200 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:47:38.149169 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3a225f_6eb8_47d9_a76e_2e46633fbc25.slice/crio-4d7cd3e01fc51cfb934a6210999243cf39cf06e4b5e54b7cb3e5f660eec6c991 WatchSource:0}: Error finding container 4d7cd3e01fc51cfb934a6210999243cf39cf06e4b5e54b7cb3e5f660eec6c991: Status 404 returned error can't find the container with id 4d7cd3e01fc51cfb934a6210999243cf39cf06e4b5e54b7cb3e5f660eec6c991 Jun 14 22:47:38.237150 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.237127 2548 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:47:38.316110 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.316066 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 22:42:37 +0000 UTC" deadline="2027-12-04 14:05:21.252569368 +0000 UTC" Jun 14 22:47:38.316110 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.316110 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12903h17m42.936463328s" Jun 14 22:47:38.349593 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.349563 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-203.ec2.internal" event={"ID":"738d6f7c5f4c9f5c3c78855ee0695e2a","Type":"ContainerStarted","Data":"11e200470c9fc133420abe652397449afe85fb4442fc74558fbfe5b09dc61629"} Jun 14 22:47:38.350792 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.350766 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9rzk7" event={"ID":"3ef50632-c406-4af6-8c83-2b11545bbbc5","Type":"ContainerStarted","Data":"b6be3a70aca88d3b7c2e405b7214063b67ac79acfdffae168e7036269a36eb5f"} Jun 14 22:47:38.351831 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.351811 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7n9hc" event={"ID":"0e5475a9-0484-4dff-b9ae-20547c97da47","Type":"ContainerStarted","Data":"ef5ab40c68e91e11e20c78225d344b1cd68353e407778ac3f9adc9da71002322"} Jun 14 22:47:38.353319 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.353294 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" event={"ID":"2b8032a6-26b4-4932-807a-9b2201d812c4","Type":"ContainerStarted","Data":"92ba41161b1bacfc468ea64006e6041a74fb407914f86731f27d24fbc831d7a7"} Jun 14 22:47:38.354327 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.354301 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" event={"ID":"6c4ad5dd-5283-404f-b55b-8ab360f24839","Type":"ContainerStarted","Data":"a82b245c769777239aa8ce57fc9d6d358ca621f5e8cf4f826c3c9fe1b17808d8"} Jun 14 22:47:38.355515 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.355498 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2sqmn" event={"ID":"34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b","Type":"ContainerStarted","Data":"886c1e2a277973502443009eb9f5eb3605f88b4166f833c36af2237d6f63a736"} Jun 14 22:47:38.357448 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.357428 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzmjl" event={"ID":"5b3a225f-6eb8-47d9-a76e-2e46633fbc25","Type":"ContainerStarted","Data":"4d7cd3e01fc51cfb934a6210999243cf39cf06e4b5e54b7cb3e5f660eec6c991"} Jun 14 22:47:38.358569 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.358551 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-78k5w" event={"ID":"ab0cff7b-a262-4bd2-9fdb-35b311aa0646","Type":"ContainerStarted","Data":"ab31b000be89ab6668e2bcdc0c5c17026571a1b8c508b3928c3874c65f294a2c"} Jun 14 22:47:38.360420 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.360395 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6p85r" event={"ID":"ad86b433-87b0-417b-81b0-5ab21f0e343c","Type":"ContainerStarted","Data":"40a5df6b86f1ff38869163ac92f5b29650d72e7e19f2eea9bceb545e699660d5"} Jun 14 22:47:38.361506 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.361484 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4c8h7" event={"ID":"84e1e86c-140d-4fdf-95f4-253050093b55","Type":"ContainerStarted","Data":"bc64019fcbc881bdd97bed225438099d9c4e937a928a5322e5d4c8c0755ac1dc"} Jun 14 22:47:38.363422 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.363384 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-203.ec2.internal" podStartSLOduration=2.363371291 podStartE2EDuration="2.363371291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:47:38.362690493 +0000 UTC m=+3.493142838" watchObservedRunningTime="2026-06-14 22:47:38.363371291 +0000 UTC m=+3.493823614" Jun 14 22:47:38.910356 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.910262 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:38.910356 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:38.910315 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:38.910578 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:38.910455 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:38.910578 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:38.910515 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret podName:57671521-d126-4c0a-9ac7-ef06884dac62 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:40.910497188 +0000 UTC m=+6.040949495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret") pod "global-pull-secret-syncer-xx4zd" (UID: "57671521-d126-4c0a-9ac7-ef06884dac62") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:38.910747 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:38.910729 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:38.910876 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:38.910784 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs podName:b7f24fe8-cb38-4ac7-871f-f320c9e3393b nodeName:}" failed. No retries permitted until 2026-06-14 22:47:40.910769168 +0000 UTC m=+6.041221479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs") pod "network-metrics-daemon-7znkl" (UID: "b7f24fe8-cb38-4ac7-871f-f320c9e3393b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:39.011267 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:39.011081 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66td8\" (UniqueName: \"kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8\") pod \"network-check-target-dltzk\" (UID: \"e5a4162d-3927-444e-9ab1-ba7a7ea2ec75\") " pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:39.011267 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:39.011253 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:47:39.011484 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:39.011290 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:47:39.011484 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:39.011307 2548 projected.go:196] Error preparing data for projected volume kube-api-access-66td8 for pod openshift-network-diagnostics/network-check-target-dltzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:39.011484 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:39.011361 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8 podName:e5a4162d-3927-444e-9ab1-ba7a7ea2ec75 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:41.011342813 +0000 UTC m=+6.141795130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-66td8" (UniqueName: "kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8") pod "network-check-target-dltzk" (UID: "e5a4162d-3927-444e-9ab1-ba7a7ea2ec75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:39.316729 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:39.316636 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 22:42:37 +0000 UTC" deadline="2028-01-11 02:50:13.344589216 +0000 UTC" Jun 14 22:47:39.316729 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:39.316674 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13804h2m34.027919596s" Jun 14 22:47:39.341804 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:39.341121 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:39.341804 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:39.341267 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:47:39.341804 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:39.341663 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:39.341804 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:39.341754 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:47:39.342440 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:39.342269 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:39.342440 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:39.342372 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:47:39.389382 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:39.389349 2548 generic.go:356] "Generic (PLEG): container finished" podID="90ecc437d443a4ce8460ea8261c859b7" containerID="8841509dfa4a55e9bfa1478b5ab5b88006ced6acf0f24aeffdd5ffc2b8dfbaf0" exitCode=0 Jun 14 22:47:39.390013 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:39.389920 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" event={"ID":"90ecc437d443a4ce8460ea8261c859b7","Type":"ContainerDied","Data":"8841509dfa4a55e9bfa1478b5ab5b88006ced6acf0f24aeffdd5ffc2b8dfbaf0"} Jun 14 22:47:40.417434 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:40.417122 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" event={"ID":"90ecc437d443a4ce8460ea8261c859b7","Type":"ContainerStarted","Data":"721c9aac962108297ac336708106cf706cfc4e30d3e94f8dc4679f33d73de5cc"} Jun 14 22:47:40.928258 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:40.928215 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:40.928436 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:40.928266 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:40.928436 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:40.928390 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:40.928552 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:40.928450 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret podName:57671521-d126-4c0a-9ac7-ef06884dac62 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:44.92843147 +0000 UTC m=+10.058883775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret") pod "global-pull-secret-syncer-xx4zd" (UID: "57671521-d126-4c0a-9ac7-ef06884dac62") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:40.928920 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:40.928823 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:40.928920 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:40.928886 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs podName:b7f24fe8-cb38-4ac7-871f-f320c9e3393b nodeName:}" failed. No retries permitted until 2026-06-14 22:47:44.928869664 +0000 UTC m=+10.059321981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs") pod "network-metrics-daemon-7znkl" (UID: "b7f24fe8-cb38-4ac7-871f-f320c9e3393b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:41.029401 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:41.029119 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66td8\" (UniqueName: \"kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8\") pod \"network-check-target-dltzk\" (UID: \"e5a4162d-3927-444e-9ab1-ba7a7ea2ec75\") " pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:41.029401 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:41.029285 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:47:41.029401 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:41.029304 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:47:41.029401 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:41.029318 2548 projected.go:196] Error preparing data for projected volume kube-api-access-66td8 for pod openshift-network-diagnostics/network-check-target-dltzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:41.029401 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:41.029374 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8 podName:e5a4162d-3927-444e-9ab1-ba7a7ea2ec75 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:45.029355541 +0000 UTC m=+10.159807843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-66td8" (UniqueName: "kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8") pod "network-check-target-dltzk" (UID: "e5a4162d-3927-444e-9ab1-ba7a7ea2ec75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:41.341056 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:41.341028 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:41.341216 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:41.341067 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:41.341216 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:41.341028 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:41.341216 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:41.341173 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:47:41.341382 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:41.341244 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:47:41.341382 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:41.341309 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:47:43.341741 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:43.341378 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:43.341741 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:43.341498 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:43.341741 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:43.341497 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:47:43.341741 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:43.341571 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:47:43.341741 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:43.341612 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:43.341741 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:43.341688 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:47:44.960315 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:44.960201 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:44.960698 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:44.960297 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:44.960698 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:44.960395 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:44.960698 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:44.960470 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:44.960698 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:44.960471 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs podName:b7f24fe8-cb38-4ac7-871f-f320c9e3393b nodeName:}" failed. No retries permitted until 2026-06-14 22:47:52.960450666 +0000 UTC m=+18.090902981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs") pod "network-metrics-daemon-7znkl" (UID: "b7f24fe8-cb38-4ac7-871f-f320c9e3393b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:44.960698 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:44.960533 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret podName:57671521-d126-4c0a-9ac7-ef06884dac62 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:52.960514777 +0000 UTC m=+18.090967082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret") pod "global-pull-secret-syncer-xx4zd" (UID: "57671521-d126-4c0a-9ac7-ef06884dac62") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:45.060754 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:45.060716 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66td8\" (UniqueName: \"kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8\") pod \"network-check-target-dltzk\" (UID: \"e5a4162d-3927-444e-9ab1-ba7a7ea2ec75\") " pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:45.060961 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:45.060906 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:47:45.060961 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:45.060942 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:47:45.060961 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:45.060956 2548 projected.go:196] Error preparing data for projected volume kube-api-access-66td8 for pod openshift-network-diagnostics/network-check-target-dltzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:45.061130 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:45.061018 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8 podName:e5a4162d-3927-444e-9ab1-ba7a7ea2ec75 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:53.060998569 +0000 UTC m=+18.191450871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-66td8" (UniqueName: "kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8") pod "network-check-target-dltzk" (UID: "e5a4162d-3927-444e-9ab1-ba7a7ea2ec75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:45.342856 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:45.342016 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:45.342856 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:45.342123 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:47:45.342856 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:45.342505 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:45.342856 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:45.342608 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:47:45.342856 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:45.342644 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:45.342856 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:45.342758 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:47:47.340979 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:47.340948 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:47.341457 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:47.341082 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:47:47.341529 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:47.341458 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:47.341584 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:47.341556 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:47:47.341700 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:47.341684 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:47.341797 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:47.341779 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:47:49.341532 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:49.341486 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:49.342002 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:49.341494 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:49.342002 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:49.341615 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:47:49.342002 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:49.341722 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:47:49.342002 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:49.341784 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:49.342002 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:49.341861 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:47:51.341106 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:51.341014 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:51.341106 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:51.341049 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:51.341547 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:51.341144 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:47:51.341547 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:51.341198 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:47:51.341547 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:51.341230 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:51.341547 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:51.341328 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:47:53.023465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:53.023429 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:53.023465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:53.023472 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:53.024095 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:53.023572 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:53.024095 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:53.023578 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:53.024095 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:53.023628 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret podName:57671521-d126-4c0a-9ac7-ef06884dac62 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:09.023610255 +0000 UTC m=+34.154062559 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret") pod "global-pull-secret-syncer-xx4zd" (UID: "57671521-d126-4c0a-9ac7-ef06884dac62") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:53.024095 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:53.023648 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs podName:b7f24fe8-cb38-4ac7-871f-f320c9e3393b nodeName:}" failed. No retries permitted until 2026-06-14 22:48:09.023638152 +0000 UTC m=+34.154090458 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs") pod "network-metrics-daemon-7znkl" (UID: "b7f24fe8-cb38-4ac7-871f-f320c9e3393b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:53.124446 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:53.124417 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66td8\" (UniqueName: \"kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8\") pod \"network-check-target-dltzk\" (UID: \"e5a4162d-3927-444e-9ab1-ba7a7ea2ec75\") " pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:53.124596 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:53.124535 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:47:53.124596 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:53.124552 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:47:53.124596 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:53.124562 2548 projected.go:196] Error preparing data for projected volume kube-api-access-66td8 for pod openshift-network-diagnostics/network-check-target-dltzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:53.124733 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:53.124610 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8 podName:e5a4162d-3927-444e-9ab1-ba7a7ea2ec75 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:09.124594033 +0000 UTC m=+34.255046339 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-66td8" (UniqueName: "kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8") pod "network-check-target-dltzk" (UID: "e5a4162d-3927-444e-9ab1-ba7a7ea2ec75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:53.341383 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:53.341225 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:53.341383 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:53.341259 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:53.341383 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:53.341225 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:53.341629 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:53.341378 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:47:53.341629 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:53.341484 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:47:53.341629 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:53.341557 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:47:55.341718 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:55.341687 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:55.342223 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:55.341785 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:47:55.342223 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:55.341883 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:55.342223 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:55.342013 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:55.342223 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:55.342092 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:47:55.342223 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:55.342138 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:47:57.340923 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.340714 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:57.341657 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.340744 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:57.341657 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:57.341044 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:47:57.341657 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.340886 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:57.341657 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:57.341137 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:47:57.341657 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:57.341187 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:47:57.450044 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.449975 2548 generic.go:356] "Generic (PLEG): container finished" podID="5b3a225f-6eb8-47d9-a76e-2e46633fbc25" containerID="db04f4cf0c3f785bafb1f973ad2cfe0b46c6ecbc01634a3d041aa74aeeb5e252" exitCode=0 Jun 14 22:47:57.450203 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.450051 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzmjl" event={"ID":"5b3a225f-6eb8-47d9-a76e-2e46633fbc25","Type":"ContainerDied","Data":"db04f4cf0c3f785bafb1f973ad2cfe0b46c6ecbc01634a3d041aa74aeeb5e252"} Jun 14 22:47:57.451578 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.451558 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-78k5w" event={"ID":"ab0cff7b-a262-4bd2-9fdb-35b311aa0646","Type":"ContainerStarted","Data":"d18ec0ecfeaf06338fd38297a866afc5e948c2d26c3027039556fb8364ff6a59"} Jun 14 22:47:57.453206 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.453176 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6p85r" event={"ID":"ad86b433-87b0-417b-81b0-5ab21f0e343c","Type":"ContainerStarted","Data":"d3a30e5246c318d49327e7b695b8ae684640dfd2f40fb797761af20922128322"} Jun 14 22:47:57.454601 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.454579 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9rzk7" event={"ID":"3ef50632-c406-4af6-8c83-2b11545bbbc5","Type":"ContainerStarted","Data":"d8506200725897e9db7891ef509d2d7fbdb11dc9defcefdfc04e3c75d7207f21"} Jun 14 22:47:57.455888 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.455859 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7n9hc" event={"ID":"0e5475a9-0484-4dff-b9ae-20547c97da47","Type":"ContainerStarted","Data":"37147c7699ae8e524a9912675509821cf2abcfb733a88e39c63edd9508d8c3f2"} Jun 14 22:47:57.457305 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.457282 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" event={"ID":"2b8032a6-26b4-4932-807a-9b2201d812c4","Type":"ContainerStarted","Data":"ed41b96088492f4b04d473414b1091c80f19415ca685fca980b555237b749d63"} Jun 14 22:47:57.458478 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.458460 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2sqmn" event={"ID":"34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b","Type":"ContainerStarted","Data":"ac19f6483aff0a9a6e6f390858db098267c88cf85e2183c39edbb1bda41078da"} Jun 14 22:47:57.472780 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.472746 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-203.ec2.internal" podStartSLOduration=21.472735498 podStartE2EDuration="21.472735498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:47:40.433349144 +0000 UTC m=+5.563801489" watchObservedRunningTime="2026-06-14 22:47:57.472735498 +0000 UTC m=+22.603187818" Jun 14 22:47:57.487087 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.487049 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9rzk7" podStartSLOduration=3.962861776 podStartE2EDuration="22.487036955s" totalImagesPullingTime="18.524175179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:47:57.486974601 +0000 UTC m=+22.617426925" watchObservedRunningTime="2026-06-14 22:47:57.487036955 +0000 UTC m=+22.617489279" Jun 14 22:47:57.499490 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.499446 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-78k5w" podStartSLOduration=8.263962108 podStartE2EDuration="22.499434036s" totalImagesPullingTime="14.235471928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:47:57.49909434 +0000 UTC m=+22.629546675" watchObservedRunningTime="2026-06-14 22:47:57.499434036 +0000 UTC m=+22.629886362" Jun 14 22:47:57.512114 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.512069 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7n9hc" podStartSLOduration=4.021288617 podStartE2EDuration="22.51205153s" totalImagesPullingTime="18.490762913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:47:57.511352 +0000 UTC m=+22.641804326" watchObservedRunningTime="2026-06-14 22:47:57.51205153 +0000 UTC m=+22.642503925" Jun 14 22:47:57.544299 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.544247 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6p85r" podStartSLOduration=4.034344597 podStartE2EDuration="22.544237115s" totalImagesPullingTime="18.509892518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:47:57.527487859 +0000 UTC m=+22.657940184" watchObservedRunningTime="2026-06-14 22:47:57.544237115 +0000 UTC m=+22.674689439" Jun 14 22:47:57.544692 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:57.544660 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2sqmn" podStartSLOduration=4.013188956 podStartE2EDuration="22.544653192s" totalImagesPullingTime="18.531464236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:47:57.54420319 +0000 UTC m=+22.674655533" watchObservedRunningTime="2026-06-14 22:47:57.544653192 +0000 UTC m=+22.675105515" Jun 14 22:47:58.212808 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.212774 2548 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 22:47:58.354623 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.354400 2548 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T22:47:58.212806873Z","UUID":"b9f17291-8057-4f3b-a9ce-cbae854f1d3a","Handler":null,"Name":"","Endpoint":""} Jun 14 22:47:58.356025 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.355998 2548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 22:47:58.356130 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.356066 2548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 22:47:58.462746 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.462713 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" event={"ID":"2b8032a6-26b4-4932-807a-9b2201d812c4","Type":"ContainerStarted","Data":"636c905f5995dea4bf0fd71b5141f61915b166edc5b25d1bc3a80346383a4b74"} Jun 14 22:47:58.465263 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.465243 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 22:47:58.465641 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.465614 2548 generic.go:356] "Generic (PLEG): container finished" podID="6c4ad5dd-5283-404f-b55b-8ab360f24839" containerID="2ffa57d29b2bb67fc0bc4313d337ba9e325b69a4f8d8a15116368768a59cf5d1" exitCode=1 Jun 14 22:47:58.465742 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.465685 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" event={"ID":"6c4ad5dd-5283-404f-b55b-8ab360f24839","Type":"ContainerStarted","Data":"48858bc44d3d19706caf3fda02151e76b38e54455593eb3195b3a020ef62ada0"} Jun 14 22:47:58.465807 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.465766 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" event={"ID":"6c4ad5dd-5283-404f-b55b-8ab360f24839","Type":"ContainerStarted","Data":"87413084895fb653bd1e1d13ece7e5370fa9904505d6ee2c53978476695c8891"} Jun 14 22:47:58.465857 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.465818 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" event={"ID":"6c4ad5dd-5283-404f-b55b-8ab360f24839","Type":"ContainerDied","Data":"2ffa57d29b2bb67fc0bc4313d337ba9e325b69a4f8d8a15116368768a59cf5d1"} Jun 14 22:47:58.465896 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.465869 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" event={"ID":"6c4ad5dd-5283-404f-b55b-8ab360f24839","Type":"ContainerStarted","Data":"0cbbb0d48864857ee20707b6b46b8d3bba487b83aa4640ed9e769e56f368a2e1"} Jun 14 22:47:58.467385 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.467318 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4c8h7" event={"ID":"84e1e86c-140d-4fdf-95f4-253050093b55","Type":"ContainerStarted","Data":"27666638e05098964c3ea976dc470e6069024180253391bf3786684f2de125cf"} Jun 14 22:47:58.481463 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:58.481426 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4c8h7" podStartSLOduration=4.96335458 podStartE2EDuration="23.481411609s" totalImagesPullingTime="18.518057029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:47:58.481220285 +0000 UTC m=+23.611672609" watchObservedRunningTime="2026-06-14 22:47:58.481411609 +0000 UTC m=+23.611863935" Jun 14 22:47:59.341173 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:59.341143 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:47:59.341404 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:59.341182 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:47:59.341404 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:59.341142 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:47:59.341404 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:59.341265 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:47:59.341614 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:59.341398 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:47:59.341614 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:47:59.341517 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:47:59.364419 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:59.364400 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-78k5w" Jun 14 22:47:59.365077 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:59.365060 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-78k5w" Jun 14 22:47:59.472587 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:59.472554 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" event={"ID":"2b8032a6-26b4-4932-807a-9b2201d812c4","Type":"ContainerStarted","Data":"b6a289e4731d6822abe1337b6023d22a1b1fe5161d7733b0e217039062e9d772"} Jun 14 22:47:59.475786 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:59.475768 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 22:47:59.476632 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:59.476611 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" event={"ID":"6c4ad5dd-5283-404f-b55b-8ab360f24839","Type":"ContainerStarted","Data":"265a70cfb9bd09d57a35763ad8d94646bf0c98a0e939e554192d656337e4ce01"} Jun 14 22:47:59.476715 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:59.476666 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" event={"ID":"6c4ad5dd-5283-404f-b55b-8ab360f24839","Type":"ContainerStarted","Data":"f36fb79afc0918eec71d3ad882f4cc16e66541578bd0ef7094fd7581cedd8f6c"} Jun 14 22:47:59.476715 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:59.476699 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-78k5w" Jun 14 22:47:59.477142 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:47:59.477124 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-78k5w" Jun 14 22:48:00.500413 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:00.500366 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkq5g" podStartSLOduration=4.670662298 podStartE2EDuration="25.500348977s" totalImagesPullingTime="20.829686679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:00.500316283 +0000 UTC m=+25.630768608" watchObservedRunningTime="2026-06-14 22:48:00.500348977 +0000 UTC m=+25.630801302" Jun 14 22:48:01.344189 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:01.344158 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:48:01.344347 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:01.344256 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:48:01.344347 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:01.344265 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:48:01.344347 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:01.344284 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:48:01.344488 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:01.344357 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:48:01.344488 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:01.344443 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:48:02.484455 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:02.484282 2548 generic.go:356] "Generic (PLEG): container finished" podID="5b3a225f-6eb8-47d9-a76e-2e46633fbc25" containerID="248fa56dcd5752f1b154801b1a32f06b3af4e9322f55a99cbff40476eb88efbd" exitCode=0 Jun 14 22:48:02.484946 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:02.484365 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzmjl" event={"ID":"5b3a225f-6eb8-47d9-a76e-2e46633fbc25","Type":"ContainerDied","Data":"248fa56dcd5752f1b154801b1a32f06b3af4e9322f55a99cbff40476eb88efbd"} Jun 14 22:48:02.490573 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:02.488115 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 22:48:02.491110 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:02.491088 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" event={"ID":"6c4ad5dd-5283-404f-b55b-8ab360f24839","Type":"ContainerStarted","Data":"a9b9d745995fd6ee215a8f09a1ce453743b126943d91cca4078992c25e6f625b"} Jun 14 22:48:03.340760 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:03.340730 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:48:03.340760 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:03.340745 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:48:03.340760 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:03.340745 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:48:03.341086 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:03.340842 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:48:03.341086 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:03.340892 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:48:03.341086 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:03.341000 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:48:04.497583 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:04.497557 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 22:48:04.498059 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:04.497971 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" event={"ID":"6c4ad5dd-5283-404f-b55b-8ab360f24839","Type":"ContainerStarted","Data":"103b2fc09a6b657bc45642946be6f4a639f00eeb0bc315005bac77ce3a17fbc5"} Jun 14 22:48:04.498278 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:04.498251 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:48:04.498419 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:04.498333 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:48:04.498505 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:04.498490 2548 scope.go:117] "RemoveContainer" containerID="2ffa57d29b2bb67fc0bc4313d337ba9e325b69a4f8d8a15116368768a59cf5d1" Jun 14 22:48:04.500513 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:04.500486 2548 generic.go:356] "Generic (PLEG): container finished" podID="5b3a225f-6eb8-47d9-a76e-2e46633fbc25" containerID="d2f172105fee5d036bf214c2470fcfb565320f06aaf968028a179370fa042262" exitCode=0 Jun 14 22:48:04.500613 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:04.500532 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzmjl" event={"ID":"5b3a225f-6eb8-47d9-a76e-2e46633fbc25","Type":"ContainerDied","Data":"d2f172105fee5d036bf214c2470fcfb565320f06aaf968028a179370fa042262"} Jun 14 22:48:04.515426 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:04.515409 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:48:05.341821 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:05.341655 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:48:05.342115 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:05.341875 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:48:05.342115 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:05.341759 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:48:05.342115 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:05.341729 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:48:05.342115 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:05.341965 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:48:05.342115 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:05.342044 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:48:05.508527 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:05.508271 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 22:48:05.508819 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:05.508726 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" event={"ID":"6c4ad5dd-5283-404f-b55b-8ab360f24839","Type":"ContainerStarted","Data":"9f03976f9caf8e878ffb0b68e0d96a912704b33475c363aedc40506d13611d70"} Jun 14 22:48:05.508949 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:05.508916 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:48:05.523160 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:05.523142 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:48:05.533761 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:05.533724 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" podStartSLOduration=10.597280222 podStartE2EDuration="30.533712642s" totalImagesPullingTime="19.93643242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:05.531909375 +0000 UTC m=+30.662361700" watchObservedRunningTime="2026-06-14 22:48:05.533712642 +0000 UTC m=+30.664164965" Jun 14 22:48:06.167050 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:06.167020 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7znkl"] Jun 14 22:48:06.167161 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:06.167149 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:48:06.167287 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:06.167266 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:48:06.170073 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:06.170038 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xx4zd"] Jun 14 22:48:06.170204 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:06.170168 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:48:06.170274 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:06.170250 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:48:06.170770 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:06.170737 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dltzk"] Jun 14 22:48:06.170849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:06.170841 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:48:06.170970 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:06.170950 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:48:06.512979 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:06.512945 2548 generic.go:356] "Generic (PLEG): container finished" podID="5b3a225f-6eb8-47d9-a76e-2e46633fbc25" containerID="4d692295d2ad0f8ade52d902f0b84728a4864054acf84228e4cebc1b04179ee3" exitCode=0 Jun 14 22:48:06.513475 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:06.513041 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzmjl" event={"ID":"5b3a225f-6eb8-47d9-a76e-2e46633fbc25","Type":"ContainerDied","Data":"4d692295d2ad0f8ade52d902f0b84728a4864054acf84228e4cebc1b04179ee3"} Jun 14 22:48:07.341257 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:07.341208 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:48:07.341439 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:07.341320 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:48:07.341439 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:07.341384 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:48:07.341524 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:07.341472 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:48:08.341058 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:08.341020 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:48:08.341717 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:08.341156 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:48:09.054221 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.054191 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:48:09.054403 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.054233 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:48:09.054403 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.054356 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:09.054521 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.054413 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret podName:57671521-d126-4c0a-9ac7-ef06884dac62 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:41.054395529 +0000 UTC m=+66.184847834 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret") pod "global-pull-secret-syncer-xx4zd" (UID: "57671521-d126-4c0a-9ac7-ef06884dac62") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:09.054521 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.054356 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:09.054521 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.054481 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs podName:b7f24fe8-cb38-4ac7-871f-f320c9e3393b nodeName:}" failed. No retries permitted until 2026-06-14 22:48:41.054467778 +0000 UTC m=+66.184920097 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs") pod "network-metrics-daemon-7znkl" (UID: "b7f24fe8-cb38-4ac7-871f-f320c9e3393b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:09.155124 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.155083 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66td8\" (UniqueName: \"kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8\") pod \"network-check-target-dltzk\" (UID: \"e5a4162d-3927-444e-9ab1-ba7a7ea2ec75\") " pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:48:09.155306 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.155280 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:48:09.155306 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.155304 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:48:09.155496 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.155317 2548 projected.go:196] Error preparing data for projected volume kube-api-access-66td8 for pod openshift-network-diagnostics/network-check-target-dltzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:09.155496 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.155381 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8 podName:e5a4162d-3927-444e-9ab1-ba7a7ea2ec75 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:41.155361549 +0000 UTC m=+66.285813851 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-66td8" (UniqueName: "kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8") pod "network-check-target-dltzk" (UID: "e5a4162d-3927-444e-9ab1-ba7a7ea2ec75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:09.344476 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.344404 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:48:09.344814 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.344411 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:48:09.344814 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.344530 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx4zd" podUID="57671521-d126-4c0a-9ac7-ef06884dac62" Jun 14 22:48:09.344814 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.344587 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dltzk" podUID="e5a4162d-3927-444e-9ab1-ba7a7ea2ec75" Jun 14 22:48:09.670037 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.669963 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-203.ec2.internal" event="NodeReady" Jun 14 22:48:09.670169 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.670090 2548 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 22:48:09.701344 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.701312 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768"] Jun 14 22:48:09.707855 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.707833 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb"] Jun 14 22:48:09.707981 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.707956 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:09.709506 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.709485 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65"] Jun 14 22:48:09.709626 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.709600 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" Jun 14 22:48:09.710524 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.710462 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 22:48:09.710524 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.710479 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 22:48:09.710657 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.710562 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 14 22:48:09.710657 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.710587 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 22:48:09.711112 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.711094 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b5d7654f9-ftcs8"] Jun 14 22:48:09.711227 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.711212 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.711751 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.711729 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rrwpv\"" Jun 14 22:48:09.712260 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.712238 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 14 22:48:09.712722 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.712688 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.713691 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.713466 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 14 22:48:09.713691 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.713621 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 14 22:48:09.713861 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.713766 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768"] Jun 14 22:48:09.713974 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.713956 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 14 22:48:09.714195 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.714180 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 14 22:48:09.716280 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.716252 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 22:48:09.716507 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.716492 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kv5xf\"" Jun 14 22:48:09.716594 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.716572 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 22:48:09.718357 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.716689 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 22:48:09.718731 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.718712 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb"] Jun 14 22:48:09.722396 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.722381 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65"] Jun 14 22:48:09.723103 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.723079 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b5d7654f9-ftcs8"] Jun 14 22:48:09.723808 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.723767 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w92nv"] Jun 14 22:48:09.725296 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.725275 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 22:48:09.725589 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.725573 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mkg5l"] Jun 14 22:48:09.725737 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.725723 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:09.727628 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.727610 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mkg5l" Jun 14 22:48:09.728196 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.728177 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jjmh8\"" Jun 14 22:48:09.728302 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.728205 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 22:48:09.728369 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.728358 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 22:48:09.730145 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.730125 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dq9pf\"" Jun 14 22:48:09.730237 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.730215 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 22:48:09.730354 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.730333 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 22:48:09.730463 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.730432 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 22:48:09.733908 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.733887 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mkg5l"] Jun 14 22:48:09.736892 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.736810 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w92nv"] Jun 14 22:48:09.852236 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.852196 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:09.861049 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861025 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-certificates\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.861169 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861059 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-tmp-dir\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:09.861169 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861092 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scdzq\" (UniqueName: \"kubernetes.io/projected/5860c7f2-924a-4ed2-9ab9-4134a762cebb-kube-api-access-scdzq\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.861169 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861117 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-725s2\" (UniqueName: \"kubernetes.io/projected/e5f4cdff-d8f5-45f5-924a-cfa15d74b9db-kube-api-access-725s2\") pod \"klusterlet-addon-workmgr-689f7bbc7b-9g768\" (UID: \"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:09.861169 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861142 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4799\" (UniqueName: \"kubernetes.io/projected/e9c6dfb1-dcd4-471d-b06d-366261fea10c-kube-api-access-v4799\") pod \"managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb\" (UID: \"e9c6dfb1-dcd4-471d-b06d-366261fea10c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" Jun 14 22:48:09.861344 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861169 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:09.861344 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861199 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-bound-sa-token\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.861344 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861263 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.861344 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861320 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5f4cdff-d8f5-45f5-924a-cfa15d74b9db-tmp\") pod \"klusterlet-addon-workmgr-689f7bbc7b-9g768\" (UID: \"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:09.861499 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861355 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b02698-9972-44c4-8c93-19f8ae6107ec-trusted-ca\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.861499 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861381 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw45w\" (UniqueName: \"kubernetes.io/projected/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-kube-api-access-zw45w\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:09.861499 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861416 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5860c7f2-924a-4ed2-9ab9-4134a762cebb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.861499 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861439 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9c6dfb1-dcd4-471d-b06d-366261fea10c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb\" (UID: \"e9c6dfb1-dcd4-471d-b06d-366261fea10c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" Jun 14 22:48:09.861499 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861461 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74c35091-736c-4700-a92d-ef31bf121160-cert\") pod \"ingress-canary-mkg5l\" (UID: \"74c35091-736c-4700-a92d-ef31bf121160\") " pod="openshift-ingress-canary/ingress-canary-mkg5l" Jun 14 22:48:09.861691 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861538 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5860c7f2-924a-4ed2-9ab9-4134a762cebb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.861691 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861570 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e5f4cdff-d8f5-45f5-924a-cfa15d74b9db-klusterlet-config\") pod \"klusterlet-addon-workmgr-689f7bbc7b-9g768\" (UID: \"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:09.861691 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861597 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b02698-9972-44c4-8c93-19f8ae6107ec-image-registry-private-configuration\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.861691 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861622 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5860c7f2-924a-4ed2-9ab9-4134a762cebb-hub\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.861691 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861645 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v79t9\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-kube-api-access-v79t9\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.861691 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861663 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x7sx\" (UniqueName: \"kubernetes.io/projected/74c35091-736c-4700-a92d-ef31bf121160-kube-api-access-9x7sx\") pod \"ingress-canary-mkg5l\" (UID: \"74c35091-736c-4700-a92d-ef31bf121160\") " pod="openshift-ingress-canary/ingress-canary-mkg5l" Jun 14 22:48:09.861691 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861689 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5860c7f2-924a-4ed2-9ab9-4134a762cebb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.861910 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861709 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b02698-9972-44c4-8c93-19f8ae6107ec-ca-trust-extracted\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.861910 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861732 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-config-volume\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:09.861910 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861752 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b02698-9972-44c4-8c93-19f8ae6107ec-installation-pull-secrets\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.861910 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.861776 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5860c7f2-924a-4ed2-9ab9-4134a762cebb-ca\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.934403 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.934333 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:09.962387 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.962189 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-bound-sa-token\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.962505 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.962404 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.962505 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.962424 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5f4cdff-d8f5-45f5-924a-cfa15d74b9db-tmp\") pod \"klusterlet-addon-workmgr-689f7bbc7b-9g768\" (UID: \"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:09.962505 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.962445 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b02698-9972-44c4-8c93-19f8ae6107ec-trusted-ca\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.962505 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.962460 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw45w\" (UniqueName: \"kubernetes.io/projected/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-kube-api-access-zw45w\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:09.962505 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.962499 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5860c7f2-924a-4ed2-9ab9-4134a762cebb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.962740 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.962524 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9c6dfb1-dcd4-471d-b06d-366261fea10c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb\" (UID: \"e9c6dfb1-dcd4-471d-b06d-366261fea10c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" Jun 14 22:48:09.962740 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.962546 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74c35091-736c-4700-a92d-ef31bf121160-cert\") pod \"ingress-canary-mkg5l\" (UID: \"74c35091-736c-4700-a92d-ef31bf121160\") " pod="openshift-ingress-canary/ingress-canary-mkg5l" Jun 14 22:48:09.962740 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.962565 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:48:09.962740 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.962585 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5d7654f9-ftcs8: secret "image-registry-tls" not found Jun 14 22:48:09.962740 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.962651 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls podName:b0b02698-9972-44c4-8c93-19f8ae6107ec nodeName:}" failed. No retries permitted until 2026-06-14 22:48:10.462632264 +0000 UTC m=+35.593084571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls") pod "image-registry-5b5d7654f9-ftcs8" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec") : secret "image-registry-tls" not found Jun 14 22:48:09.962994 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.962862 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5f4cdff-d8f5-45f5-924a-cfa15d74b9db-tmp\") pod \"klusterlet-addon-workmgr-689f7bbc7b-9g768\" (UID: \"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:09.962994 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.962887 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5860c7f2-924a-4ed2-9ab9-4134a762cebb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.962994 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.962920 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e5f4cdff-d8f5-45f5-924a-cfa15d74b9db-klusterlet-config\") pod \"klusterlet-addon-workmgr-689f7bbc7b-9g768\" (UID: \"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:09.962994 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.962971 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b02698-9972-44c4-8c93-19f8ae6107ec-image-registry-private-configuration\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.963195 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963000 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5860c7f2-924a-4ed2-9ab9-4134a762cebb-hub\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.963195 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963026 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v79t9\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-kube-api-access-v79t9\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.963195 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963053 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x7sx\" (UniqueName: \"kubernetes.io/projected/74c35091-736c-4700-a92d-ef31bf121160-kube-api-access-9x7sx\") pod \"ingress-canary-mkg5l\" (UID: \"74c35091-736c-4700-a92d-ef31bf121160\") " pod="openshift-ingress-canary/ingress-canary-mkg5l" Jun 14 22:48:09.963195 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963095 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5860c7f2-924a-4ed2-9ab9-4134a762cebb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.963195 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963121 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b02698-9972-44c4-8c93-19f8ae6107ec-ca-trust-extracted\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.963195 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963148 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-config-volume\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:09.963195 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963183 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b02698-9972-44c4-8c93-19f8ae6107ec-installation-pull-secrets\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.963521 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963215 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5860c7f2-924a-4ed2-9ab9-4134a762cebb-ca\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.963521 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963256 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-certificates\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.963521 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963287 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-tmp-dir\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:09.963521 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963333 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scdzq\" (UniqueName: \"kubernetes.io/projected/5860c7f2-924a-4ed2-9ab9-4134a762cebb-kube-api-access-scdzq\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.963521 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963358 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-725s2\" (UniqueName: \"kubernetes.io/projected/e5f4cdff-d8f5-45f5-924a-cfa15d74b9db-kube-api-access-725s2\") pod \"klusterlet-addon-workmgr-689f7bbc7b-9g768\" (UID: \"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:09.963521 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963382 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4799\" (UniqueName: \"kubernetes.io/projected/e9c6dfb1-dcd4-471d-b06d-366261fea10c-kube-api-access-v4799\") pod \"managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb\" (UID: \"e9c6dfb1-dcd4-471d-b06d-366261fea10c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" Jun 14 22:48:09.963521 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963406 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:09.963521 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.963482 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b02698-9972-44c4-8c93-19f8ae6107ec-trusted-ca\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.963521 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.963516 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:09.963866 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:09.963576 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls podName:dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:10.46355915 +0000 UTC m=+35.594011451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls") pod "dns-default-w92nv" (UID: "dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f") : secret "dns-default-metrics-tls" not found Jun 14 22:48:09.966800 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.964655 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5860c7f2-924a-4ed2-9ab9-4134a762cebb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.966800 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.964972 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b02698-9972-44c4-8c93-19f8ae6107ec-ca-trust-extracted\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.966800 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.965457 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-config-volume\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:09.966800 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.966043 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-tmp-dir\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:09.967086 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.967031 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-certificates\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.967426 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.967327 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74c35091-736c-4700-a92d-ef31bf121160-cert\") pod \"ingress-canary-mkg5l\" (UID: \"74c35091-736c-4700-a92d-ef31bf121160\") " pod="openshift-ingress-canary/ingress-canary-mkg5l" Jun 14 22:48:09.967707 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.967655 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e5f4cdff-d8f5-45f5-924a-cfa15d74b9db-klusterlet-config\") pod \"klusterlet-addon-workmgr-689f7bbc7b-9g768\" (UID: \"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:09.967707 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.967688 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5860c7f2-924a-4ed2-9ab9-4134a762cebb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.967894 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.967869 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5860c7f2-924a-4ed2-9ab9-4134a762cebb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.968029 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.967896 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5860c7f2-924a-4ed2-9ab9-4134a762cebb-hub\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.968804 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.968764 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9c6dfb1-dcd4-471d-b06d-366261fea10c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb\" (UID: \"e9c6dfb1-dcd4-471d-b06d-366261fea10c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" Jun 14 22:48:09.969256 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.969214 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b02698-9972-44c4-8c93-19f8ae6107ec-image-registry-private-configuration\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.970379 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.970346 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5860c7f2-924a-4ed2-9ab9-4134a762cebb-ca\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:09.970488 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.970469 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b02698-9972-44c4-8c93-19f8ae6107ec-installation-pull-secrets\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.971721 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.971682 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-bound-sa-token\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.971805 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.971785 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v79t9\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-kube-api-access-v79t9\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:09.972419 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.972395 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw45w\" (UniqueName: \"kubernetes.io/projected/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-kube-api-access-zw45w\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:09.973784 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.973740 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-725s2\" (UniqueName: \"kubernetes.io/projected/e5f4cdff-d8f5-45f5-924a-cfa15d74b9db-kube-api-access-725s2\") pod \"klusterlet-addon-workmgr-689f7bbc7b-9g768\" (UID: \"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:09.974242 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.974219 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x7sx\" (UniqueName: \"kubernetes.io/projected/74c35091-736c-4700-a92d-ef31bf121160-kube-api-access-9x7sx\") pod \"ingress-canary-mkg5l\" (UID: \"74c35091-736c-4700-a92d-ef31bf121160\") " pod="openshift-ingress-canary/ingress-canary-mkg5l" Jun 14 22:48:09.974344 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.974219 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4799\" (UniqueName: \"kubernetes.io/projected/e9c6dfb1-dcd4-471d-b06d-366261fea10c-kube-api-access-v4799\") pod \"managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb\" (UID: \"e9c6dfb1-dcd4-471d-b06d-366261fea10c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" Jun 14 22:48:09.974748 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:09.974724 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scdzq\" (UniqueName: \"kubernetes.io/projected/5860c7f2-924a-4ed2-9ab9-4134a762cebb-kube-api-access-scdzq\") pod \"cluster-proxy-proxy-agent-688bd985cf-fpp65\" (UID: \"5860c7f2-924a-4ed2-9ab9-4134a762cebb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:10.024459 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.024435 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:10.040101 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.040080 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" Jun 14 22:48:10.047659 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.047639 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:48:10.077459 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.077418 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mkg5l" Jun 14 22:48:10.341683 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.341588 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:48:10.344724 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.344702 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k6g9m\"" Jun 14 22:48:10.344724 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.344720 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 22:48:10.468731 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.468206 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:10.468731 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.468261 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:10.468731 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:10.468517 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:10.468731 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:10.468606 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:48:10.468731 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:10.468621 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5d7654f9-ftcs8: secret "image-registry-tls" not found Jun 14 22:48:10.468731 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:10.468609 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls podName:dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:11.468587068 +0000 UTC m=+36.599039382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls") pod "dns-default-w92nv" (UID: "dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f") : secret "dns-default-metrics-tls" not found Jun 14 22:48:10.468731 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:10.468664 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls podName:b0b02698-9972-44c4-8c93-19f8ae6107ec nodeName:}" failed. No retries permitted until 2026-06-14 22:48:11.468653524 +0000 UTC m=+36.599105839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls") pod "image-registry-5b5d7654f9-ftcs8" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec") : secret "image-registry-tls" not found Jun 14 22:48:10.498749 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.498456 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768"] Jun 14 22:48:10.501222 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:48:10.501199 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f4cdff_d8f5_45f5_924a_cfa15d74b9db.slice/crio-88a55b6e66ba744533139bd643e78bf422fc85ce0ca7f21425fb4145fce0063a WatchSource:0}: Error finding container 88a55b6e66ba744533139bd643e78bf422fc85ce0ca7f21425fb4145fce0063a: Status 404 returned error can't find the container with id 88a55b6e66ba744533139bd643e78bf422fc85ce0ca7f21425fb4145fce0063a Jun 14 22:48:10.510754 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.510732 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65"] Jun 14 22:48:10.513476 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:48:10.513450 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5860c7f2_924a_4ed2_9ab9_4134a762cebb.slice/crio-186358e581861e7623902287b49916dc254c990b6b605237fa29f9a94f4298c6 WatchSource:0}: Error finding container 186358e581861e7623902287b49916dc254c990b6b605237fa29f9a94f4298c6: Status 404 returned error can't find the container with id 186358e581861e7623902287b49916dc254c990b6b605237fa29f9a94f4298c6 Jun 14 22:48:10.515529 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.515369 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mkg5l"] Jun 14 22:48:10.518753 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:48:10.518615 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c35091_736c_4700_a92d_ef31bf121160.slice/crio-b67116a5f86d1fd553953392b4d9d0ae282c80f43603a980f4f72c9c9575eac9 WatchSource:0}: Error finding container b67116a5f86d1fd553953392b4d9d0ae282c80f43603a980f4f72c9c9575eac9: Status 404 returned error can't find the container with id b67116a5f86d1fd553953392b4d9d0ae282c80f43603a980f4f72c9c9575eac9 Jun 14 22:48:10.518753 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.518656 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb"] Jun 14 22:48:10.521382 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:48:10.521156 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9c6dfb1_dcd4_471d_b06d_366261fea10c.slice/crio-987846e19fcb499c316c74656cb8cd951102cf0604f47d02db7f4db83bdadcfa WatchSource:0}: Error finding container 987846e19fcb499c316c74656cb8cd951102cf0604f47d02db7f4db83bdadcfa: Status 404 returned error can't find the container with id 987846e19fcb499c316c74656cb8cd951102cf0604f47d02db7f4db83bdadcfa Jun 14 22:48:10.524450 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.524426 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mkg5l" event={"ID":"74c35091-736c-4700-a92d-ef31bf121160","Type":"ContainerStarted","Data":"b67116a5f86d1fd553953392b4d9d0ae282c80f43603a980f4f72c9c9575eac9"} Jun 14 22:48:10.525538 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.525513 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" event={"ID":"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db","Type":"ContainerStarted","Data":"88a55b6e66ba744533139bd643e78bf422fc85ce0ca7f21425fb4145fce0063a"} Jun 14 22:48:10.526737 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.526712 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" event={"ID":"5860c7f2-924a-4ed2-9ab9-4134a762cebb","Type":"ContainerStarted","Data":"186358e581861e7623902287b49916dc254c990b6b605237fa29f9a94f4298c6"} Jun 14 22:48:10.530126 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:10.530106 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzmjl" event={"ID":"5b3a225f-6eb8-47d9-a76e-2e46633fbc25","Type":"ContainerStarted","Data":"ae03bcb259c9b9112dd66eccfc2d2ef8002b20c2e180c19e72a99b20a938d38b"} Jun 14 22:48:11.301587 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.301549 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:11.341068 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.341039 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:48:11.341441 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.341426 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:48:11.353954 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.351966 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 22:48:11.359059 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.354792 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 22:48:11.359059 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.355317 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cnbs\"" Jun 14 22:48:11.367416 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.366532 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 22:48:11.397607 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.397579 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:11.452326 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.452243 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:11.477816 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.477755 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:11.477924 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.477832 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:11.478043 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:11.478026 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:48:11.478095 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:11.478042 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5d7654f9-ftcs8: secret "image-registry-tls" not found Jun 14 22:48:11.478160 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:11.478097 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls podName:b0b02698-9972-44c4-8c93-19f8ae6107ec nodeName:}" failed. No retries permitted until 2026-06-14 22:48:13.478078841 +0000 UTC m=+38.608531147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls") pod "image-registry-5b5d7654f9-ftcs8" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec") : secret "image-registry-tls" not found Jun 14 22:48:11.478611 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:11.478592 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:11.478691 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:11.478649 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls podName:dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:13.478632295 +0000 UTC m=+38.609084596 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls") pod "dns-default-w92nv" (UID: "dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f") : secret "dns-default-metrics-tls" not found Jun 14 22:48:11.537038 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.537008 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" event={"ID":"e9c6dfb1-dcd4-471d-b06d-366261fea10c","Type":"ContainerStarted","Data":"987846e19fcb499c316c74656cb8cd951102cf0604f47d02db7f4db83bdadcfa"} Jun 14 22:48:11.542538 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.542509 2548 generic.go:356] "Generic (PLEG): container finished" podID="5b3a225f-6eb8-47d9-a76e-2e46633fbc25" containerID="ae03bcb259c9b9112dd66eccfc2d2ef8002b20c2e180c19e72a99b20a938d38b" exitCode=0 Jun 14 22:48:11.542641 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:11.542560 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzmjl" event={"ID":"5b3a225f-6eb8-47d9-a76e-2e46633fbc25","Type":"ContainerDied","Data":"ae03bcb259c9b9112dd66eccfc2d2ef8002b20c2e180c19e72a99b20a938d38b"} Jun 14 22:48:12.333245 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:12.333004 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:12.435654 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:12.435597 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:12.554528 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:12.554388 2548 generic.go:356] "Generic (PLEG): container finished" podID="5b3a225f-6eb8-47d9-a76e-2e46633fbc25" containerID="43efdb9dcfb02da071858a71f50ae2c4ac2bbecc9df4910ac99e50beb5a56988" exitCode=0 Jun 14 22:48:12.554528 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:12.554465 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzmjl" event={"ID":"5b3a225f-6eb8-47d9-a76e-2e46633fbc25","Type":"ContainerDied","Data":"43efdb9dcfb02da071858a71f50ae2c4ac2bbecc9df4910ac99e50beb5a56988"} Jun 14 22:48:13.494178 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:13.494099 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:13.494178 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:13.494161 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:13.494757 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:13.494297 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:48:13.494757 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:13.494309 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5d7654f9-ftcs8: secret "image-registry-tls" not found Jun 14 22:48:13.494757 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:13.494364 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls podName:b0b02698-9972-44c4-8c93-19f8ae6107ec nodeName:}" failed. No retries permitted until 2026-06-14 22:48:17.4943468 +0000 UTC m=+42.624799123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls") pod "image-registry-5b5d7654f9-ftcs8" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec") : secret "image-registry-tls" not found Jun 14 22:48:13.494757 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:13.494724 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:13.494982 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:13.494774 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls podName:dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:17.494758369 +0000 UTC m=+42.625210685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls") pod "dns-default-w92nv" (UID: "dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f") : secret "dns-default-metrics-tls" not found Jun 14 22:48:14.266768 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:14.266735 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:14.373992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:14.373960 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:14.474622 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:14.474586 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:15.078657 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:15.078607 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:17.522267 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:17.522175 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:17.522267 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:17.522233 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:17.522736 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:17.522358 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:17.522736 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:17.522414 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:48:17.522736 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:17.522435 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5d7654f9-ftcs8: secret "image-registry-tls" not found Jun 14 22:48:17.522736 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:17.522441 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls podName:dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:25.522420926 +0000 UTC m=+50.652873228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls") pod "dns-default-w92nv" (UID: "dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f") : secret "dns-default-metrics-tls" not found Jun 14 22:48:17.522736 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:17.522497 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls podName:b0b02698-9972-44c4-8c93-19f8ae6107ec nodeName:}" failed. No retries permitted until 2026-06-14 22:48:25.52247918 +0000 UTC m=+50.652931489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls") pod "image-registry-5b5d7654f9-ftcs8" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec") : secret "image-registry-tls" not found Jun 14 22:48:19.576565 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.576531 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzmjl" event={"ID":"5b3a225f-6eb8-47d9-a76e-2e46633fbc25","Type":"ContainerStarted","Data":"d89b3aa0cfb85674b9c7cc9ce132a650e9d7806bddc776136536c5d91e53641d"} Jun 14 22:48:19.578401 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.578376 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" event={"ID":"5860c7f2-924a-4ed2-9ab9-4134a762cebb","Type":"ContainerStarted","Data":"c3b47cca1bd059c66d6312f6af78e984a817aeca448ffa8b42104b4eace238ff"} Jun 14 22:48:19.578513 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.578417 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" event={"ID":"5860c7f2-924a-4ed2-9ab9-4134a762cebb","Type":"ContainerStarted","Data":"39d02c8d14228044e869d12e2fdf6ab2f7bfcd9e4cca5884cc0b0e64b2c463ba"} Jun 14 22:48:19.578513 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.578430 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" event={"ID":"5860c7f2-924a-4ed2-9ab9-4134a762cebb","Type":"ContainerStarted","Data":"5d8fb9ea128e4e356939d0545c76b6ef0eb80a55607b057b8c5d8ce53642e286"} Jun 14 22:48:19.579842 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.579822 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mkg5l" event={"ID":"74c35091-736c-4700-a92d-ef31bf121160","Type":"ContainerStarted","Data":"15d0655bd31a8768a9ac0afb06f71994ceaebf9e5a4635a9e2d14dc5c14d0555"} Jun 14 22:48:19.581197 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.581175 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" event={"ID":"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db","Type":"ContainerStarted","Data":"3ee6301e72033888618961c292b1968f35fe730ffc3bfaf90e6af1ab02445212"} Jun 14 22:48:19.581295 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.581220 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:19.582681 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.582655 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" event={"ID":"e9c6dfb1-dcd4-471d-b06d-366261fea10c","Type":"ContainerStarted","Data":"ea2a24e1fca78d5d98825ed5ab1f7ad31bd90c77660dce93e850a5a1947823c2"} Jun 14 22:48:19.583101 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.583084 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:48:19.598792 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.598751 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pzmjl" podStartSLOduration=16.087812444 podStartE2EDuration="44.598738999s" totalImagesPullingTime="28.510926555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:19.596979055 +0000 UTC m=+44.727431378" watchObservedRunningTime="2026-06-14 22:48:19.598738999 +0000 UTC m=+44.729191324" Jun 14 22:48:19.609667 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.609631 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" podStartSLOduration=7.381682681 podStartE2EDuration="15.609619399s" totalImagesPullingTime="8.227936718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:19.609433249 +0000 UTC m=+44.739885572" watchObservedRunningTime="2026-06-14 22:48:19.609619399 +0000 UTC m=+44.740071723" Jun 14 22:48:19.626488 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.626452 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" podStartSLOduration=7.37832329 podStartE2EDuration="15.626440804s" totalImagesPullingTime="8.248117514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:19.625425926 +0000 UTC m=+44.755878249" watchObservedRunningTime="2026-06-14 22:48:19.626440804 +0000 UTC m=+44.756893127" Jun 14 22:48:19.642613 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.642578 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" podStartSLOduration=7.388405351 podStartE2EDuration="15.642566162s" totalImagesPullingTime="8.254160811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:19.642087793 +0000 UTC m=+44.772540139" watchObservedRunningTime="2026-06-14 22:48:19.642566162 +0000 UTC m=+44.773018486" Jun 14 22:48:19.659768 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.659721 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mkg5l" podStartSLOduration=2.429630358 podStartE2EDuration="10.659707514s" totalImagesPullingTime="8.230077156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:19.659341221 +0000 UTC m=+44.789793555" watchObservedRunningTime="2026-06-14 22:48:19.659707514 +0000 UTC m=+44.790159842" Jun 14 22:48:19.722594 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.722566 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:19.782803 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:19.782775 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:22.622760 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:22.622714 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:22.675331 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:22.675307 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:23.623676 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:23.623641 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:23.675646 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:23.675619 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:24.086300 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:24.086265 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:25.580407 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:25.580379 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:25.580407 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:25.580411 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:25.580805 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:25.580514 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:48:25.580805 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:25.580524 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5d7654f9-ftcs8: secret "image-registry-tls" not found Jun 14 22:48:25.580805 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:25.580574 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls podName:b0b02698-9972-44c4-8c93-19f8ae6107ec nodeName:}" failed. No retries permitted until 2026-06-14 22:48:41.580561171 +0000 UTC m=+66.711013473 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls") pod "image-registry-5b5d7654f9-ftcs8" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec") : secret "image-registry-tls" not found Jun 14 22:48:25.580805 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:25.580513 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:25.580805 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:25.580636 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls podName:dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:41.580623258 +0000 UTC m=+66.711075560 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls") pod "dns-default-w92nv" (UID: "dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f") : secret "dns-default-metrics-tls" not found Jun 14 22:48:27.370776 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:27.370736 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:27.423347 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:27.423318 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:27.773530 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:27.773499 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:27.820063 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:27.820031 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:34.864634 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:34.864599 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:36.703499 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:36.703462 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:36.759281 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:36.759250 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:37.526150 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:37.526116 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c6wmz" Jun 14 22:48:37.672325 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:37.672293 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:37.726741 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:37.726708 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:41.086714 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.086684 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:48:41.086714 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.086717 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:48:41.089093 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.089074 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 22:48:41.089151 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.089074 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 22:48:41.097021 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:41.096997 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 22:48:41.097142 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:41.097074 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs podName:b7f24fe8-cb38-4ac7-871f-f320c9e3393b nodeName:}" failed. No retries permitted until 2026-06-14 22:49:45.09705442 +0000 UTC m=+130.227506730 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs") pod "network-metrics-daemon-7znkl" (UID: "b7f24fe8-cb38-4ac7-871f-f320c9e3393b") : secret "metrics-daemon-secret" not found Jun 14 22:48:41.100278 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.100259 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57671521-d126-4c0a-9ac7-ef06884dac62-original-pull-secret\") pod \"global-pull-secret-syncer-xx4zd\" (UID: \"57671521-d126-4c0a-9ac7-ef06884dac62\") " pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:48:41.187751 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.187725 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66td8\" (UniqueName: \"kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8\") pod \"network-check-target-dltzk\" (UID: \"e5a4162d-3927-444e-9ab1-ba7a7ea2ec75\") " pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:48:41.190246 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.190228 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 22:48:41.199941 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.199913 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 22:48:41.210763 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.210743 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66td8\" (UniqueName: \"kubernetes.io/projected/e5a4162d-3927-444e-9ab1-ba7a7ea2ec75-kube-api-access-66td8\") pod \"network-check-target-dltzk\" (UID: \"e5a4162d-3927-444e-9ab1-ba7a7ea2ec75\") " pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:48:41.376135 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.376070 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cnbs\"" Jun 14 22:48:41.382988 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.382973 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx4zd" Jun 14 22:48:41.384067 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.384052 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:48:41.544922 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.544893 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xx4zd"] Jun 14 22:48:41.546918 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:48:41.546891 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57671521_d126_4c0a_9ac7_ef06884dac62.slice/crio-aa46de32d1bd4900673dc5c0af74d52d985149ca90371b23974550f1b4ae2b66 WatchSource:0}: Error finding container aa46de32d1bd4900673dc5c0af74d52d985149ca90371b23974550f1b4ae2b66: Status 404 returned error can't find the container with id aa46de32d1bd4900673dc5c0af74d52d985149ca90371b23974550f1b4ae2b66 Jun 14 22:48:41.562520 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.562497 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dltzk"] Jun 14 22:48:41.566845 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:48:41.566823 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a4162d_3927_444e_9ab1_ba7a7ea2ec75.slice/crio-6ea04e3f41d5afc8ae8669f4756ff5dd1edbc7339525ee1b729818f7ff80c129 WatchSource:0}: Error finding container 6ea04e3f41d5afc8ae8669f4756ff5dd1edbc7339525ee1b729818f7ff80c129: Status 404 returned error can't find the container with id 6ea04e3f41d5afc8ae8669f4756ff5dd1edbc7339525ee1b729818f7ff80c129 Jun 14 22:48:41.591341 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.591321 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:48:41.591425 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.591354 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:48:41.591476 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:41.591464 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:48:41.591513 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:41.591472 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:41.591554 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:41.591522 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls podName:dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f nodeName:}" failed. No retries permitted until 2026-06-14 22:49:13.591507188 +0000 UTC m=+98.721959490 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls") pod "dns-default-w92nv" (UID: "dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f") : secret "dns-default-metrics-tls" not found Jun 14 22:48:41.591554 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:41.591478 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5d7654f9-ftcs8: secret "image-registry-tls" not found Jun 14 22:48:41.591554 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:48:41.591553 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls podName:b0b02698-9972-44c4-8c93-19f8ae6107ec nodeName:}" failed. No retries permitted until 2026-06-14 22:49:13.591547204 +0000 UTC m=+98.721999511 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls") pod "image-registry-5b5d7654f9-ftcs8" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec") : secret "image-registry-tls" not found Jun 14 22:48:41.644581 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.644521 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dltzk" event={"ID":"e5a4162d-3927-444e-9ab1-ba7a7ea2ec75","Type":"ContainerStarted","Data":"6ea04e3f41d5afc8ae8669f4756ff5dd1edbc7339525ee1b729818f7ff80c129"} Jun 14 22:48:41.645536 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:41.645517 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xx4zd" event={"ID":"57671521-d126-4c0a-9ac7-ef06884dac62","Type":"ContainerStarted","Data":"aa46de32d1bd4900673dc5c0af74d52d985149ca90371b23974550f1b4ae2b66"} Jun 14 22:48:46.664913 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:46.664883 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dltzk" event={"ID":"e5a4162d-3927-444e-9ab1-ba7a7ea2ec75","Type":"ContainerStarted","Data":"73d07153d81c10bfabd0b5d7f85451c31b55a8c57356b6b2785c0e0228f37f47"} Jun 14 22:48:46.665371 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:46.664983 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:48:46.666386 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:46.666360 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xx4zd" event={"ID":"57671521-d126-4c0a-9ac7-ef06884dac62","Type":"ContainerStarted","Data":"c44e4e65e06d0f880f9490e5bd299c0ad5137545275c4a00de4fa6882682b152"} Jun 14 22:48:46.679479 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:46.679429 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dltzk" podStartSLOduration=66.77393531 podStartE2EDuration="1m11.679414619s" totalImagesPullingTime="4.905479309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:46.678763263 +0000 UTC m=+71.809215586" watchObservedRunningTime="2026-06-14 22:48:46.679414619 +0000 UTC m=+71.809866937" Jun 14 22:48:46.693576 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:46.693535 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xx4zd" podStartSLOduration=66.756150314 podStartE2EDuration="1m11.693522938s" totalImagesPullingTime="4.937372624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:46.69259032 +0000 UTC m=+71.823042681" watchObservedRunningTime="2026-06-14 22:48:46.693522938 +0000 UTC m=+71.823975319" Jun 14 22:48:49.388512 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:49.388481 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:49.489244 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:49.489207 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:54.729716 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:54.729690 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:48:54.778473 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:48:54.778437 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:49:00.654774 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:49:00.654740 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:49:00.713297 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:49:00.713265 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:49:13.624510 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:49:13.624467 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:49:13.624510 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:49:13.624517 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:49:13.624909 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:49:13.624625 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:49:13.624909 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:49:13.624629 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:49:13.624909 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:49:13.624701 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls podName:dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f nodeName:}" failed. No retries permitted until 2026-06-14 22:50:17.624686576 +0000 UTC m=+162.755138878 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls") pod "dns-default-w92nv" (UID: "dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f") : secret "dns-default-metrics-tls" not found Jun 14 22:49:13.624909 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:49:13.624635 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5d7654f9-ftcs8: secret "image-registry-tls" not found Jun 14 22:49:13.624909 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:49:13.624768 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls podName:b0b02698-9972-44c4-8c93-19f8ae6107ec nodeName:}" failed. No retries permitted until 2026-06-14 22:50:17.624756017 +0000 UTC m=+162.755208319 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls") pod "image-registry-5b5d7654f9-ftcs8" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec") : secret "image-registry-tls" not found Jun 14 22:49:17.672094 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:49:17.672059 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dltzk" Jun 14 22:49:45.130460 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:49:45.130414 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:49:45.130890 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:49:45.130529 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 22:49:45.130890 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:49:45.130607 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs podName:b7f24fe8-cb38-4ac7-871f-f320c9e3393b nodeName:}" failed. No retries permitted until 2026-06-14 22:51:47.130588912 +0000 UTC m=+252.261041215 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs") pod "network-metrics-daemon-7znkl" (UID: "b7f24fe8-cb38-4ac7-871f-f320c9e3393b") : secret "metrics-daemon-secret" not found Jun 14 22:50:12.763306 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:50:12.763259 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" podUID="b0b02698-9972-44c4-8c93-19f8ae6107ec" Jun 14 22:50:12.772436 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:50:12.772405 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w92nv" podUID="dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f" Jun 14 22:50:12.917583 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:12.917548 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:50:12.917583 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:12.917579 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w92nv" Jun 14 22:50:13.358051 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:50:13.358019 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:50:17.657317 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:17.657281 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:50:17.657317 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:17.657321 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:50:17.657805 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:50:17.657437 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:50:17.657805 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:50:17.657448 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5d7654f9-ftcs8: secret "image-registry-tls" not found Jun 14 22:50:17.657805 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:50:17.657450 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:50:17.657805 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:50:17.657496 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls podName:b0b02698-9972-44c4-8c93-19f8ae6107ec nodeName:}" failed. No retries permitted until 2026-06-14 22:52:19.657482523 +0000 UTC m=+284.787934825 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls") pod "image-registry-5b5d7654f9-ftcs8" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec") : secret "image-registry-tls" not found Jun 14 22:50:17.657805 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:50:17.657534 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls podName:dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f nodeName:}" failed. No retries permitted until 2026-06-14 22:52:19.65751423 +0000 UTC m=+284.787966545 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls") pod "dns-default-w92nv" (UID: "dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f") : secret "dns-default-metrics-tls" not found Jun 14 22:50:18.936766 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:18.936733 2548 generic.go:356] "Generic (PLEG): container finished" podID="e5f4cdff-d8f5-45f5-924a-cfa15d74b9db" containerID="3ee6301e72033888618961c292b1968f35fe730ffc3bfaf90e6af1ab02445212" exitCode=1 Jun 14 22:50:18.937110 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:18.936800 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" event={"ID":"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db","Type":"ContainerDied","Data":"3ee6301e72033888618961c292b1968f35fe730ffc3bfaf90e6af1ab02445212"} Jun 14 22:50:18.937169 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:18.937153 2548 scope.go:117] "RemoveContainer" containerID="3ee6301e72033888618961c292b1968f35fe730ffc3bfaf90e6af1ab02445212" Jun 14 22:50:19.582045 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:19.582000 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:50:19.942153 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:19.942059 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" event={"ID":"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db","Type":"ContainerStarted","Data":"2d3e73534549d45825edf858da91da790ac818bf6116a14efc7d3b88a71eb321"} Jun 14 22:50:19.942626 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:19.942337 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:50:19.943034 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:19.943009 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:50:19.943947 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:19.943911 2548 generic.go:356] "Generic (PLEG): container finished" podID="e9c6dfb1-dcd4-471d-b06d-366261fea10c" containerID="ea2a24e1fca78d5d98825ed5ab1f7ad31bd90c77660dce93e850a5a1947823c2" exitCode=255 Jun 14 22:50:19.944034 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:19.943963 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" event={"ID":"e9c6dfb1-dcd4-471d-b06d-366261fea10c","Type":"ContainerDied","Data":"ea2a24e1fca78d5d98825ed5ab1f7ad31bd90c77660dce93e850a5a1947823c2"} Jun 14 22:50:19.944254 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:19.944239 2548 scope.go:117] "RemoveContainer" containerID="ea2a24e1fca78d5d98825ed5ab1f7ad31bd90c77660dce93e850a5a1947823c2" Jun 14 22:50:20.040356 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:20.040332 2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" Jun 14 22:50:20.948683 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:20.948637 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" event={"ID":"e9c6dfb1-dcd4-471d-b06d-366261fea10c","Type":"ContainerStarted","Data":"7f49f6cec70147bc7ac2122d9021a237d9c9caaa8868c8d70a98ba516783470c"} Jun 14 22:50:28.341273 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:28.341182 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:50:51.711129 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:50:51.711078 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:51:46.644096 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:51:46.644055 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:51:46.695535 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:51:46.695502 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:51:47.143863 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:51:47.143823 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:51:47.144068 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:51:47.143964 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 22:51:47.144068 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:51:47.144024 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs podName:b7f24fe8-cb38-4ac7-871f-f320c9e3393b nodeName:}" failed. No retries permitted until 2026-06-14 22:53:49.144008736 +0000 UTC m=+374.274461039 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs") pod "network-metrics-daemon-7znkl" (UID: "b7f24fe8-cb38-4ac7-871f-f320c9e3393b") : secret "metrics-daemon-secret" not found Jun 14 22:52:02.889742 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:02.889645 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:02.944247 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:02.944212 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:04.850318 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:04.850279 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:04.950811 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:04.950783 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:06.229541 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:06.229509 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:06.323968 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:06.323877 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:06.422824 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:06.422801 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:07.346149 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.346113 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:07.398106 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.398078 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:07.799032 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.799003 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:07.899735 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.899709 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:07.948132 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.948107 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mbwpr"] Jun 14 22:52:07.951107 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.951089 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:07.953171 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.953154 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 22:52:07.953171 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.953165 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 22:52:07.954186 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.954172 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 22:52:07.954282 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.954200 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 22:52:07.954282 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.954201 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2789x\"" Jun 14 22:52:07.961823 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.961803 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mbwpr"] Jun 14 22:52:07.975726 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.975709 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52cdad12-3b19-411d-9420-20e04d29fbb8-data-volume\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:07.975815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.975746 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52cdad12-3b19-411d-9420-20e04d29fbb8-crio-socket\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:07.975815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.975765 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:07.975887 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.975834 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:07.975922 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.975886 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggz5n\" (UniqueName: \"kubernetes.io/projected/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-api-access-ggz5n\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:07.989814 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:07.989793 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:08.061558 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.061508 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:08.076467 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.076448 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggz5n\" (UniqueName: \"kubernetes.io/projected/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-api-access-ggz5n\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:08.076529 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.076490 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52cdad12-3b19-411d-9420-20e04d29fbb8-data-volume\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:08.076529 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.076520 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52cdad12-3b19-411d-9420-20e04d29fbb8-crio-socket\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:08.076624 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.076537 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:08.076624 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.076555 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:08.076624 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.076607 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52cdad12-3b19-411d-9420-20e04d29fbb8-crio-socket\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:08.076733 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:08.076640 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:08.076733 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:08.076646 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:08.076733 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:08.076704 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls podName:52cdad12-3b19-411d-9420-20e04d29fbb8 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:08.5766885 +0000 UTC m=+273.707140835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbwpr" (UID: "52cdad12-3b19-411d-9420-20e04d29fbb8") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:08.076733 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:08.076725 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm podName:52cdad12-3b19-411d-9420-20e04d29fbb8 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:08.576718303 +0000 UTC m=+273.707170605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbwpr" (UID: "52cdad12-3b19-411d-9420-20e04d29fbb8") : configmap "kube-rbac-proxy" not found Jun 14 22:52:08.076881 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.076793 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52cdad12-3b19-411d-9420-20e04d29fbb8-data-volume\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:08.085022 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.084998 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggz5n\" (UniqueName: \"kubernetes.io/projected/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-api-access-ggz5n\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:08.124424 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.124389 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:08.263476 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.263458 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:08.580453 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.580426 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:08.580801 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:08.580461 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:08.580801 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:08.580565 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:08.580801 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:08.580618 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls podName:52cdad12-3b19-411d-9420-20e04d29fbb8 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:09.58060529 +0000 UTC m=+274.711057592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbwpr" (UID: "52cdad12-3b19-411d-9420-20e04d29fbb8") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:08.580801 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:08.580568 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:08.580801 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:08.580728 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm podName:52cdad12-3b19-411d-9420-20e04d29fbb8 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:09.580709842 +0000 UTC m=+274.711162153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbwpr" (UID: "52cdad12-3b19-411d-9420-20e04d29fbb8") : configmap "kube-rbac-proxy" not found Jun 14 22:52:09.588298 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:09.588261 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:09.588298 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:09.588301 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:09.588705 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:09.588372 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:09.588705 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:09.588407 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:09.588705 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:09.588438 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm podName:52cdad12-3b19-411d-9420-20e04d29fbb8 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:11.588418276 +0000 UTC m=+276.718870578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbwpr" (UID: "52cdad12-3b19-411d-9420-20e04d29fbb8") : configmap "kube-rbac-proxy" not found Jun 14 22:52:09.588705 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:09.588469 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls podName:52cdad12-3b19-411d-9420-20e04d29fbb8 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:11.588455502 +0000 UTC m=+276.718907804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbwpr" (UID: "52cdad12-3b19-411d-9420-20e04d29fbb8") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:09.686453 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:09.686417 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:09.736067 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:09.736042 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:10.585528 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:10.585491 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:10.744429 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:10.744404 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7n9hc_0e5475a9-0484-4dff-b9ae-20547c97da47/dns-node-resolver/0.log" Jun 14 22:52:11.234372 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:11.234338 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:11.313067 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:11.313027 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:11.425276 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:11.425232 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:11.525142 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:11.525075 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:11.544157 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:11.544137 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2sqmn_34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b/node-ca/0.log" Jun 14 22:52:11.604599 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:11.604572 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:11.604697 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:11.604671 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:11.604749 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:11.604694 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:11.604790 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:11.604759 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm podName:52cdad12-3b19-411d-9420-20e04d29fbb8 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:15.604738959 +0000 UTC m=+280.735191266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbwpr" (UID: "52cdad12-3b19-411d-9420-20e04d29fbb8") : configmap "kube-rbac-proxy" not found Jun 14 22:52:11.604790 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:11.604766 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:11.604878 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:11.604802 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls podName:52cdad12-3b19-411d-9420-20e04d29fbb8 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:15.604792135 +0000 UTC m=+280.735244448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbwpr" (UID: "52cdad12-3b19-411d-9420-20e04d29fbb8") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:11.625209 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:11.625185 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:11.726310 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:11.726284 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:12.102283 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:12.102251 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:12.508203 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:12.508178 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:12.542848 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:12.542829 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mkg5l_74c35091-736c-4700-a92d-ef31bf121160/serve-healthcheck-canary/0.log" Jun 14 22:52:13.272322 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:13.272284 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:13.371561 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:13.371533 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:13.515259 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:13.515234 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:13.705332 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:13.705269 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:13.911425 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:13.911401 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:14.570667 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:14.570632 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:14.918639 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:14.918555 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:15.097147 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:15.097118 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:15.145370 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:15.145342 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:15.297950 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:15.297905 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:15.501111 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:15.501085 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:15.632766 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:15.632707 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:15.632766 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:15.632737 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:15.633126 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:15.632824 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:15.633126 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:15.632844 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:15.633126 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:15.632872 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm podName:52cdad12-3b19-411d-9420-20e04d29fbb8 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:23.632858988 +0000 UTC m=+288.763311291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbwpr" (UID: "52cdad12-3b19-411d-9420-20e04d29fbb8") : configmap "kube-rbac-proxy" not found Jun 14 22:52:15.633126 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:15.632911 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls podName:52cdad12-3b19-411d-9420-20e04d29fbb8 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:23.632897938 +0000 UTC m=+288.763350240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbwpr" (UID: "52cdad12-3b19-411d-9420-20e04d29fbb8") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:15.704394 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:15.704369 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:15.902553 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:15.902497 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:15.918692 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:15.918667 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w92nv" podUID="dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f" Jun 14 22:52:15.918766 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:15.918676 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" podUID="b0b02698-9972-44c4-8c93-19f8ae6107ec" Jun 14 22:52:16.295145 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:16.295118 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:52:16.295288 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:16.295122 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w92nv" Jun 14 22:52:16.562106 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:16.562049 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:16.902487 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:16.902421 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:17.307624 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:17.307595 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:17.498825 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:17.498795 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:17.701403 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:17.701340 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:17.746046 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:17.746013 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:17.903720 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:17.903691 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:18.899633 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:18.899593 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:19.100804 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.100778 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:19.257535 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.257510 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:19.305671 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.305647 2548 generic.go:356] "Generic (PLEG): container finished" podID="e5f4cdff-d8f5-45f5-924a-cfa15d74b9db" containerID="2d3e73534549d45825edf858da91da790ac818bf6116a14efc7d3b88a71eb321" exitCode=1 Jun 14 22:52:19.305769 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.305716 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" event={"ID":"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db","Type":"ContainerDied","Data":"2d3e73534549d45825edf858da91da790ac818bf6116a14efc7d3b88a71eb321"} Jun 14 22:52:19.305813 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.305769 2548 scope.go:117] "RemoveContainer" containerID="3ee6301e72033888618961c292b1968f35fe730ffc3bfaf90e6af1ab02445212" Jun 14 22:52:19.306058 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.306036 2548 scope.go:117] "RemoveContainer" containerID="2d3e73534549d45825edf858da91da790ac818bf6116a14efc7d3b88a71eb321" Jun 14 22:52:19.306257 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:19.306233 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-689f7bbc7b-9g768_open-cluster-management-agent-addon(e5f4cdff-d8f5-45f5-924a-cfa15d74b9db)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" podUID="e5f4cdff-d8f5-45f5-924a-cfa15d74b9db" Jun 14 22:52:19.513415 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.513356 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:19.662006 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.661982 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:52:19.662102 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.662012 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:52:19.664317 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.664296 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f-metrics-tls\") pod \"dns-default-w92nv\" (UID: \"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f\") " pod="openshift-dns/dns-default-w92nv" Jun 14 22:52:19.664523 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.664502 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"image-registry-5b5d7654f9-ftcs8\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:52:19.701742 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.701718 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:19.899525 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.899466 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kv5xf\"" Jun 14 22:52:19.899525 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.899466 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jjmh8\"" Jun 14 22:52:19.906322 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.906299 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:52:19.906409 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.906393 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w92nv" Jun 14 22:52:19.942606 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:19.942579 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:52:20.025207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.025175 2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:52:20.039158 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.039125 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b5d7654f9-ftcs8"] Jun 14 22:52:20.042721 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:52:20.042696 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b02698_9972_44c4_8c93_19f8ae6107ec.slice/crio-cab1b7a2b4b43f905b83f9c05516deb0cdb2b5a3a20a73ec508d4d24d3019957 WatchSource:0}: Error finding container cab1b7a2b4b43f905b83f9c05516deb0cdb2b5a3a20a73ec508d4d24d3019957: Status 404 returned error can't find the container with id cab1b7a2b4b43f905b83f9c05516deb0cdb2b5a3a20a73ec508d4d24d3019957 Jun 14 22:52:20.053297 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.053272 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w92nv"] Jun 14 22:52:20.056224 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:52:20.056202 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddffaced6_6f1d_4dbb_bef5_02fcc4f5e93f.slice/crio-30b02768de04d1ada7cb7a5f360677a8df47edb6632398ec2ffe9dcfd691bd61 WatchSource:0}: Error finding container 30b02768de04d1ada7cb7a5f360677a8df47edb6632398ec2ffe9dcfd691bd61: Status 404 returned error can't find the container with id 30b02768de04d1ada7cb7a5f360677a8df47edb6632398ec2ffe9dcfd691bd61 Jun 14 22:52:20.100271 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.100246 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:20.310772 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.310737 2548 scope.go:117] "RemoveContainer" containerID="2d3e73534549d45825edf858da91da790ac818bf6116a14efc7d3b88a71eb321" Jun 14 22:52:20.311237 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:20.310903 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-689f7bbc7b-9g768_open-cluster-management-agent-addon(e5f4cdff-d8f5-45f5-924a-cfa15d74b9db)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" podUID="e5f4cdff-d8f5-45f5-924a-cfa15d74b9db" Jun 14 22:52:20.312153 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.312130 2548 generic.go:356] "Generic (PLEG): container finished" podID="e9c6dfb1-dcd4-471d-b06d-366261fea10c" containerID="7f49f6cec70147bc7ac2122d9021a237d9c9caaa8868c8d70a98ba516783470c" exitCode=255 Jun 14 22:52:20.312264 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.312198 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" event={"ID":"e9c6dfb1-dcd4-471d-b06d-366261fea10c","Type":"ContainerDied","Data":"7f49f6cec70147bc7ac2122d9021a237d9c9caaa8868c8d70a98ba516783470c"} Jun 14 22:52:20.312264 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.312236 2548 scope.go:117] "RemoveContainer" containerID="ea2a24e1fca78d5d98825ed5ab1f7ad31bd90c77660dce93e850a5a1947823c2" Jun 14 22:52:20.312516 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.312498 2548 scope.go:117] "RemoveContainer" containerID="7f49f6cec70147bc7ac2122d9021a237d9c9caaa8868c8d70a98ba516783470c" Jun 14 22:52:20.312676 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:20.312656 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb_open-cluster-management-agent-addon(e9c6dfb1-dcd4-471d-b06d-366261fea10c)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" podUID="e9c6dfb1-dcd4-471d-b06d-366261fea10c" Jun 14 22:52:20.313460 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.313402 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w92nv" event={"ID":"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f","Type":"ContainerStarted","Data":"30b02768de04d1ada7cb7a5f360677a8df47edb6632398ec2ffe9dcfd691bd61"} Jun 14 22:52:20.314966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.314904 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" event={"ID":"b0b02698-9972-44c4-8c93-19f8ae6107ec","Type":"ContainerStarted","Data":"4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553"} Jun 14 22:52:20.315054 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.314965 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" event={"ID":"b0b02698-9972-44c4-8c93-19f8ae6107ec","Type":"ContainerStarted","Data":"cab1b7a2b4b43f905b83f9c05516deb0cdb2b5a3a20a73ec508d4d24d3019957"} Jun 14 22:52:20.315054 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.315015 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:52:20.357388 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.357348 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" podStartSLOduration=285.357335625 podStartE2EDuration="4m45.357335625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:20.356373323 +0000 UTC m=+285.486825666" watchObservedRunningTime="2026-06-14 22:52:20.357335625 +0000 UTC m=+285.487787949" Jun 14 22:52:20.704890 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.704816 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:20.888522 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:20.888480 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:21.032422 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:21.032393 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:21.302752 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:21.302667 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:21.322910 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:21.322876 2548 scope.go:117] "RemoveContainer" containerID="2d3e73534549d45825edf858da91da790ac818bf6116a14efc7d3b88a71eb321" Jun 14 22:52:21.323445 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:21.323416 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-689f7bbc7b-9g768_open-cluster-management-agent-addon(e5f4cdff-d8f5-45f5-924a-cfa15d74b9db)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" podUID="e5f4cdff-d8f5-45f5-924a-cfa15d74b9db" Jun 14 22:52:21.507168 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:21.507134 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:21.715379 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:21.715354 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:21.906381 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:21.906292 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:22.302012 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:22.301980 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:22.327506 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:22.327478 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w92nv" event={"ID":"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f","Type":"ContainerStarted","Data":"05214a1381cbff2743c07971bd1d69587f4fcd9cc2ff46785835995ee60f9ec4"} Jun 14 22:52:22.327903 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:22.327522 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w92nv" event={"ID":"dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f","Type":"ContainerStarted","Data":"c60867ddb3d7cbd32e5c3e0875ba24f8d513cd9cdd2e435999473edc1c8270e8"} Jun 14 22:52:22.327903 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:22.327616 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w92nv" Jun 14 22:52:22.343835 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:22.343797 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w92nv" podStartSLOduration=251.886816197 podStartE2EDuration="4m13.343784706s" totalImagesPullingTime="1.456968509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:22.342565067 +0000 UTC m=+287.473017408" watchObservedRunningTime="2026-06-14 22:52:22.343784706 +0000 UTC m=+287.474237030" Jun 14 22:52:23.694449 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:23.694416 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:23.694449 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:23.694449 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:23.694947 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:23.694911 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52cdad12-3b19-411d-9420-20e04d29fbb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:23.696722 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:23.696704 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52cdad12-3b19-411d-9420-20e04d29fbb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbwpr\" (UID: \"52cdad12-3b19-411d-9420-20e04d29fbb8\") " pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:23.860246 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:23.860216 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mbwpr" Jun 14 22:52:23.981600 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:23.981474 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mbwpr"] Jun 14 22:52:23.983947 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:52:23.983909 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52cdad12_3b19_411d_9420_20e04d29fbb8.slice/crio-d08d0bb2159da041b7762d73caf19e6615b91654a691ce9d016c56b6bdeef757 WatchSource:0}: Error finding container d08d0bb2159da041b7762d73caf19e6615b91654a691ce9d016c56b6bdeef757: Status 404 returned error can't find the container with id d08d0bb2159da041b7762d73caf19e6615b91654a691ce9d016c56b6bdeef757 Jun 14 22:52:24.335788 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:24.335729 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbwpr" event={"ID":"52cdad12-3b19-411d-9420-20e04d29fbb8","Type":"ContainerStarted","Data":"d08d0bb2159da041b7762d73caf19e6615b91654a691ce9d016c56b6bdeef757"} Jun 14 22:52:28.352259 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:28.352187 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbwpr" event={"ID":"52cdad12-3b19-411d-9420-20e04d29fbb8","Type":"ContainerStarted","Data":"4e7e8e780a9bb100c44c51869f47ff1c0437e5ec5d72de66c27700e12855510b"} Jun 14 22:52:28.352259 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:28.352247 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbwpr" event={"ID":"52cdad12-3b19-411d-9420-20e04d29fbb8","Type":"ContainerStarted","Data":"702dbad4fb0b581f3fc7f755a36724467f7d3b8b44973a5f73f025230d4d18fd"} Jun 14 22:52:29.370418 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:29.370383 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:29.425122 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:29.425091 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:30.041038 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:30.040977 2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" Jun 14 22:52:30.041271 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:30.041250 2548 scope.go:117] "RemoveContainer" containerID="7f49f6cec70147bc7ac2122d9021a237d9c9caaa8868c8d70a98ba516783470c" Jun 14 22:52:30.041395 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:30.041375 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb_open-cluster-management-agent-addon(e9c6dfb1-dcd4-471d-b06d-366261fea10c)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" podUID="e9c6dfb1-dcd4-471d-b06d-366261fea10c" Jun 14 22:52:30.148267 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:30.148244 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:30.268473 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:30.268451 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:30.361445 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:30.361381 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbwpr" event={"ID":"52cdad12-3b19-411d-9420-20e04d29fbb8","Type":"ContainerStarted","Data":"c394036323e4be112cea55f45f5d0067ccd945723d96fb164ebb16435e2ee7ea"} Jun 14 22:52:30.377799 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:30.377749 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mbwpr" podStartSLOduration=17.715830234 podStartE2EDuration="23.377736574s" totalImagesPullingTime="5.66190634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:52:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:30.377558414 +0000 UTC m=+295.508010789" watchObservedRunningTime="2026-06-14 22:52:30.377736574 +0000 UTC m=+295.508188897" Jun 14 22:52:31.342409 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:52:31.342364 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7znkl" podUID="b7f24fe8-cb38-4ac7-871f-f320c9e3393b" Jun 14 22:52:32.333301 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:32.333264 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w92nv" Jun 14 22:52:33.063751 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:33.063717 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:33.124489 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:33.124451 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:33.402533 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:33.402458 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:35.297024 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:35.296988 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 22:52:35.298120 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:35.298099 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 22:52:35.300604 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:35.300582 2548 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 22:52:35.342248 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:35.342128 2548 scope.go:117] "RemoveContainer" containerID="2d3e73534549d45825edf858da91da790ac818bf6116a14efc7d3b88a71eb321" Jun 14 22:52:35.393262 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:35.393231 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:36.381980 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:36.381926 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" event={"ID":"e5f4cdff-d8f5-45f5-924a-cfa15d74b9db","Type":"ContainerStarted","Data":"765b3152ddcdccea33d0ab04c21af13ba579a4e9a1c01e25afc7fe5b7452cfdd"} Jun 14 22:52:36.382386 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:36.382233 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:52:36.383916 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:36.383892 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-689f7bbc7b-9g768" Jun 14 22:52:38.186221 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.186188 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:38.441034 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.440972 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-llzjq"] Jun 14 22:52:38.444169 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.444155 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.446516 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.446494 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 22:52:38.446629 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.446519 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 22:52:38.447387 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.447366 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 22:52:38.447491 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.447389 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 22:52:38.447491 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.447411 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t8p9k\"" Jun 14 22:52:38.447491 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.447395 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 22:52:38.447491 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.447369 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 22:52:38.499611 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.499587 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-textfile\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.499707 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.499635 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16a0c95f-ad51-43b5-9664-d0414555629c-metrics-client-ca\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.499707 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.499654 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-accelerators-collector-config\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.499777 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.499700 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.499812 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.499774 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-tls\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.499848 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.499821 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16a0c95f-ad51-43b5-9664-d0414555629c-sys\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.499848 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.499838 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-wtmp\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.499920 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.499852 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhhrz\" (UniqueName: \"kubernetes.io/projected/16a0c95f-ad51-43b5-9664-d0414555629c-kube-api-access-vhhrz\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.499920 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.499866 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16a0c95f-ad51-43b5-9664-d0414555629c-root\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600121 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600100 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16a0c95f-ad51-43b5-9664-d0414555629c-metrics-client-ca\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600219 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600126 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-accelerators-collector-config\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600219 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600146 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600219 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600162 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-tls\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600419 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600290 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16a0c95f-ad51-43b5-9664-d0414555629c-sys\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600419 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600325 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-wtmp\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600419 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600347 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhhrz\" (UniqueName: \"kubernetes.io/projected/16a0c95f-ad51-43b5-9664-d0414555629c-kube-api-access-vhhrz\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600419 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600372 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16a0c95f-ad51-43b5-9664-d0414555629c-root\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600419 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600398 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16a0c95f-ad51-43b5-9664-d0414555629c-sys\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600419 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600419 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16a0c95f-ad51-43b5-9664-d0414555629c-root\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600682 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600520 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-textfile\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600723 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600689 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16a0c95f-ad51-43b5-9664-d0414555629c-metrics-client-ca\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600772 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600758 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-wtmp\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.600870 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.600851 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-textfile\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.601156 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.601135 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-accelerators-collector-config\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.602398 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.602379 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-tls\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.602517 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.602501 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16a0c95f-ad51-43b5-9664-d0414555629c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.607314 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.607289 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhhrz\" (UniqueName: \"kubernetes.io/projected/16a0c95f-ad51-43b5-9664-d0414555629c-kube-api-access-vhhrz\") pod \"node-exporter-llzjq\" (UID: \"16a0c95f-ad51-43b5-9664-d0414555629c\") " pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.753472 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.753450 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llzjq" Jun 14 22:52:38.763957 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:52:38.763917 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16a0c95f_ad51_43b5_9664_d0414555629c.slice/crio-68e72fd792d60b8d3875da2d75d3604571e5ad5a5f0023d023810401aff86d03 WatchSource:0}: Error finding container 68e72fd792d60b8d3875da2d75d3604571e5ad5a5f0023d023810401aff86d03: Status 404 returned error can't find the container with id 68e72fd792d60b8d3875da2d75d3604571e5ad5a5f0023d023810401aff86d03 Jun 14 22:52:38.765853 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:38.765837 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 22:52:39.080969 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:39.080891 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:39.179792 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:39.179762 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:39.289671 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:39.289642 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:39.393389 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:39.393321 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llzjq" event={"ID":"16a0c95f-ad51-43b5-9664-d0414555629c","Type":"ContainerStarted","Data":"68e72fd792d60b8d3875da2d75d3604571e5ad5a5f0023d023810401aff86d03"} Jun 14 22:52:39.435599 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:39.435554 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:39.547416 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:39.547387 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:39.616569 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:39.616530 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:39.911132 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:39.911105 2548 patch_prober.go:28] interesting pod/image-registry-5b5d7654f9-ftcs8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 22:52:39.911243 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:39.911151 2548 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" podUID="b0b02698-9972-44c4-8c93-19f8ae6107ec" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 22:52:40.398193 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:40.398158 2548 generic.go:356] "Generic (PLEG): container finished" podID="16a0c95f-ad51-43b5-9664-d0414555629c" containerID="ec4712efa3bb70aa8ea1b52bcabd14aa2156dedb051b8b73c515380c8e01a481" exitCode=0 Jun 14 22:52:40.398552 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:40.398229 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llzjq" event={"ID":"16a0c95f-ad51-43b5-9664-d0414555629c","Type":"ContainerDied","Data":"ec4712efa3bb70aa8ea1b52bcabd14aa2156dedb051b8b73c515380c8e01a481"} Jun 14 22:52:41.327424 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:41.327396 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:52:41.385634 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:41.385604 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:41.403298 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:41.403275 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llzjq" event={"ID":"16a0c95f-ad51-43b5-9664-d0414555629c","Type":"ContainerStarted","Data":"451ed9df4624ecf9703972f0b588013cfb15fd7fe144b70e346a8a4da315db35"} Jun 14 22:52:41.403633 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:41.403316 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llzjq" event={"ID":"16a0c95f-ad51-43b5-9664-d0414555629c","Type":"ContainerStarted","Data":"c9c112805a68fae054e0f4d563f3fdee58f38bc4322bcdf5ae1478735a519fa7"} Jun 14 22:52:41.423621 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:41.423583 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-llzjq" podStartSLOduration=2.439717865 podStartE2EDuration="3.423571895s" totalImagesPullingTime="923.602233ms" totalInitContainerRuntime="60.251797ms" isStatefulPod=true podCreationTimestamp="2026-06-14 22:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:41.423058352 +0000 UTC m=+306.553510726" watchObservedRunningTime="2026-06-14 22:52:41.423571895 +0000 UTC m=+306.554024219" Jun 14 22:52:41.485825 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:41.485798 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:41.548208 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:41.548181 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:41.674617 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:41.674554 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:41.775224 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:41.775201 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:43.204687 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:43.204656 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:43.377195 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:43.377165 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:43.617372 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:43.617348 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:43.674490 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:43.674466 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:44.340730 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:44.340702 2548 scope.go:117] "RemoveContainer" containerID="7f49f6cec70147bc7ac2122d9021a237d9c9caaa8868c8d70a98ba516783470c" Jun 14 22:52:44.415436 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:44.415410 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578cf4d6f6-s7rfb" event={"ID":"e9c6dfb1-dcd4-471d-b06d-366261fea10c","Type":"ContainerStarted","Data":"6a8d68eccea271fe1df91caed4ee5d4434d3d5c79de922981bf32b9b3b5d6432"} Jun 14 22:52:44.616381 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:44.616304 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:46.341391 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:46.341355 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:52:50.172717 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:50.172683 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:50.273769 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:50.273736 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:51.920069 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:51.920033 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b5d7654f9-ftcs8"] Jun 14 22:52:51.988260 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:51.988230 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:52.088224 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:52.088181 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:52.139519 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:52.139494 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:52.698576 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:52.698543 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:52.798138 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:52.798110 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:54.997281 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:54.997247 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:55.046280 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:55.046253 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:58.926878 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:58.926826 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:59.023566 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:59.023539 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:59.220730 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:59.220705 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:59.375619 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:59.375595 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:59.475014 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:59.474957 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:52:59.587384 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:52:59.587362 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:00.020498 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:00.020473 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:00.069809 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:00.069782 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:00.800416 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:00.800388 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:01.015402 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:01.015371 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:01.064389 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:01.064323 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:02.217128 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:02.217094 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:02.317400 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:02.317371 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:06.408308 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:06.408274 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:10.048915 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:10.048873 2548 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" podUID="5860c7f2-924a-4ed2-9ab9-4134a762cebb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 22:53:13.826219 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:13.826185 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:13.875848 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:13.875822 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:14.378313 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:14.378281 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:14.479450 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:14.479423 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:14.579161 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:14.579121 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:14.679259 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:14.679202 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:14.733284 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:14.733258 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:16.939941 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:16.939901 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" podUID="b0b02698-9972-44c4-8c93-19f8ae6107ec" containerName="registry" containerID="cri-o://4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553" gracePeriod=30 Jun 14 22:53:17.181442 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.181415 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:53:17.355587 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.355564 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v79t9\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-kube-api-access-v79t9\") pod \"b0b02698-9972-44c4-8c93-19f8ae6107ec\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " Jun 14 22:53:17.355751 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.355615 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b02698-9972-44c4-8c93-19f8ae6107ec-image-registry-private-configuration\") pod \"b0b02698-9972-44c4-8c93-19f8ae6107ec\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " Jun 14 22:53:17.355751 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.355647 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b02698-9972-44c4-8c93-19f8ae6107ec-ca-trust-extracted\") pod \"b0b02698-9972-44c4-8c93-19f8ae6107ec\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " Jun 14 22:53:17.355880 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.355789 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") pod \"b0b02698-9972-44c4-8c93-19f8ae6107ec\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " Jun 14 22:53:17.355880 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.355818 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-certificates\") pod \"b0b02698-9972-44c4-8c93-19f8ae6107ec\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " Jun 14 22:53:17.355880 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.355833 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-bound-sa-token\") pod \"b0b02698-9972-44c4-8c93-19f8ae6107ec\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " Jun 14 22:53:17.355880 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.355855 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b02698-9972-44c4-8c93-19f8ae6107ec-installation-pull-secrets\") pod \"b0b02698-9972-44c4-8c93-19f8ae6107ec\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " Jun 14 22:53:17.356109 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.355965 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b02698-9972-44c4-8c93-19f8ae6107ec-trusted-ca\") pod \"b0b02698-9972-44c4-8c93-19f8ae6107ec\" (UID: \"b0b02698-9972-44c4-8c93-19f8ae6107ec\") " Jun 14 22:53:17.356452 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.356275 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b0b02698-9972-44c4-8c93-19f8ae6107ec" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:53:17.356577 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.356533 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0b02698-9972-44c4-8c93-19f8ae6107ec-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b0b02698-9972-44c4-8c93-19f8ae6107ec" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:53:17.358338 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.358265 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-kube-api-access-v79t9" (OuterVolumeSpecName: "kube-api-access-v79t9") pod "b0b02698-9972-44c4-8c93-19f8ae6107ec" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec"). InnerVolumeSpecName "kube-api-access-v79t9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:53:17.358338 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.358313 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b0b02698-9972-44c4-8c93-19f8ae6107ec" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:53:17.358510 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.358319 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0b02698-9972-44c4-8c93-19f8ae6107ec-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b0b02698-9972-44c4-8c93-19f8ae6107ec" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:53:17.358510 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.358493 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0b02698-9972-44c4-8c93-19f8ae6107ec-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b0b02698-9972-44c4-8c93-19f8ae6107ec" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:53:17.358510 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.358492 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b0b02698-9972-44c4-8c93-19f8ae6107ec" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:53:17.364364 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.364343 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b02698-9972-44c4-8c93-19f8ae6107ec-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b0b02698-9972-44c4-8c93-19f8ae6107ec" (UID: "b0b02698-9972-44c4-8c93-19f8ae6107ec"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:53:17.419979 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.419903 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:17.457052 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.457030 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v79t9\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-kube-api-access-v79t9\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:53:17.457052 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.457049 2548 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b02698-9972-44c4-8c93-19f8ae6107ec-image-registry-private-configuration\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:53:17.457168 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.457059 2548 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b02698-9972-44c4-8c93-19f8ae6107ec-ca-trust-extracted\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:53:17.457168 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.457068 2548 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-tls\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:53:17.457168 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.457077 2548 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b02698-9972-44c4-8c93-19f8ae6107ec-registry-certificates\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:53:17.457168 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.457085 2548 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b02698-9972-44c4-8c93-19f8ae6107ec-bound-sa-token\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:53:17.457168 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.457093 2548 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b02698-9972-44c4-8c93-19f8ae6107ec-installation-pull-secrets\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:53:17.457168 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.457116 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b02698-9972-44c4-8c93-19f8ae6107ec-trusted-ca\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:53:17.471413 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.471391 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:17.516792 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.516770 2548 generic.go:356] "Generic (PLEG): container finished" podID="b0b02698-9972-44c4-8c93-19f8ae6107ec" containerID="4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553" exitCode=0 Jun 14 22:53:17.516870 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.516798 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" event={"ID":"b0b02698-9972-44c4-8c93-19f8ae6107ec","Type":"ContainerDied","Data":"4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553"} Jun 14 22:53:17.516870 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.516817 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" Jun 14 22:53:17.516870 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.516842 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b5d7654f9-ftcs8" event={"ID":"b0b02698-9972-44c4-8c93-19f8ae6107ec","Type":"ContainerDied","Data":"cab1b7a2b4b43f905b83f9c05516deb0cdb2b5a3a20a73ec508d4d24d3019957"} Jun 14 22:53:17.516870 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.516863 2548 scope.go:117] "RemoveContainer" containerID="4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553" Jun 14 22:53:17.525164 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.525145 2548 scope.go:117] "RemoveContainer" containerID="4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553" Jun 14 22:53:17.525498 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:53:17.525465 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553\": container with ID starting with 4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553 not found: ID does not exist" containerID="4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553" Jun 14 22:53:17.525575 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.525508 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553"} err="failed to get container status \"4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553\": rpc error: code = NotFound desc = could not find container \"4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553\": container with ID starting with 4196ef923f013ed78579b02528422fb4e70bdd3812f78f8f2fe99cc0fb51f553 not found: ID does not exist" Jun 14 22:53:17.536293 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.536270 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b5d7654f9-ftcs8"] Jun 14 22:53:17.540180 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:17.540162 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b5d7654f9-ftcs8"] Jun 14 22:53:19.025026 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:19.024990 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:19.126182 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:19.126158 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:19.345355 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:19.345288 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0b02698-9972-44c4-8c93-19f8ae6107ec" path="/var/lib/kubelet/pods/b0b02698-9972-44c4-8c93-19f8ae6107ec/volumes" Jun 14 22:53:20.048677 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:20.048633 2548 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" podUID="5860c7f2-924a-4ed2-9ab9-4134a762cebb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 22:53:24.633308 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:24.633277 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:24.678562 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:24.678528 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:25.029390 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:25.029354 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:25.088512 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:25.088486 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:28.623658 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:28.623626 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:28.674119 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:28.674093 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:28.724820 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:28.724797 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:30.048644 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:30.048605 2548 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" podUID="5860c7f2-924a-4ed2-9ab9-4134a762cebb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 22:53:30.049036 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:30.048685 2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" Jun 14 22:53:30.049213 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:30.049192 2548 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c3b47cca1bd059c66d6312f6af78e984a817aeca448ffa8b42104b4eace238ff"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 14 22:53:30.049256 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:30.049236 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" podUID="5860c7f2-924a-4ed2-9ab9-4134a762cebb" containerName="service-proxy" containerID="cri-o://c3b47cca1bd059c66d6312f6af78e984a817aeca448ffa8b42104b4eace238ff" gracePeriod=30 Jun 14 22:53:30.559701 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:30.559669 2548 generic.go:356] "Generic (PLEG): container finished" podID="5860c7f2-924a-4ed2-9ab9-4134a762cebb" containerID="c3b47cca1bd059c66d6312f6af78e984a817aeca448ffa8b42104b4eace238ff" exitCode=2 Jun 14 22:53:30.559849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:30.559741 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" event={"ID":"5860c7f2-924a-4ed2-9ab9-4134a762cebb","Type":"ContainerDied","Data":"c3b47cca1bd059c66d6312f6af78e984a817aeca448ffa8b42104b4eace238ff"} Jun 14 22:53:30.559849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:30.559782 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-688bd985cf-fpp65" event={"ID":"5860c7f2-924a-4ed2-9ab9-4134a762cebb","Type":"ContainerStarted","Data":"853a79f970b4a316db061fbbc605d53f2f0f26e1723c0c395ab6224949df71b9"} Jun 14 22:53:44.370872 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:44.370837 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:44.470490 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:44.470464 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:49.165798 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:49.165760 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:53:49.168116 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:49.168089 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f24fe8-cb38-4ac7-871f-f320c9e3393b-metrics-certs\") pod \"network-metrics-daemon-7znkl\" (UID: \"b7f24fe8-cb38-4ac7-871f-f320c9e3393b\") " pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:53:49.344107 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:49.344082 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k6g9m\"" Jun 14 22:53:49.352848 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:49.352831 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7znkl" Jun 14 22:53:49.469495 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:49.469469 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7znkl"] Jun 14 22:53:49.472604 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:53:49.472580 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f24fe8_cb38_4ac7_871f_f320c9e3393b.slice/crio-e87838b93a08844bde67355dcf3812f3a3591c290c9d56333eeb3ce6db1b995f WatchSource:0}: Error finding container e87838b93a08844bde67355dcf3812f3a3591c290c9d56333eeb3ce6db1b995f: Status 404 returned error can't find the container with id e87838b93a08844bde67355dcf3812f3a3591c290c9d56333eeb3ce6db1b995f Jun 14 22:53:49.619842 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:49.619809 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7znkl" event={"ID":"b7f24fe8-cb38-4ac7-871f-f320c9e3393b","Type":"ContainerStarted","Data":"e87838b93a08844bde67355dcf3812f3a3591c290c9d56333eeb3ce6db1b995f"} Jun 14 22:53:50.625529 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:50.625455 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7znkl" event={"ID":"b7f24fe8-cb38-4ac7-871f-f320c9e3393b","Type":"ContainerStarted","Data":"8e66b4ad49bb08b3b88d3abb6bbd3b765dfb8fd9ca4b5f0497c25af8cc462679"} Jun 14 22:53:50.625529 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:50.625504 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7znkl" event={"ID":"b7f24fe8-cb38-4ac7-871f-f320c9e3393b","Type":"ContainerStarted","Data":"61b85806f8cc85e22b146a593df582fc8231786b315e680dae3791e06e740169"} Jun 14 22:53:50.641016 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:50.640973 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7znkl" podStartSLOduration=374.878161583 podStartE2EDuration="6m15.640960082s" totalImagesPullingTime="762.798499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:53:50.640209948 +0000 UTC m=+375.770662285" watchObservedRunningTime="2026-06-14 22:53:50.640960082 +0000 UTC m=+375.771412406" Jun 14 22:53:50.724529 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:50.724503 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:50.776405 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:50.776381 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:54.509250 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:54.509216 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:54.557519 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:54.557491 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:59.199164 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:59.199125 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:53:59.298243 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:53:59.298200 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:04.364784 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:04.364750 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:04.469677 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:04.469648 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:09.022692 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:09.022652 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:09.075916 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:09.075888 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:09.833436 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:09.833401 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:09.887793 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:09.887764 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:14.380689 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:14.380651 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:14.477907 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:14.477862 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:15.804849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:15.804819 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:15.860951 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:15.860882 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:38.757227 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:38.757178 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:40.542381 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:40.542335 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:54:40.642075 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:54:40.642037 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:02.069647 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:02.069560 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:02.874804 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:02.874773 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:05.677661 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:05.677628 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:05.728015 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:05.727983 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:07.283855 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:07.283822 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:07.390404 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:07.390370 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:07.493668 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:07.493636 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:08.099859 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.099829 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw"] Jun 14 22:55:08.100080 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.100065 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b02698-9972-44c4-8c93-19f8ae6107ec" containerName="registry" Jun 14 22:55:08.100136 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.100081 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b02698-9972-44c4-8c93-19f8ae6107ec" containerName="registry" Jun 14 22:55:08.100136 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.100131 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0b02698-9972-44c4-8c93-19f8ae6107ec" containerName="registry" Jun 14 22:55:08.102975 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.102960 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:08.105207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.105183 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 22:55:08.106161 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.106139 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v4tk7\"" Jun 14 22:55:08.106316 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.106145 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 22:55:08.110736 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.110717 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw"] Jun 14 22:55:08.186510 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.186486 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw\" (UID: \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:08.186629 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.186531 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw\" (UID: \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:08.186629 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.186550 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68h47\" (UniqueName: \"kubernetes.io/projected/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-kube-api-access-68h47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw\" (UID: \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:08.287444 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.287423 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw\" (UID: \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:08.287820 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.287467 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw\" (UID: \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:08.287820 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.287487 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68h47\" (UniqueName: \"kubernetes.io/projected/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-kube-api-access-68h47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw\" (UID: \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:08.287958 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.287896 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw\" (UID: \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:08.287958 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.287905 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw\" (UID: \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:08.296702 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.296680 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68h47\" (UniqueName: \"kubernetes.io/projected/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-kube-api-access-68h47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw\" (UID: \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:08.412218 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.412159 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:08.531226 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.531195 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw"] Jun 14 22:55:08.534096 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:55:08.534061 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e0b6cd_f600_4e62_bd81_3dd9e971dd00.slice/crio-1ddcc5826991620f6e307b0cac36ef88df474425fd349bf614afaf3df8747093 WatchSource:0}: Error finding container 1ddcc5826991620f6e307b0cac36ef88df474425fd349bf614afaf3df8747093: Status 404 returned error can't find the container with id 1ddcc5826991620f6e307b0cac36ef88df474425fd349bf614afaf3df8747093 Jun 14 22:55:08.875432 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:08.875397 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" event={"ID":"32e0b6cd-f600-4e62-bd81-3dd9e971dd00","Type":"ContainerStarted","Data":"1ddcc5826991620f6e307b0cac36ef88df474425fd349bf614afaf3df8747093"} Jun 14 22:55:10.919132 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:10.919095 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:11.315712 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:11.315674 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:12.480339 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:12.480260 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:12.580543 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:12.580509 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:13.895198 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:13.895119 2548 generic.go:356] "Generic (PLEG): container finished" podID="32e0b6cd-f600-4e62-bd81-3dd9e971dd00" containerID="c164837d0b50518b3aa1fb530838807cda886c864b111cd4f0c7a88500ba94a7" exitCode=0 Jun 14 22:55:13.895536 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:13.895195 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" event={"ID":"32e0b6cd-f600-4e62-bd81-3dd9e971dd00","Type":"ContainerDied","Data":"c164837d0b50518b3aa1fb530838807cda886c864b111cd4f0c7a88500ba94a7"} Jun 14 22:55:15.503276 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.503243 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf"] Jun 14 22:55:15.506221 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.506202 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" Jun 14 22:55:15.508966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.508944 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 22:55:15.510011 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.509990 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5mspv\"" Jun 14 22:55:15.510118 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.510021 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 22:55:15.514367 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.514312 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf"] Jun 14 22:55:15.645502 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.645465 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1c77331-9a4d-42d5-8a0d-65010c1e015a-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xl7vf\" (UID: \"f1c77331-9a4d-42d5-8a0d-65010c1e015a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" Jun 14 22:55:15.645647 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.645528 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjjf\" (UniqueName: \"kubernetes.io/projected/f1c77331-9a4d-42d5-8a0d-65010c1e015a-kube-api-access-5hjjf\") pod \"cert-manager-webhook-7dc76cbb94-xl7vf\" (UID: \"f1c77331-9a4d-42d5-8a0d-65010c1e015a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" Jun 14 22:55:15.746050 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.746018 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1c77331-9a4d-42d5-8a0d-65010c1e015a-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xl7vf\" (UID: \"f1c77331-9a4d-42d5-8a0d-65010c1e015a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" Jun 14 22:55:15.746210 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.746070 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjjf\" (UniqueName: \"kubernetes.io/projected/f1c77331-9a4d-42d5-8a0d-65010c1e015a-kube-api-access-5hjjf\") pod \"cert-manager-webhook-7dc76cbb94-xl7vf\" (UID: \"f1c77331-9a4d-42d5-8a0d-65010c1e015a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" Jun 14 22:55:15.753966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.753860 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1c77331-9a4d-42d5-8a0d-65010c1e015a-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xl7vf\" (UID: \"f1c77331-9a4d-42d5-8a0d-65010c1e015a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" Jun 14 22:55:15.754441 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.754420 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjjf\" (UniqueName: \"kubernetes.io/projected/f1c77331-9a4d-42d5-8a0d-65010c1e015a-kube-api-access-5hjjf\") pod \"cert-manager-webhook-7dc76cbb94-xl7vf\" (UID: \"f1c77331-9a4d-42d5-8a0d-65010c1e015a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" Jun 14 22:55:15.818429 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:15.818395 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" Jun 14 22:55:16.601142 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:16.601119 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf"] Jun 14 22:55:16.603110 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:55:16.603087 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1c77331_9a4d_42d5_8a0d_65010c1e015a.slice/crio-32ff5bad132c2911ffaebcd55af277af9d6f58cf56aeee15372de36b50cc3574 WatchSource:0}: Error finding container 32ff5bad132c2911ffaebcd55af277af9d6f58cf56aeee15372de36b50cc3574: Status 404 returned error can't find the container with id 32ff5bad132c2911ffaebcd55af277af9d6f58cf56aeee15372de36b50cc3574 Jun 14 22:55:16.906296 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:16.906264 2548 generic.go:356] "Generic (PLEG): container finished" podID="32e0b6cd-f600-4e62-bd81-3dd9e971dd00" containerID="5a8b4f7bffa70df9d989b59a26157d7fd36905d7d1564ee2d2d719f282249197" exitCode=0 Jun 14 22:55:16.906445 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:16.906364 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" event={"ID":"32e0b6cd-f600-4e62-bd81-3dd9e971dd00","Type":"ContainerDied","Data":"5a8b4f7bffa70df9d989b59a26157d7fd36905d7d1564ee2d2d719f282249197"} Jun 14 22:55:16.907502 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:16.907485 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" event={"ID":"f1c77331-9a4d-42d5-8a0d-65010c1e015a","Type":"ContainerStarted","Data":"32ff5bad132c2911ffaebcd55af277af9d6f58cf56aeee15372de36b50cc3574"} Jun 14 22:55:18.519308 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:18.519193 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:20.768458 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:20.768384 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:20.874235 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:20.874197 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:20.927138 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:20.927105 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" event={"ID":"f1c77331-9a4d-42d5-8a0d-65010c1e015a","Type":"ContainerStarted","Data":"e20cf0c0e3771247dd1644cf5f6bcc806e5e5eb0ccf312fc0ec3f17fa198cd3e"} Jun 14 22:55:20.927357 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:20.927333 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" Jun 14 22:55:20.942439 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:20.942383 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" podStartSLOduration=2.036581136 podStartE2EDuration="5.94236409s" totalImagesPullingTime="3.905782954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:55:20.941031665 +0000 UTC m=+466.071483990" watchObservedRunningTime="2026-06-14 22:55:20.94236409 +0000 UTC m=+466.072816396" Jun 14 22:55:23.940514 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:23.940478 2548 generic.go:356] "Generic (PLEG): container finished" podID="32e0b6cd-f600-4e62-bd81-3dd9e971dd00" containerID="5b0eb376b96f2a9e1d5cdbd9374b6b5fa828160b7534a610a5e3380c15f51558" exitCode=0 Jun 14 22:55:23.940855 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:23.940557 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" event={"ID":"32e0b6cd-f600-4e62-bd81-3dd9e971dd00","Type":"ContainerDied","Data":"5b0eb376b96f2a9e1d5cdbd9374b6b5fa828160b7534a610a5e3380c15f51558"} Jun 14 22:55:25.067997 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.067970 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:25.223718 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.223685 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68h47\" (UniqueName: \"kubernetes.io/projected/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-kube-api-access-68h47\") pod \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\" (UID: \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\") " Jun 14 22:55:25.223884 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.223727 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-bundle\") pod \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\" (UID: \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\") " Jun 14 22:55:25.223884 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.223775 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-util\") pod \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\" (UID: \"32e0b6cd-f600-4e62-bd81-3dd9e971dd00\") " Jun 14 22:55:25.224183 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.224162 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-bundle" (OuterVolumeSpecName: "bundle") pod "32e0b6cd-f600-4e62-bd81-3dd9e971dd00" (UID: "32e0b6cd-f600-4e62-bd81-3dd9e971dd00"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:55:25.225881 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.225865 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-kube-api-access-68h47" (OuterVolumeSpecName: "kube-api-access-68h47") pod "32e0b6cd-f600-4e62-bd81-3dd9e971dd00" (UID: "32e0b6cd-f600-4e62-bd81-3dd9e971dd00"). InnerVolumeSpecName "kube-api-access-68h47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:55:25.227793 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.227772 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-util" (OuterVolumeSpecName: "util") pod "32e0b6cd-f600-4e62-bd81-3dd9e971dd00" (UID: "32e0b6cd-f600-4e62-bd81-3dd9e971dd00"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:55:25.324616 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.324565 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-util\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:55:25.324616 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.324610 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68h47\" (UniqueName: \"kubernetes.io/projected/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-kube-api-access-68h47\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:55:25.324616 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.324622 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32e0b6cd-f600-4e62-bd81-3dd9e971dd00-bundle\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:55:25.948868 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.948831 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" event={"ID":"32e0b6cd-f600-4e62-bd81-3dd9e971dd00","Type":"ContainerDied","Data":"1ddcc5826991620f6e307b0cac36ef88df474425fd349bf614afaf3df8747093"} Jun 14 22:55:25.948868 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.948865 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hxdw" Jun 14 22:55:25.949083 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:25.948918 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ddcc5826991620f6e307b0cac36ef88df474425fd349bf614afaf3df8747093" Jun 14 22:55:26.747145 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:26.747096 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:26.848159 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:26.848128 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:26.932697 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:26.932675 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xl7vf" Jun 14 22:55:33.283821 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:33.283782 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:33.338682 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:33.338625 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:35.404628 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:35.404597 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:47.651535 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:47.651503 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:47.719906 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:47.719878 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:50.500041 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:50.500003 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:50.609317 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:50.609263 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:51.120481 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.120453 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:51.445427 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.445324 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:51.553423 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.553391 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:51.570947 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.570914 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v"] Jun 14 22:55:51.571151 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.571139 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e0b6cd-f600-4e62-bd81-3dd9e971dd00" containerName="util" Jun 14 22:55:51.571196 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.571152 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e0b6cd-f600-4e62-bd81-3dd9e971dd00" containerName="util" Jun 14 22:55:51.571196 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.571160 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e0b6cd-f600-4e62-bd81-3dd9e971dd00" containerName="pull" Jun 14 22:55:51.571196 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.571165 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e0b6cd-f600-4e62-bd81-3dd9e971dd00" containerName="pull" Jun 14 22:55:51.571196 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.571173 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e0b6cd-f600-4e62-bd81-3dd9e971dd00" containerName="extract" Jun 14 22:55:51.571196 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.571178 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e0b6cd-f600-4e62-bd81-3dd9e971dd00" containerName="extract" Jun 14 22:55:51.571338 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.571218 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="32e0b6cd-f600-4e62-bd81-3dd9e971dd00" containerName="extract" Jun 14 22:55:51.577078 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.577054 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.579327 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.579308 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 22:55:51.579758 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.579741 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 22:55:51.579846 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.579770 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 22:55:51.579846 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.579814 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 22:55:51.579975 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.579843 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rxwmc\"" Jun 14 22:55:51.588281 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.588261 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ed51e43-7fa1-476b-bcef-b3b665448bfc-tmp\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.588384 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.588295 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvkh9\" (UniqueName: \"kubernetes.io/projected/3ed51e43-7fa1-476b-bcef-b3b665448bfc-kube-api-access-xvkh9\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.588384 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.588335 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ed51e43-7fa1-476b-bcef-b3b665448bfc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.588384 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.588379 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ed51e43-7fa1-476b-bcef-b3b665448bfc-manifests\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.588558 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.588418 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ed51e43-7fa1-476b-bcef-b3b665448bfc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.591761 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.591651 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v"] Jun 14 22:55:51.680502 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.680479 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:51.689639 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.689625 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ed51e43-7fa1-476b-bcef-b3b665448bfc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.689697 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.689650 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ed51e43-7fa1-476b-bcef-b3b665448bfc-tmp\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.689697 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.689671 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvkh9\" (UniqueName: \"kubernetes.io/projected/3ed51e43-7fa1-476b-bcef-b3b665448bfc-kube-api-access-xvkh9\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.689795 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.689780 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ed51e43-7fa1-476b-bcef-b3b665448bfc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.689863 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.689839 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ed51e43-7fa1-476b-bcef-b3b665448bfc-manifests\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.690226 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.690199 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ed51e43-7fa1-476b-bcef-b3b665448bfc-manifests\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.691945 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.691908 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ed51e43-7fa1-476b-bcef-b3b665448bfc-tmp\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.692049 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.692013 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ed51e43-7fa1-476b-bcef-b3b665448bfc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.692138 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.692120 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ed51e43-7fa1-476b-bcef-b3b665448bfc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.700607 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.700562 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvkh9\" (UniqueName: \"kubernetes.io/projected/3ed51e43-7fa1-476b-bcef-b3b665448bfc-kube-api-access-xvkh9\") pod \"opendatahub-operator-controller-manager-7cf75689df-t6n7v\" (UID: \"3ed51e43-7fa1-476b-bcef-b3b665448bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.780502 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.780478 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:51.881377 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.881352 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:51.887276 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.887258 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:51.984857 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:51.984827 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:52.015813 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:52.015792 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v"] Jun 14 22:55:52.018377 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:55:52.018354 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed51e43_7fa1_476b_bcef_b3b665448bfc.slice/crio-604a3a696f1af929568e689bcfe268ce6cc0c6603c1445a8b625ba8c0c6ef069 WatchSource:0}: Error finding container 604a3a696f1af929568e689bcfe268ce6cc0c6603c1445a8b625ba8c0c6ef069: Status 404 returned error can't find the container with id 604a3a696f1af929568e689bcfe268ce6cc0c6603c1445a8b625ba8c0c6ef069 Jun 14 22:55:52.039600 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:52.039578 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" event={"ID":"3ed51e43-7fa1-476b-bcef-b3b665448bfc","Type":"ContainerStarted","Data":"604a3a696f1af929568e689bcfe268ce6cc0c6603c1445a8b625ba8c0c6ef069"} Jun 14 22:55:52.054257 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:52.054232 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:52.151375 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:52.151355 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:52.252427 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:52.252375 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:55:55.052642 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:55.052579 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" event={"ID":"3ed51e43-7fa1-476b-bcef-b3b665448bfc","Type":"ContainerStarted","Data":"4f9cd710dbf72108a5f512c1645362693e5bc73520425889caf6c52928f9ba9a"} Jun 14 22:55:56.058148 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:56.058062 2548 generic.go:356] "Generic (PLEG): container finished" podID="3ed51e43-7fa1-476b-bcef-b3b665448bfc" containerID="4f9cd710dbf72108a5f512c1645362693e5bc73520425889caf6c52928f9ba9a" exitCode=0 Jun 14 22:55:56.058540 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:56.058161 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" event={"ID":"3ed51e43-7fa1-476b-bcef-b3b665448bfc","Type":"ContainerDied","Data":"4f9cd710dbf72108a5f512c1645362693e5bc73520425889caf6c52928f9ba9a"} Jun 14 22:55:57.063340 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:57.063289 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" event={"ID":"3ed51e43-7fa1-476b-bcef-b3b665448bfc","Type":"ContainerStarted","Data":"0a9f3463e694e943d0673586cd9569399f199d04f5823285b1779ace3b312d07"} Jun 14 22:55:57.063803 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:57.063399 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:55:57.082812 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:55:57.082756 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" podStartSLOduration=2.172181882 podStartE2EDuration="6.082737092s" totalImagesPullingTime="2.984567963s" totalInitContainerRuntime="925.987247ms" isStatefulPod=false podCreationTimestamp="2026-06-14 22:55:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:55:57.081009199 +0000 UTC m=+502.211461548" watchObservedRunningTime="2026-06-14 22:55:57.082737092 +0000 UTC m=+502.213189416" Jun 14 22:56:08.069050 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:08.069016 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-t6n7v" Jun 14 22:56:09.697266 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:09.697235 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:10.276535 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.276494 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:10.363721 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.363674 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:10.608748 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.608673 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:10.716638 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.716605 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:10.788854 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.788812 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f989997cb-tk98z"] Jun 14 22:56:10.796602 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.796577 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" Jun 14 22:56:10.801002 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.800982 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 22:56:10.801159 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.801141 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 22:56:10.801441 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.801426 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 22:56:10.801981 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.801969 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 22:56:10.802163 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.802144 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7bbpc\"" Jun 14 22:56:10.804720 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.804696 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:10.807681 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.807662 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f989997cb-tk98z"] Jun 14 22:56:10.824189 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.824163 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e001a7d-d5db-45bc-9e62-7791702dd19a-tls-certs\") pod \"kube-auth-proxy-7f989997cb-tk98z\" (UID: \"0e001a7d-d5db-45bc-9e62-7791702dd19a\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" Jun 14 22:56:10.824300 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.824198 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e001a7d-d5db-45bc-9e62-7791702dd19a-tmp\") pod \"kube-auth-proxy-7f989997cb-tk98z\" (UID: \"0e001a7d-d5db-45bc-9e62-7791702dd19a\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" Jun 14 22:56:10.824300 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.824293 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhrnk\" (UniqueName: \"kubernetes.io/projected/0e001a7d-d5db-45bc-9e62-7791702dd19a-kube-api-access-qhrnk\") pod \"kube-auth-proxy-7f989997cb-tk98z\" (UID: \"0e001a7d-d5db-45bc-9e62-7791702dd19a\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" Jun 14 22:56:10.832656 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.832635 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-mkxft"] Jun 14 22:56:10.836218 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.836197 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" Jun 14 22:56:10.839565 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.839545 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lptln\"" Jun 14 22:56:10.839710 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.839695 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 14 22:56:10.856862 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.856613 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-mkxft"] Jun 14 22:56:10.924737 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.924667 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e001a7d-d5db-45bc-9e62-7791702dd19a-tls-certs\") pod \"kube-auth-proxy-7f989997cb-tk98z\" (UID: \"0e001a7d-d5db-45bc-9e62-7791702dd19a\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" Jun 14 22:56:10.924737 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.924708 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e001a7d-d5db-45bc-9e62-7791702dd19a-tmp\") pod \"kube-auth-proxy-7f989997cb-tk98z\" (UID: \"0e001a7d-d5db-45bc-9e62-7791702dd19a\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" Jun 14 22:56:10.924894 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.924758 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq769\" (UniqueName: \"kubernetes.io/projected/6d2d20b1-7a42-47c9-9dca-7e0164915104-kube-api-access-lq769\") pod \"odh-model-controller-6dc94f689f-mkxft\" (UID: \"6d2d20b1-7a42-47c9-9dca-7e0164915104\") " pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" Jun 14 22:56:10.924894 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.924801 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d2d20b1-7a42-47c9-9dca-7e0164915104-cert\") pod \"odh-model-controller-6dc94f689f-mkxft\" (UID: \"6d2d20b1-7a42-47c9-9dca-7e0164915104\") " pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" Jun 14 22:56:10.924894 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.924837 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhrnk\" (UniqueName: \"kubernetes.io/projected/0e001a7d-d5db-45bc-9e62-7791702dd19a-kube-api-access-qhrnk\") pod \"kube-auth-proxy-7f989997cb-tk98z\" (UID: \"0e001a7d-d5db-45bc-9e62-7791702dd19a\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" Jun 14 22:56:10.927069 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.927047 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e001a7d-d5db-45bc-9e62-7791702dd19a-tmp\") pod \"kube-auth-proxy-7f989997cb-tk98z\" (UID: \"0e001a7d-d5db-45bc-9e62-7791702dd19a\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" Jun 14 22:56:10.927394 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.927366 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e001a7d-d5db-45bc-9e62-7791702dd19a-tls-certs\") pod \"kube-auth-proxy-7f989997cb-tk98z\" (UID: \"0e001a7d-d5db-45bc-9e62-7791702dd19a\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" Jun 14 22:56:10.927609 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.927589 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:10.933068 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:10.933044 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhrnk\" (UniqueName: \"kubernetes.io/projected/0e001a7d-d5db-45bc-9e62-7791702dd19a-kube-api-access-qhrnk\") pod \"kube-auth-proxy-7f989997cb-tk98z\" (UID: \"0e001a7d-d5db-45bc-9e62-7791702dd19a\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" Jun 14 22:56:11.022665 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.022632 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:11.025693 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.025671 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq769\" (UniqueName: \"kubernetes.io/projected/6d2d20b1-7a42-47c9-9dca-7e0164915104-kube-api-access-lq769\") pod \"odh-model-controller-6dc94f689f-mkxft\" (UID: \"6d2d20b1-7a42-47c9-9dca-7e0164915104\") " pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" Jun 14 22:56:11.025781 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.025708 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d2d20b1-7a42-47c9-9dca-7e0164915104-cert\") pod \"odh-model-controller-6dc94f689f-mkxft\" (UID: \"6d2d20b1-7a42-47c9-9dca-7e0164915104\") " pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" Jun 14 22:56:11.028149 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.028123 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d2d20b1-7a42-47c9-9dca-7e0164915104-cert\") pod \"odh-model-controller-6dc94f689f-mkxft\" (UID: \"6d2d20b1-7a42-47c9-9dca-7e0164915104\") " pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" Jun 14 22:56:11.033801 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.033775 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq769\" (UniqueName: \"kubernetes.io/projected/6d2d20b1-7a42-47c9-9dca-7e0164915104-kube-api-access-lq769\") pod \"odh-model-controller-6dc94f689f-mkxft\" (UID: \"6d2d20b1-7a42-47c9-9dca-7e0164915104\") " pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" Jun 14 22:56:11.106015 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.105981 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" Jun 14 22:56:11.127818 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.127791 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:11.146377 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.146350 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" Jun 14 22:56:11.246416 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.246370 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f989997cb-tk98z"] Jun 14 22:56:11.251700 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:56:11.251665 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e001a7d_d5db_45bc_9e62_7791702dd19a.slice/crio-ad3ef914719e0462a67223da70a7f635fddf1ef8f336f2e7e2d098af73d8aa80 WatchSource:0}: Error finding container ad3ef914719e0462a67223da70a7f635fddf1ef8f336f2e7e2d098af73d8aa80: Status 404 returned error can't find the container with id ad3ef914719e0462a67223da70a7f635fddf1ef8f336f2e7e2d098af73d8aa80 Jun 14 22:56:11.289302 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.289275 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-mkxft"] Jun 14 22:56:11.291478 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:56:11.291442 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d2d20b1_7a42_47c9_9dca_7e0164915104.slice/crio-73ec208bead2f859f1f4daef095fbafd8a4fafe84b8148c97702cda58959c954 WatchSource:0}: Error finding container 73ec208bead2f859f1f4daef095fbafd8a4fafe84b8148c97702cda58959c954: Status 404 returned error can't find the container with id 73ec208bead2f859f1f4daef095fbafd8a4fafe84b8148c97702cda58959c954 Jun 14 22:56:11.521614 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.521549 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:11.541433 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.541404 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-p5ksw"] Jun 14 22:56:11.545674 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.545658 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" Jun 14 22:56:11.547804 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.547777 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 14 22:56:11.552964 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.552889 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-p5ksw"] Jun 14 22:56:11.631943 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.631908 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/346a4127-a3b8-40f3-83d1-591a526ee5da-tls-certs\") pod \"model-serving-api-5dd488fc48-p5ksw\" (UID: \"346a4127-a3b8-40f3-83d1-591a526ee5da\") " pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" Jun 14 22:56:11.632112 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.631954 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw75t\" (UniqueName: \"kubernetes.io/projected/346a4127-a3b8-40f3-83d1-591a526ee5da-kube-api-access-zw75t\") pod \"model-serving-api-5dd488fc48-p5ksw\" (UID: \"346a4127-a3b8-40f3-83d1-591a526ee5da\") " pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" Jun 14 22:56:11.732461 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.732424 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/346a4127-a3b8-40f3-83d1-591a526ee5da-tls-certs\") pod \"model-serving-api-5dd488fc48-p5ksw\" (UID: \"346a4127-a3b8-40f3-83d1-591a526ee5da\") " pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" Jun 14 22:56:11.732461 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.732457 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw75t\" (UniqueName: \"kubernetes.io/projected/346a4127-a3b8-40f3-83d1-591a526ee5da-kube-api-access-zw75t\") pod \"model-serving-api-5dd488fc48-p5ksw\" (UID: \"346a4127-a3b8-40f3-83d1-591a526ee5da\") " pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" Jun 14 22:56:11.732900 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:56:11.732583 2548 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 14 22:56:11.732900 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:56:11.732651 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/346a4127-a3b8-40f3-83d1-591a526ee5da-tls-certs podName:346a4127-a3b8-40f3-83d1-591a526ee5da nodeName:}" failed. No retries permitted until 2026-06-14 22:56:12.232633154 +0000 UTC m=+517.363085460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/346a4127-a3b8-40f3-83d1-591a526ee5da-tls-certs") pod "model-serving-api-5dd488fc48-p5ksw" (UID: "346a4127-a3b8-40f3-83d1-591a526ee5da") : secret "model-serving-api-tls" not found Jun 14 22:56:11.740444 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:11.740420 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw75t\" (UniqueName: \"kubernetes.io/projected/346a4127-a3b8-40f3-83d1-591a526ee5da-kube-api-access-zw75t\") pod \"model-serving-api-5dd488fc48-p5ksw\" (UID: \"346a4127-a3b8-40f3-83d1-591a526ee5da\") " pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" Jun 14 22:56:12.121366 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:12.121325 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" event={"ID":"6d2d20b1-7a42-47c9-9dca-7e0164915104","Type":"ContainerStarted","Data":"73ec208bead2f859f1f4daef095fbafd8a4fafe84b8148c97702cda58959c954"} Jun 14 22:56:12.122994 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:12.122963 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" event={"ID":"0e001a7d-d5db-45bc-9e62-7791702dd19a","Type":"ContainerStarted","Data":"ad3ef914719e0462a67223da70a7f635fddf1ef8f336f2e7e2d098af73d8aa80"} Jun 14 22:56:12.242724 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:12.242688 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/346a4127-a3b8-40f3-83d1-591a526ee5da-tls-certs\") pod \"model-serving-api-5dd488fc48-p5ksw\" (UID: \"346a4127-a3b8-40f3-83d1-591a526ee5da\") " pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" Jun 14 22:56:12.242896 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:56:12.242862 2548 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 14 22:56:12.242966 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:56:12.242949 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/346a4127-a3b8-40f3-83d1-591a526ee5da-tls-certs podName:346a4127-a3b8-40f3-83d1-591a526ee5da nodeName:}" failed. No retries permitted until 2026-06-14 22:56:13.24291425 +0000 UTC m=+518.373366555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/346a4127-a3b8-40f3-83d1-591a526ee5da-tls-certs") pod "model-serving-api-5dd488fc48-p5ksw" (UID: "346a4127-a3b8-40f3-83d1-591a526ee5da") : secret "model-serving-api-tls" not found Jun 14 22:56:12.290225 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:12.290151 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:13.254089 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.254054 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/346a4127-a3b8-40f3-83d1-591a526ee5da-tls-certs\") pod \"model-serving-api-5dd488fc48-p5ksw\" (UID: \"346a4127-a3b8-40f3-83d1-591a526ee5da\") " pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" Jun 14 22:56:13.256519 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.256488 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/346a4127-a3b8-40f3-83d1-591a526ee5da-tls-certs\") pod \"model-serving-api-5dd488fc48-p5ksw\" (UID: \"346a4127-a3b8-40f3-83d1-591a526ee5da\") " pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" Jun 14 22:56:13.359133 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.359101 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" Jun 14 22:56:13.503838 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.503798 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb"] Jun 14 22:56:13.508695 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.508643 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:13.511189 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.511162 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v4tk7\"" Jun 14 22:56:13.511189 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.511182 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 22:56:13.511505 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.511485 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 22:56:13.514362 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.514309 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb"] Jun 14 22:56:13.557097 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.557065 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb\" (UID: \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:13.557287 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.557116 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xf4n\" (UniqueName: \"kubernetes.io/projected/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-kube-api-access-2xf4n\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb\" (UID: \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:13.557287 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.557180 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb\" (UID: \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:13.658358 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.658317 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb\" (UID: \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:13.658523 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.658406 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xf4n\" (UniqueName: \"kubernetes.io/projected/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-kube-api-access-2xf4n\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb\" (UID: \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:13.658523 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.658436 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb\" (UID: \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:13.658775 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.658751 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb\" (UID: \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:13.658862 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.658832 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb\" (UID: \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:13.666339 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.666316 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xf4n\" (UniqueName: \"kubernetes.io/projected/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-kube-api-access-2xf4n\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb\" (UID: \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:13.822435 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:13.822342 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:15.765668 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:15.765598 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-p5ksw"] Jun 14 22:56:15.768039 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:56:15.768015 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346a4127_a3b8_40f3_83d1_591a526ee5da.slice/crio-ba9cdaca008897b284587843a40f0823b306aad6f30fecb16de07b907eb0df7b WatchSource:0}: Error finding container ba9cdaca008897b284587843a40f0823b306aad6f30fecb16de07b907eb0df7b: Status 404 returned error can't find the container with id ba9cdaca008897b284587843a40f0823b306aad6f30fecb16de07b907eb0df7b Jun 14 22:56:15.789640 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:15.789617 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb"] Jun 14 22:56:15.792803 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:56:15.792773 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aaa52f2_63e7_4d53_ae6f_d3bdb9f25da0.slice/crio-86789787cfe30b2f4126362ca0bd86604f386fe51c6dfea56b887960eda88662 WatchSource:0}: Error finding container 86789787cfe30b2f4126362ca0bd86604f386fe51c6dfea56b887960eda88662: Status 404 returned error can't find the container with id 86789787cfe30b2f4126362ca0bd86604f386fe51c6dfea56b887960eda88662 Jun 14 22:56:16.144849 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:16.144754 2548 generic.go:356] "Generic (PLEG): container finished" podID="7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" containerID="c7387c25bf07df2974133975ebdfad012414cd8bd17dd84f92fbf4856e4d2280" exitCode=0 Jun 14 22:56:16.145033 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:16.144849 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" event={"ID":"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0","Type":"ContainerDied","Data":"c7387c25bf07df2974133975ebdfad012414cd8bd17dd84f92fbf4856e4d2280"} Jun 14 22:56:16.145033 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:16.144895 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" event={"ID":"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0","Type":"ContainerStarted","Data":"86789787cfe30b2f4126362ca0bd86604f386fe51c6dfea56b887960eda88662"} Jun 14 22:56:16.146265 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:16.146190 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" event={"ID":"346a4127-a3b8-40f3-83d1-591a526ee5da","Type":"ContainerStarted","Data":"ba9cdaca008897b284587843a40f0823b306aad6f30fecb16de07b907eb0df7b"} Jun 14 22:56:16.147992 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:16.147959 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" event={"ID":"6d2d20b1-7a42-47c9-9dca-7e0164915104","Type":"ContainerStarted","Data":"8dcdda862c796010d32f3a9f9be8ec553b971119ba9e19e617f6ac3f57261129"} Jun 14 22:56:16.148134 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:16.148111 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" Jun 14 22:56:16.149634 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:16.149610 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" event={"ID":"0e001a7d-d5db-45bc-9e62-7791702dd19a","Type":"ContainerStarted","Data":"7de1cec890848a938809051b70204f5d8d0b96912139b88090b5311e575c27a6"} Jun 14 22:56:16.175143 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:16.175099 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" podStartSLOduration=1.808825956 podStartE2EDuration="6.175087173s" totalImagesPullingTime="4.366261217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:56:16.174684849 +0000 UTC m=+521.305137197" watchObservedRunningTime="2026-06-14 22:56:16.175087173 +0000 UTC m=+521.305539498" Jun 14 22:56:16.189070 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:16.188917 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f989997cb-tk98z" podStartSLOduration=1.827718798 podStartE2EDuration="6.188902338s" totalImagesPullingTime="4.36118354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:56:16.188816683 +0000 UTC m=+521.319269044" watchObservedRunningTime="2026-06-14 22:56:16.188902338 +0000 UTC m=+521.319354663" Jun 14 22:56:18.159821 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:18.159783 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" event={"ID":"346a4127-a3b8-40f3-83d1-591a526ee5da","Type":"ContainerStarted","Data":"e7f2b887967f58f852eadc1f90761baecd2c1792c3b83d43e6f3f13c62707e9e"} Jun 14 22:56:18.160250 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:18.159848 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" Jun 14 22:56:18.161504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:18.161482 2548 generic.go:356] "Generic (PLEG): container finished" podID="7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" containerID="b38c48ab3ea0b5e2e1740ba09a458fe25689736552e4b16704c8cd9228122dab" exitCode=0 Jun 14 22:56:18.161596 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:18.161543 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" event={"ID":"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0","Type":"ContainerDied","Data":"b38c48ab3ea0b5e2e1740ba09a458fe25689736552e4b16704c8cd9228122dab"} Jun 14 22:56:18.183044 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:18.183005 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" podStartSLOduration=5.56087915 podStartE2EDuration="7.182990253s" totalImagesPullingTime="1.622111103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:56:18.181746083 +0000 UTC m=+523.312198633" watchObservedRunningTime="2026-06-14 22:56:18.182990253 +0000 UTC m=+523.313442576" Jun 14 22:56:19.167906 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:19.167871 2548 generic.go:356] "Generic (PLEG): container finished" podID="7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" containerID="dac76e71bf953d4f3c18a26505eb945c01f3ceae275892dce70fb8f9ada96da6" exitCode=0 Jun 14 22:56:19.168418 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:19.167982 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" event={"ID":"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0","Type":"ContainerDied","Data":"dac76e71bf953d4f3c18a26505eb945c01f3ceae275892dce70fb8f9ada96da6"} Jun 14 22:56:20.294958 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:20.294917 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:20.412809 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:20.412786 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-bundle\") pod \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\" (UID: \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\") " Jun 14 22:56:20.412979 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:20.412829 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xf4n\" (UniqueName: \"kubernetes.io/projected/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-kube-api-access-2xf4n\") pod \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\" (UID: \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\") " Jun 14 22:56:20.412979 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:20.412898 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-util\") pod \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\" (UID: \"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0\") " Jun 14 22:56:20.413862 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:20.413832 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-bundle" (OuterVolumeSpecName: "bundle") pod "7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" (UID: "7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:56:20.415023 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:20.414999 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-kube-api-access-2xf4n" (OuterVolumeSpecName: "kube-api-access-2xf4n") pod "7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" (UID: "7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0"). InnerVolumeSpecName "kube-api-access-2xf4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:56:20.418963 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:20.418918 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-util" (OuterVolumeSpecName: "util") pod "7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" (UID: "7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:56:20.513684 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:20.513661 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-bundle\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:56:20.513684 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:20.513684 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xf4n\" (UniqueName: \"kubernetes.io/projected/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-kube-api-access-2xf4n\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:56:20.513827 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:20.513694 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0-util\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:56:21.096070 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.096039 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:21.145389 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.145356 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-f4jrw"] Jun 14 22:56:21.145617 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.145606 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" containerName="util" Jun 14 22:56:21.145661 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.145619 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" containerName="util" Jun 14 22:56:21.145661 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.145634 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" containerName="pull" Jun 14 22:56:21.145661 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.145639 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" containerName="pull" Jun 14 22:56:21.145661 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.145650 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" containerName="extract" Jun 14 22:56:21.145661 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.145656 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" containerName="extract" Jun 14 22:56:21.145803 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.145699 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0" containerName="extract" Jun 14 22:56:21.148793 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.148773 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" Jun 14 22:56:21.151105 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.151080 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 14 22:56:21.151235 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.151127 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zcxc7\"" Jun 14 22:56:21.157691 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.157665 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk"] Jun 14 22:56:21.161052 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.161031 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-f4jrw"] Jun 14 22:56:21.161156 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.161131 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" Jun 14 22:56:21.163805 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.163787 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qwjnb\"" Jun 14 22:56:21.163903 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.163787 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 14 22:56:21.170638 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.170619 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk"] Jun 14 22:56:21.179324 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.179304 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" event={"ID":"7aaa52f2-63e7-4d53-ae6f-d3bdb9f25da0","Type":"ContainerDied","Data":"86789787cfe30b2f4126362ca0bd86604f386fe51c6dfea56b887960eda88662"} Jun 14 22:56:21.179416 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.179336 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86789787cfe30b2f4126362ca0bd86604f386fe51c6dfea56b887960eda88662" Jun 14 22:56:21.179416 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.179356 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065kbvb" Jun 14 22:56:21.191426 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.191397 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:21.219167 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.219143 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05c753b0-ca21-4e83-a607-7167ef049b14-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p2vfk\" (UID: \"05c753b0-ca21-4e83-a607-7167ef049b14\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" Jun 14 22:56:21.219254 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.219177 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2t9q\" (UniqueName: \"kubernetes.io/projected/a3b6f882-a04c-4133-adaf-290b81bdc593-kube-api-access-c2t9q\") pod \"kserve-controller-manager-69fc866d76-f4jrw\" (UID: \"a3b6f882-a04c-4133-adaf-290b81bdc593\") " pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" Jun 14 22:56:21.219254 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.219202 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3b6f882-a04c-4133-adaf-290b81bdc593-cert\") pod \"kserve-controller-manager-69fc866d76-f4jrw\" (UID: \"a3b6f882-a04c-4133-adaf-290b81bdc593\") " pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" Jun 14 22:56:21.219254 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.219245 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl4tn\" (UniqueName: \"kubernetes.io/projected/05c753b0-ca21-4e83-a607-7167ef049b14-kube-api-access-sl4tn\") pod \"llmisvc-controller-manager-864bfd7bc9-p2vfk\" (UID: \"05c753b0-ca21-4e83-a607-7167ef049b14\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" Jun 14 22:56:21.282720 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.282699 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:21.319822 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.319794 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05c753b0-ca21-4e83-a607-7167ef049b14-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p2vfk\" (UID: \"05c753b0-ca21-4e83-a607-7167ef049b14\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" Jun 14 22:56:21.320200 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.319829 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2t9q\" (UniqueName: \"kubernetes.io/projected/a3b6f882-a04c-4133-adaf-290b81bdc593-kube-api-access-c2t9q\") pod \"kserve-controller-manager-69fc866d76-f4jrw\" (UID: \"a3b6f882-a04c-4133-adaf-290b81bdc593\") " pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" Jun 14 22:56:21.320200 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.319854 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3b6f882-a04c-4133-adaf-290b81bdc593-cert\") pod \"kserve-controller-manager-69fc866d76-f4jrw\" (UID: \"a3b6f882-a04c-4133-adaf-290b81bdc593\") " pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" Jun 14 22:56:21.320200 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.319875 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl4tn\" (UniqueName: \"kubernetes.io/projected/05c753b0-ca21-4e83-a607-7167ef049b14-kube-api-access-sl4tn\") pod \"llmisvc-controller-manager-864bfd7bc9-p2vfk\" (UID: \"05c753b0-ca21-4e83-a607-7167ef049b14\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" Jun 14 22:56:21.320200 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:56:21.319983 2548 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 14 22:56:21.320200 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:56:21.320046 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b6f882-a04c-4133-adaf-290b81bdc593-cert podName:a3b6f882-a04c-4133-adaf-290b81bdc593 nodeName:}" failed. No retries permitted until 2026-06-14 22:56:21.820029119 +0000 UTC m=+526.950481424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a3b6f882-a04c-4133-adaf-290b81bdc593-cert") pod "kserve-controller-manager-69fc866d76-f4jrw" (UID: "a3b6f882-a04c-4133-adaf-290b81bdc593") : secret "kserve-webhook-server-cert" not found Jun 14 22:56:21.322293 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.322270 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05c753b0-ca21-4e83-a607-7167ef049b14-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p2vfk\" (UID: \"05c753b0-ca21-4e83-a607-7167ef049b14\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" Jun 14 22:56:21.337669 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.337646 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2t9q\" (UniqueName: \"kubernetes.io/projected/a3b6f882-a04c-4133-adaf-290b81bdc593-kube-api-access-c2t9q\") pod \"kserve-controller-manager-69fc866d76-f4jrw\" (UID: \"a3b6f882-a04c-4133-adaf-290b81bdc593\") " pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" Jun 14 22:56:21.342422 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.342390 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl4tn\" (UniqueName: \"kubernetes.io/projected/05c753b0-ca21-4e83-a607-7167ef049b14-kube-api-access-sl4tn\") pod \"llmisvc-controller-manager-864bfd7bc9-p2vfk\" (UID: \"05c753b0-ca21-4e83-a607-7167ef049b14\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" Jun 14 22:56:21.465332 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.465306 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:21.471280 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.471251 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" Jun 14 22:56:21.595921 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.595893 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk"] Jun 14 22:56:21.598732 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:56:21.598708 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod05c753b0_ca21_4e83_a607_7167ef049b14.slice/crio-885aa9930da039922823f2530a3b708f939e3e19f2ae9cae67b0e33761901e5e WatchSource:0}: Error finding container 885aa9930da039922823f2530a3b708f939e3e19f2ae9cae67b0e33761901e5e: Status 404 returned error can't find the container with id 885aa9930da039922823f2530a3b708f939e3e19f2ae9cae67b0e33761901e5e Jun 14 22:56:21.824115 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.824043 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3b6f882-a04c-4133-adaf-290b81bdc593-cert\") pod \"kserve-controller-manager-69fc866d76-f4jrw\" (UID: \"a3b6f882-a04c-4133-adaf-290b81bdc593\") " pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" Jun 14 22:56:21.826277 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:21.826255 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3b6f882-a04c-4133-adaf-290b81bdc593-cert\") pod \"kserve-controller-manager-69fc866d76-f4jrw\" (UID: \"a3b6f882-a04c-4133-adaf-290b81bdc593\") " pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" Jun 14 22:56:22.059310 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:22.059282 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" Jun 14 22:56:22.190126 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:22.189978 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" event={"ID":"05c753b0-ca21-4e83-a607-7167ef049b14","Type":"ContainerStarted","Data":"885aa9930da039922823f2530a3b708f939e3e19f2ae9cae67b0e33761901e5e"} Jun 14 22:56:22.191791 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:22.191770 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-f4jrw"] Jun 14 22:56:22.211193 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:56:22.211170 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b6f882_a04c_4133_adaf_290b81bdc593.slice/crio-9c8339c9c5ec7610bb09ad2b18c1b88af2b4cb15e9c5cf890ff7919fcb6c2bb5 WatchSource:0}: Error finding container 9c8339c9c5ec7610bb09ad2b18c1b88af2b4cb15e9c5cf890ff7919fcb6c2bb5: Status 404 returned error can't find the container with id 9c8339c9c5ec7610bb09ad2b18c1b88af2b4cb15e9c5cf890ff7919fcb6c2bb5 Jun 14 22:56:22.344942 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:22.344901 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:22.473372 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:22.473343 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:22.538792 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:22.538767 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:23.196659 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:23.196619 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" event={"ID":"a3b6f882-a04c-4133-adaf-290b81bdc593","Type":"ContainerStarted","Data":"9c8339c9c5ec7610bb09ad2b18c1b88af2b4cb15e9c5cf890ff7919fcb6c2bb5"} Jun 14 22:56:25.208091 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:25.208058 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" event={"ID":"a3b6f882-a04c-4133-adaf-290b81bdc593","Type":"ContainerStarted","Data":"a5f0b11a7da986ccddf38408b94ed57f040b5366199b677b83355eddecde3d3d"} Jun 14 22:56:25.208526 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:25.208187 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" Jun 14 22:56:25.209535 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:25.209510 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" event={"ID":"05c753b0-ca21-4e83-a607-7167ef049b14","Type":"ContainerStarted","Data":"4acd02edb987c566cf1dfc0bcffbddf7a7c8b8a20b16f0e6774495838daf360f"} Jun 14 22:56:25.209636 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:25.209618 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" Jun 14 22:56:25.224408 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:25.224320 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" podStartSLOduration=1.471912564 podStartE2EDuration="4.224304623s" totalImagesPullingTime="2.752392059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:56:25.222663674 +0000 UTC m=+530.353116049" watchObservedRunningTime="2026-06-14 22:56:25.224304623 +0000 UTC m=+530.354756946" Jun 14 22:56:25.237804 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:25.237758 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" podStartSLOduration=0.875592991 podStartE2EDuration="4.23774797s" totalImagesPullingTime="3.362154979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:56:25.236951487 +0000 UTC m=+530.367403809" watchObservedRunningTime="2026-06-14 22:56:25.23774797 +0000 UTC m=+530.368200295" Jun 14 22:56:26.809851 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:26.809808 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:26.911739 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:26.911695 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:27.156116 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:27.156052 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-mkxft" Jun 14 22:56:27.931625 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:27.931587 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:27.993895 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:27.993868 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5"] Jun 14 22:56:27.999177 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:27.999159 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:28.001593 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.001566 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 22:56:28.001813 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.001793 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 22:56:28.004115 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.004096 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v4tk7\"" Jun 14 22:56:28.009629 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.009610 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5"] Jun 14 22:56:28.022502 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.022476 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:28.075085 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.075062 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbkbc\" (UniqueName: \"kubernetes.io/projected/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-kube-api-access-qbkbc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5\" (UID: \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:28.075177 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.075091 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5\" (UID: \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:28.075177 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.075120 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5\" (UID: \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:28.175510 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.175487 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbkbc\" (UniqueName: \"kubernetes.io/projected/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-kube-api-access-qbkbc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5\" (UID: \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:28.175609 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.175518 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5\" (UID: \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:28.175609 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.175545 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5\" (UID: \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:28.175857 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.175842 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5\" (UID: \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:28.175909 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.175894 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5\" (UID: \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:28.186133 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.186077 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbkbc\" (UniqueName: \"kubernetes.io/projected/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-kube-api-access-qbkbc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5\" (UID: \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:28.308391 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.308364 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:28.457656 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.457634 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5"] Jun 14 22:56:28.459742 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:56:28.459712 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b987c1_26e3_4ede_b8ee_1f0cb1d3728a.slice/crio-acd234a5c95be2de3aea70ad331b732eda2d04a366f86a452ac8f023b3d606ca WatchSource:0}: Error finding container acd234a5c95be2de3aea70ad331b732eda2d04a366f86a452ac8f023b3d606ca: Status 404 returned error can't find the container with id acd234a5c95be2de3aea70ad331b732eda2d04a366f86a452ac8f023b3d606ca Jun 14 22:56:28.551408 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.551386 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:28.644646 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:28.644617 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:29.159476 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.159443 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:29.172384 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.172360 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-p5ksw" Jun 14 22:56:29.229154 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.229120 2548 generic.go:356] "Generic (PLEG): container finished" podID="77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" containerID="6f099826d42aea2f375ba4164c6cc16313a53ef79921c3b71e1281b7cea4319e" exitCode=0 Jun 14 22:56:29.229305 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.229174 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" event={"ID":"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a","Type":"ContainerDied","Data":"6f099826d42aea2f375ba4164c6cc16313a53ef79921c3b71e1281b7cea4319e"} Jun 14 22:56:29.229305 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.229214 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" event={"ID":"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a","Type":"ContainerStarted","Data":"acd234a5c95be2de3aea70ad331b732eda2d04a366f86a452ac8f023b3d606ca"} Jun 14 22:56:29.232834 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.232808 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-lf295"] Jun 14 22:56:29.235077 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.235058 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" Jun 14 22:56:29.237403 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.237382 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 14 22:56:29.237585 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.237565 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-plgff\"" Jun 14 22:56:29.237956 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.237922 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 14 22:56:29.251651 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.251626 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-lf295"] Jun 14 22:56:29.385757 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.385730 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/dc5a0130-96a0-4735-9ea5-12b711ba612b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-lf295\" (UID: \"dc5a0130-96a0-4735-9ea5-12b711ba612b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" Jun 14 22:56:29.385757 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.385757 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjjdq\" (UniqueName: \"kubernetes.io/projected/dc5a0130-96a0-4735-9ea5-12b711ba612b-kube-api-access-cjjdq\") pod \"servicemesh-operator3-57f65f65fb-lf295\" (UID: \"dc5a0130-96a0-4735-9ea5-12b711ba612b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" Jun 14 22:56:29.486209 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.486182 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/dc5a0130-96a0-4735-9ea5-12b711ba612b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-lf295\" (UID: \"dc5a0130-96a0-4735-9ea5-12b711ba612b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" Jun 14 22:56:29.486381 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.486226 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjjdq\" (UniqueName: \"kubernetes.io/projected/dc5a0130-96a0-4735-9ea5-12b711ba612b-kube-api-access-cjjdq\") pod \"servicemesh-operator3-57f65f65fb-lf295\" (UID: \"dc5a0130-96a0-4735-9ea5-12b711ba612b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" Jun 14 22:56:29.488650 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.488624 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/dc5a0130-96a0-4735-9ea5-12b711ba612b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-lf295\" (UID: \"dc5a0130-96a0-4735-9ea5-12b711ba612b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" Jun 14 22:56:29.499173 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.499150 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjjdq\" (UniqueName: \"kubernetes.io/projected/dc5a0130-96a0-4735-9ea5-12b711ba612b-kube-api-access-cjjdq\") pod \"servicemesh-operator3-57f65f65fb-lf295\" (UID: \"dc5a0130-96a0-4735-9ea5-12b711ba612b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" Jun 14 22:56:29.545158 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.545134 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" Jun 14 22:56:29.673707 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:29.673678 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-lf295"] Jun 14 22:56:29.676839 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:56:29.676817 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5a0130_96a0_4735_9ea5_12b711ba612b.slice/crio-8a95c7090ed4246bc0d49330cfcedb09c0a02b755f9c2263ab22b13c25ac4dd8 WatchSource:0}: Error finding container 8a95c7090ed4246bc0d49330cfcedb09c0a02b755f9c2263ab22b13c25ac4dd8: Status 404 returned error can't find the container with id 8a95c7090ed4246bc0d49330cfcedb09c0a02b755f9c2263ab22b13c25ac4dd8 Jun 14 22:56:30.235072 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:30.235039 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" event={"ID":"dc5a0130-96a0-4735-9ea5-12b711ba612b","Type":"ContainerStarted","Data":"8a95c7090ed4246bc0d49330cfcedb09c0a02b755f9c2263ab22b13c25ac4dd8"} Jun 14 22:56:34.258726 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:34.257925 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" event={"ID":"dc5a0130-96a0-4735-9ea5-12b711ba612b","Type":"ContainerStarted","Data":"0a30d610b38f9907efbfe9fc0efaecebab6b851c6346d34c94281a3715e3255e"} Jun 14 22:56:34.258726 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:34.258674 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" Jun 14 22:56:34.277592 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:34.277521 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" podStartSLOduration=0.879622082 podStartE2EDuration="5.277500559s" totalImagesPullingTime="4.397878477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:56:34.275984886 +0000 UTC m=+539.406437232" watchObservedRunningTime="2026-06-14 22:56:34.277500559 +0000 UTC m=+539.407952884" Jun 14 22:56:35.457844 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.457807 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s"] Jun 14 22:56:35.461630 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.461611 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.463089 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.463061 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:35.463680 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.463656 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 14 22:56:35.463794 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.463681 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 22:56:35.463985 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.463965 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 14 22:56:35.464128 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.464104 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 14 22:56:35.464239 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.464142 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-p98ln\"" Jun 14 22:56:35.472065 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.472044 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s"] Jun 14 22:56:35.524259 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.524221 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:35.536383 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.536362 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/67e73129-2bcb-4a04-9b47-b979497fa4ae-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.536510 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.536390 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cb5t\" (UniqueName: \"kubernetes.io/projected/67e73129-2bcb-4a04-9b47-b979497fa4ae-kube-api-access-5cb5t\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.536510 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.536410 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/67e73129-2bcb-4a04-9b47-b979497fa4ae-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.536618 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.536506 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/67e73129-2bcb-4a04-9b47-b979497fa4ae-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.536618 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.536535 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67e73129-2bcb-4a04-9b47-b979497fa4ae-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.536618 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.536574 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67e73129-2bcb-4a04-9b47-b979497fa4ae-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.536762 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.536622 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/67e73129-2bcb-4a04-9b47-b979497fa4ae-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.640994 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.637687 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/67e73129-2bcb-4a04-9b47-b979497fa4ae-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.641110 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.641025 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67e73129-2bcb-4a04-9b47-b979497fa4ae-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.641110 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.641076 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67e73129-2bcb-4a04-9b47-b979497fa4ae-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.641110 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.641097 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/67e73129-2bcb-4a04-9b47-b979497fa4ae-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.641274 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.641129 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/67e73129-2bcb-4a04-9b47-b979497fa4ae-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.641274 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.641158 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cb5t\" (UniqueName: \"kubernetes.io/projected/67e73129-2bcb-4a04-9b47-b979497fa4ae-kube-api-access-5cb5t\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.641274 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.641188 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/67e73129-2bcb-4a04-9b47-b979497fa4ae-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.642101 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.642078 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/67e73129-2bcb-4a04-9b47-b979497fa4ae-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.644154 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.644127 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/67e73129-2bcb-4a04-9b47-b979497fa4ae-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.644236 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.644153 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/67e73129-2bcb-4a04-9b47-b979497fa4ae-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.644236 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.644216 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/67e73129-2bcb-4a04-9b47-b979497fa4ae-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.644304 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.644256 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67e73129-2bcb-4a04-9b47-b979497fa4ae-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.648312 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.648293 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67e73129-2bcb-4a04-9b47-b979497fa4ae-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.648781 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.648760 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cb5t\" (UniqueName: \"kubernetes.io/projected/67e73129-2bcb-4a04-9b47-b979497fa4ae-kube-api-access-5cb5t\") pod \"istiod-openshift-gateway-75c67f8887-47n5s\" (UID: \"67e73129-2bcb-4a04-9b47-b979497fa4ae\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.771548 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.771521 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:35.927175 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:35.927151 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s"] Jun 14 22:56:35.929787 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:56:35.929758 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67e73129_2bcb_4a04_9b47_b979497fa4ae.slice/crio-faddc0a2573abcf7afd5661f5919b2711fc43a866bf6cc21d85fc16c085aa965 WatchSource:0}: Error finding container faddc0a2573abcf7afd5661f5919b2711fc43a866bf6cc21d85fc16c085aa965: Status 404 returned error can't find the container with id faddc0a2573abcf7afd5661f5919b2711fc43a866bf6cc21d85fc16c085aa965 Jun 14 22:56:36.036625 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:36.036536 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:36.269084 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:36.269041 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" event={"ID":"67e73129-2bcb-4a04-9b47-b979497fa4ae","Type":"ContainerStarted","Data":"faddc0a2573abcf7afd5661f5919b2711fc43a866bf6cc21d85fc16c085aa965"} Jun 14 22:56:37.277548 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:37.277510 2548 generic.go:356] "Generic (PLEG): container finished" podID="77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" containerID="8a9232a0648ce83228b3bc65db9706baac966ec42c6754e92a8e390b0b6de66d" exitCode=0 Jun 14 22:56:37.278013 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:37.277592 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" event={"ID":"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a","Type":"ContainerDied","Data":"8a9232a0648ce83228b3bc65db9706baac966ec42c6754e92a8e390b0b6de66d"} Jun 14 22:56:38.285830 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:38.285792 2548 generic.go:356] "Generic (PLEG): container finished" podID="77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" containerID="42e3ed56c6a758c5d0b97dd4d07696c0a903ebd4d712d9ae3c8ab86037851943" exitCode=0 Jun 14 22:56:38.286271 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:38.285878 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" event={"ID":"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a","Type":"ContainerDied","Data":"42e3ed56c6a758c5d0b97dd4d07696c0a903ebd4d712d9ae3c8ab86037851943"} Jun 14 22:56:38.882204 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:38.882169 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:38.903331 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:38.903287 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 22:56:38.903446 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:38.903365 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 22:56:38.983512 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:38.983490 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:39.292785 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.292748 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" event={"ID":"67e73129-2bcb-4a04-9b47-b979497fa4ae","Type":"ContainerStarted","Data":"f9ff0221c9fb4d32e61d74f07d606a47df55493b6e075b31636858e80e1a59c9"} Jun 14 22:56:39.293267 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.292941 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:39.294791 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.294767 2548 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-47n5s container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 14 22:56:39.294907 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.294815 2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" podUID="67e73129-2bcb-4a04-9b47-b979497fa4ae" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 22:56:39.312184 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.312135 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" podStartSLOduration=1.341562885 podStartE2EDuration="4.312117812s" totalImagesPullingTime="2.970554927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:56:39.310110011 +0000 UTC m=+544.440562334" watchObservedRunningTime="2026-06-14 22:56:39.312117812 +0000 UTC m=+544.442570137" Jun 14 22:56:39.420633 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.420608 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:39.575507 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.575437 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbkbc\" (UniqueName: \"kubernetes.io/projected/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-kube-api-access-qbkbc\") pod \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\" (UID: \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\") " Jun 14 22:56:39.575507 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.575495 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-util\") pod \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\" (UID: \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\") " Jun 14 22:56:39.575656 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.575560 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-bundle\") pod \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\" (UID: \"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a\") " Jun 14 22:56:39.576637 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.576604 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-bundle" (OuterVolumeSpecName: "bundle") pod "77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" (UID: "77b987c1-26e3-4ede-b8ee-1f0cb1d3728a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:56:39.577466 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.577444 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-kube-api-access-qbkbc" (OuterVolumeSpecName: "kube-api-access-qbkbc") pod "77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" (UID: "77b987c1-26e3-4ede-b8ee-1f0cb1d3728a"). InnerVolumeSpecName "kube-api-access-qbkbc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:56:39.579903 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.579872 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-util" (OuterVolumeSpecName: "util") pod "77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" (UID: "77b987c1-26e3-4ede-b8ee-1f0cb1d3728a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:56:39.676878 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.676840 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-bundle\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:56:39.677077 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.677037 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbkbc\" (UniqueName: \"kubernetes.io/projected/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-kube-api-access-qbkbc\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:56:39.677077 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.677069 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77b987c1-26e3-4ede-b8ee-1f0cb1d3728a-util\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:56:39.708357 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.708320 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:39.806503 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:39.806462 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:40.073807 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:40.073780 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:40.177557 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:40.177523 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:40.270029 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:40.269991 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:40.299378 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:40.299350 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" Jun 14 22:56:40.299711 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:40.299384 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9tvb5" event={"ID":"77b987c1-26e3-4ede-b8ee-1f0cb1d3728a","Type":"ContainerDied","Data":"acd234a5c95be2de3aea70ad331b732eda2d04a366f86a452ac8f023b3d606ca"} Jun 14 22:56:40.299711 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:40.299468 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acd234a5c95be2de3aea70ad331b732eda2d04a366f86a452ac8f023b3d606ca" Jun 14 22:56:40.300277 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:40.300255 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-47n5s" Jun 14 22:56:41.025435 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.025398 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7dcf6b5898-8jccl"] Jun 14 22:56:41.025825 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.025806 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" containerName="pull" Jun 14 22:56:41.025865 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.025831 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" containerName="pull" Jun 14 22:56:41.025865 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.025860 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" containerName="util" Jun 14 22:56:41.025944 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.025869 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" containerName="util" Jun 14 22:56:41.025944 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.025882 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" containerName="extract" Jun 14 22:56:41.025944 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.025891 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" containerName="extract" Jun 14 22:56:41.026033 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.026000 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="77b987c1-26e3-4ede-b8ee-1f0cb1d3728a" containerName="extract" Jun 14 22:56:41.028310 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.028287 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7dcf6b5898-8jccl" Jun 14 22:56:41.030594 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.030575 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7xlvg\"" Jun 14 22:56:41.030723 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.030692 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 22:56:41.038247 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.038229 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7dcf6b5898-8jccl"] Jun 14 22:56:41.050661 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.050632 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:41.191137 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.191109 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3f8c8879-1d24-4ff5-8d17-2924ec681577-redirect-config\") pod \"dashboard-redirect-7dcf6b5898-8jccl\" (UID: \"3f8c8879-1d24-4ff5-8d17-2924ec681577\") " pod="opendatahub/dashboard-redirect-7dcf6b5898-8jccl" Jun 14 22:56:41.191137 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.191142 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx4ns\" (UniqueName: \"kubernetes.io/projected/3f8c8879-1d24-4ff5-8d17-2924ec681577-kube-api-access-kx4ns\") pod \"dashboard-redirect-7dcf6b5898-8jccl\" (UID: \"3f8c8879-1d24-4ff5-8d17-2924ec681577\") " pod="opendatahub/dashboard-redirect-7dcf6b5898-8jccl" Jun 14 22:56:41.291822 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.291749 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3f8c8879-1d24-4ff5-8d17-2924ec681577-redirect-config\") pod \"dashboard-redirect-7dcf6b5898-8jccl\" (UID: \"3f8c8879-1d24-4ff5-8d17-2924ec681577\") " pod="opendatahub/dashboard-redirect-7dcf6b5898-8jccl" Jun 14 22:56:41.291822 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.291789 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx4ns\" (UniqueName: \"kubernetes.io/projected/3f8c8879-1d24-4ff5-8d17-2924ec681577-kube-api-access-kx4ns\") pod \"dashboard-redirect-7dcf6b5898-8jccl\" (UID: \"3f8c8879-1d24-4ff5-8d17-2924ec681577\") " pod="opendatahub/dashboard-redirect-7dcf6b5898-8jccl" Jun 14 22:56:41.292420 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.292400 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3f8c8879-1d24-4ff5-8d17-2924ec681577-redirect-config\") pod \"dashboard-redirect-7dcf6b5898-8jccl\" (UID: \"3f8c8879-1d24-4ff5-8d17-2924ec681577\") " pod="opendatahub/dashboard-redirect-7dcf6b5898-8jccl" Jun 14 22:56:41.299334 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.299312 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx4ns\" (UniqueName: \"kubernetes.io/projected/3f8c8879-1d24-4ff5-8d17-2924ec681577-kube-api-access-kx4ns\") pod \"dashboard-redirect-7dcf6b5898-8jccl\" (UID: \"3f8c8879-1d24-4ff5-8d17-2924ec681577\") " pod="opendatahub/dashboard-redirect-7dcf6b5898-8jccl" Jun 14 22:56:41.340034 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.340008 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7dcf6b5898-8jccl" Jun 14 22:56:41.476110 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:41.476009 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7dcf6b5898-8jccl"] Jun 14 22:56:41.478075 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:56:41.478048 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8c8879_1d24_4ff5_8d17_2924ec681577.slice/crio-2ba4db0dd2be58deea87d9b202c5cb746930db5b650284fc37be1068076f7b7b WatchSource:0}: Error finding container 2ba4db0dd2be58deea87d9b202c5cb746930db5b650284fc37be1068076f7b7b: Status 404 returned error can't find the container with id 2ba4db0dd2be58deea87d9b202c5cb746930db5b650284fc37be1068076f7b7b Jun 14 22:56:42.311081 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:42.311044 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7dcf6b5898-8jccl" event={"ID":"3f8c8879-1d24-4ff5-8d17-2924ec681577","Type":"ContainerStarted","Data":"2ba4db0dd2be58deea87d9b202c5cb746930db5b650284fc37be1068076f7b7b"} Jun 14 22:56:44.320898 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:44.320858 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7dcf6b5898-8jccl" event={"ID":"3f8c8879-1d24-4ff5-8d17-2924ec681577","Type":"ContainerStarted","Data":"d74be93144626af175db5655da6286e4bf3521ac937386e92c4bdd0b3a7dc945"} Jun 14 22:56:44.335500 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:44.335424 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7dcf6b5898-8jccl" podStartSLOduration=1.378571698 podStartE2EDuration="3.335404894s" totalImagesPullingTime="1.956833196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:56:44.335216885 +0000 UTC m=+549.465669205" watchObservedRunningTime="2026-06-14 22:56:44.335404894 +0000 UTC m=+549.465857219" Jun 14 22:56:45.927751 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:45.927714 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:46.030028 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:46.029994 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:56:46.270617 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:46.270596 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lf295" Jun 14 22:56:56.219557 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:56.216847 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p2vfk" Jun 14 22:56:56.222013 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:56:56.221987 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-f4jrw" Jun 14 22:57:11.175786 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:11.175752 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:57:11.274672 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:11.274635 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:57:11.330539 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:11.330505 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:57:12.087445 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:12.087406 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:57:12.292914 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:12.292883 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:57:35.327969 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:35.327924 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 22:57:35.328438 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:35.328248 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 22:57:38.515957 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.514471 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5"] Jun 14 22:57:38.519742 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.519720 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:38.522472 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.522443 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 22:57:38.523372 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.523329 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5"] Jun 14 22:57:38.523487 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.523375 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cv5t5\"" Jun 14 22:57:38.523487 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.523434 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 22:57:38.559576 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.559551 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4pzf\" (UniqueName: \"kubernetes.io/projected/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-kube-api-access-h4pzf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5\" (UID: \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:38.559690 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.559587 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5\" (UID: \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:38.559690 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.559658 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5\" (UID: \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:38.612567 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.612538 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9"] Jun 14 22:57:38.615735 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.615721 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:38.623564 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.623540 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9"] Jun 14 22:57:38.660340 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.660317 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5\" (UID: \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:38.660436 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.660348 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d94a73c-e405-4b64-8cfb-67fb59b3b630-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9\" (UID: \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:38.660436 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.660366 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qx55\" (UniqueName: \"kubernetes.io/projected/4d94a73c-e405-4b64-8cfb-67fb59b3b630-kube-api-access-7qx55\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9\" (UID: \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:38.660436 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.660397 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4pzf\" (UniqueName: \"kubernetes.io/projected/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-kube-api-access-h4pzf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5\" (UID: \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:38.660566 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.660494 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5\" (UID: \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:38.660566 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.660517 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d94a73c-e405-4b64-8cfb-67fb59b3b630-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9\" (UID: \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:38.660669 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.660652 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5\" (UID: \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:38.660817 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.660802 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5\" (UID: \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:38.667743 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.667727 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4pzf\" (UniqueName: \"kubernetes.io/projected/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-kube-api-access-h4pzf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5\" (UID: \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:38.761114 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.761094 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d94a73c-e405-4b64-8cfb-67fb59b3b630-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9\" (UID: \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:38.761210 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.761136 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d94a73c-e405-4b64-8cfb-67fb59b3b630-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9\" (UID: \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:38.761210 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.761157 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qx55\" (UniqueName: \"kubernetes.io/projected/4d94a73c-e405-4b64-8cfb-67fb59b3b630-kube-api-access-7qx55\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9\" (UID: \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:38.761410 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.761390 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d94a73c-e405-4b64-8cfb-67fb59b3b630-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9\" (UID: \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:38.761476 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.761434 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d94a73c-e405-4b64-8cfb-67fb59b3b630-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9\" (UID: \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:38.768827 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.768778 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qx55\" (UniqueName: \"kubernetes.io/projected/4d94a73c-e405-4b64-8cfb-67fb59b3b630-kube-api-access-7qx55\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9\" (UID: \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:38.831032 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.831008 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:38.914294 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.914092 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht"] Jun 14 22:57:38.918164 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.918142 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:38.927454 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.924737 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:38.927454 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.926908 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht"] Jun 14 22:57:38.962892 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.962853 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9b598ca-049f-4d52-b7a6-57308e36b228-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht\" (UID: \"f9b598ca-049f-4d52-b7a6-57308e36b228\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:38.963061 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.962907 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9b598ca-049f-4d52-b7a6-57308e36b228-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht\" (UID: \"f9b598ca-049f-4d52-b7a6-57308e36b228\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:38.963061 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.962985 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsq6q\" (UniqueName: \"kubernetes.io/projected/f9b598ca-049f-4d52-b7a6-57308e36b228-kube-api-access-rsq6q\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht\" (UID: \"f9b598ca-049f-4d52-b7a6-57308e36b228\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:38.972029 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:38.971996 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5"] Jun 14 22:57:38.974519 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:57:38.974493 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12faea3e_3db7_4bc7_93bc_21b3028a3b5f.slice/crio-0a2b018d6a53550dd4813bf1ec70f11599e5b5f115c76584714241ac3d3185c8 WatchSource:0}: Error finding container 0a2b018d6a53550dd4813bf1ec70f11599e5b5f115c76584714241ac3d3185c8: Status 404 returned error can't find the container with id 0a2b018d6a53550dd4813bf1ec70f11599e5b5f115c76584714241ac3d3185c8 Jun 14 22:57:39.063128 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.062899 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9"] Jun 14 22:57:39.064516 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.064485 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9b598ca-049f-4d52-b7a6-57308e36b228-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht\" (UID: \"f9b598ca-049f-4d52-b7a6-57308e36b228\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:39.064622 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.064546 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsq6q\" (UniqueName: \"kubernetes.io/projected/f9b598ca-049f-4d52-b7a6-57308e36b228-kube-api-access-rsq6q\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht\" (UID: \"f9b598ca-049f-4d52-b7a6-57308e36b228\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:39.064673 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.064634 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9b598ca-049f-4d52-b7a6-57308e36b228-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht\" (UID: \"f9b598ca-049f-4d52-b7a6-57308e36b228\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:39.064861 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.064835 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9b598ca-049f-4d52-b7a6-57308e36b228-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht\" (UID: \"f9b598ca-049f-4d52-b7a6-57308e36b228\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:39.065054 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.065026 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9b598ca-049f-4d52-b7a6-57308e36b228-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht\" (UID: \"f9b598ca-049f-4d52-b7a6-57308e36b228\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:39.065180 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:57:39.065161 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d94a73c_e405_4b64_8cfb_67fb59b3b630.slice/crio-0b273302766350abb40b961b6d1c255dde8cccaa78691354477e2d0a4478590e WatchSource:0}: Error finding container 0b273302766350abb40b961b6d1c255dde8cccaa78691354477e2d0a4478590e: Status 404 returned error can't find the container with id 0b273302766350abb40b961b6d1c255dde8cccaa78691354477e2d0a4478590e Jun 14 22:57:39.072230 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.072215 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsq6q\" (UniqueName: \"kubernetes.io/projected/f9b598ca-049f-4d52-b7a6-57308e36b228-kube-api-access-rsq6q\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht\" (UID: \"f9b598ca-049f-4d52-b7a6-57308e36b228\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:39.230993 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.230969 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:39.310664 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.310638 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz"] Jun 14 22:57:39.314308 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.314291 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:39.323380 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.323354 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz"] Jun 14 22:57:39.354777 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.354749 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht"] Jun 14 22:57:39.357006 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:57:39.356983 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b598ca_049f_4d52_b7a6_57308e36b228.slice/crio-038f7e324bfa8bc628186b5420b5c5fe96e4aff93251204ef6b4bd7c00683020 WatchSource:0}: Error finding container 038f7e324bfa8bc628186b5420b5c5fe96e4aff93251204ef6b4bd7c00683020: Status 404 returned error can't find the container with id 038f7e324bfa8bc628186b5420b5c5fe96e4aff93251204ef6b4bd7c00683020 Jun 14 22:57:39.368322 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.368301 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d597e994-6184-47a4-be52-4dcb8f9c3cba-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz\" (UID: \"d597e994-6184-47a4-be52-4dcb8f9c3cba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:39.368399 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.368364 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbn8g\" (UniqueName: \"kubernetes.io/projected/d597e994-6184-47a4-be52-4dcb8f9c3cba-kube-api-access-fbn8g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz\" (UID: \"d597e994-6184-47a4-be52-4dcb8f9c3cba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:39.368493 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.368471 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d597e994-6184-47a4-be52-4dcb8f9c3cba-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz\" (UID: \"d597e994-6184-47a4-be52-4dcb8f9c3cba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:39.469682 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.469645 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbn8g\" (UniqueName: \"kubernetes.io/projected/d597e994-6184-47a4-be52-4dcb8f9c3cba-kube-api-access-fbn8g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz\" (UID: \"d597e994-6184-47a4-be52-4dcb8f9c3cba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:39.469839 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.469819 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d597e994-6184-47a4-be52-4dcb8f9c3cba-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz\" (UID: \"d597e994-6184-47a4-be52-4dcb8f9c3cba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:39.469896 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.469863 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d597e994-6184-47a4-be52-4dcb8f9c3cba-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz\" (UID: \"d597e994-6184-47a4-be52-4dcb8f9c3cba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:39.470237 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.470219 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d597e994-6184-47a4-be52-4dcb8f9c3cba-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz\" (UID: \"d597e994-6184-47a4-be52-4dcb8f9c3cba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:39.470280 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.470233 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d597e994-6184-47a4-be52-4dcb8f9c3cba-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz\" (UID: \"d597e994-6184-47a4-be52-4dcb8f9c3cba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:39.478012 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.477994 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbn8g\" (UniqueName: \"kubernetes.io/projected/d597e994-6184-47a4-be52-4dcb8f9c3cba-kube-api-access-fbn8g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz\" (UID: \"d597e994-6184-47a4-be52-4dcb8f9c3cba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:39.557553 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.557490 2548 generic.go:356] "Generic (PLEG): container finished" podID="12faea3e-3db7-4bc7-93bc-21b3028a3b5f" containerID="f0ee151431bb5269c160b4a5008aa19c3da68ad849de22b6d99ae54cce4eff12" exitCode=0 Jun 14 22:57:39.557869 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.557568 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" event={"ID":"12faea3e-3db7-4bc7-93bc-21b3028a3b5f","Type":"ContainerDied","Data":"f0ee151431bb5269c160b4a5008aa19c3da68ad849de22b6d99ae54cce4eff12"} Jun 14 22:57:39.557869 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.557619 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" event={"ID":"12faea3e-3db7-4bc7-93bc-21b3028a3b5f","Type":"ContainerStarted","Data":"0a2b018d6a53550dd4813bf1ec70f11599e5b5f115c76584714241ac3d3185c8"} Jun 14 22:57:39.558105 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.558089 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 22:57:39.559124 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.559103 2548 generic.go:356] "Generic (PLEG): container finished" podID="f9b598ca-049f-4d52-b7a6-57308e36b228" containerID="5f859091cb69a04bd53a393fa1e8a0ce85b8d3af23c45bcf66b2be8440932ae6" exitCode=0 Jun 14 22:57:39.559210 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.559187 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" event={"ID":"f9b598ca-049f-4d52-b7a6-57308e36b228","Type":"ContainerDied","Data":"5f859091cb69a04bd53a393fa1e8a0ce85b8d3af23c45bcf66b2be8440932ae6"} Jun 14 22:57:39.559267 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.559229 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" event={"ID":"f9b598ca-049f-4d52-b7a6-57308e36b228","Type":"ContainerStarted","Data":"038f7e324bfa8bc628186b5420b5c5fe96e4aff93251204ef6b4bd7c00683020"} Jun 14 22:57:39.560619 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.560600 2548 generic.go:356] "Generic (PLEG): container finished" podID="4d94a73c-e405-4b64-8cfb-67fb59b3b630" containerID="d1982cb38152a3b1c0980049d6e121035f17692453840340f5baab7ec47078cb" exitCode=0 Jun 14 22:57:39.560705 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.560679 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" event={"ID":"4d94a73c-e405-4b64-8cfb-67fb59b3b630","Type":"ContainerDied","Data":"d1982cb38152a3b1c0980049d6e121035f17692453840340f5baab7ec47078cb"} Jun 14 22:57:39.560756 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.560722 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" event={"ID":"4d94a73c-e405-4b64-8cfb-67fb59b3b630","Type":"ContainerStarted","Data":"0b273302766350abb40b961b6d1c255dde8cccaa78691354477e2d0a4478590e"} Jun 14 22:57:39.625210 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.625191 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:39.751714 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:39.751667 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz"] Jun 14 22:57:39.753340 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:57:39.753314 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd597e994_6184_47a4_be52_4dcb8f9c3cba.slice/crio-cbfe2dbed18463935af7de6f4e7edcf8afce2ec2a5c123c1c2c0255932abc451 WatchSource:0}: Error finding container cbfe2dbed18463935af7de6f4e7edcf8afce2ec2a5c123c1c2c0255932abc451: Status 404 returned error can't find the container with id cbfe2dbed18463935af7de6f4e7edcf8afce2ec2a5c123c1c2c0255932abc451 Jun 14 22:57:40.567050 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:40.567015 2548 generic.go:356] "Generic (PLEG): container finished" podID="f9b598ca-049f-4d52-b7a6-57308e36b228" containerID="fd29fb8480ddb13bb27e39080b5900f9268eb66e37ba484956c68f4a02155279" exitCode=0 Jun 14 22:57:40.567420 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:40.567085 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" event={"ID":"f9b598ca-049f-4d52-b7a6-57308e36b228","Type":"ContainerDied","Data":"fd29fb8480ddb13bb27e39080b5900f9268eb66e37ba484956c68f4a02155279"} Jun 14 22:57:40.569137 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:40.569118 2548 generic.go:356] "Generic (PLEG): container finished" podID="4d94a73c-e405-4b64-8cfb-67fb59b3b630" containerID="c17cc529235f0da2958e5fc690a1000c18eab7b2f6c33f3405389f033ef93076" exitCode=0 Jun 14 22:57:40.569257 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:40.569184 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" event={"ID":"4d94a73c-e405-4b64-8cfb-67fb59b3b630","Type":"ContainerDied","Data":"c17cc529235f0da2958e5fc690a1000c18eab7b2f6c33f3405389f033ef93076"} Jun 14 22:57:40.570777 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:40.570751 2548 generic.go:356] "Generic (PLEG): container finished" podID="d597e994-6184-47a4-be52-4dcb8f9c3cba" containerID="e7b25d71c9718b33e9b123fdf0b0cb56123ee23050368c024fe1474869802d81" exitCode=0 Jun 14 22:57:40.570884 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:40.570778 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" event={"ID":"d597e994-6184-47a4-be52-4dcb8f9c3cba","Type":"ContainerDied","Data":"e7b25d71c9718b33e9b123fdf0b0cb56123ee23050368c024fe1474869802d81"} Jun 14 22:57:40.570884 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:40.570824 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" event={"ID":"d597e994-6184-47a4-be52-4dcb8f9c3cba","Type":"ContainerStarted","Data":"cbfe2dbed18463935af7de6f4e7edcf8afce2ec2a5c123c1c2c0255932abc451"} Jun 14 22:57:40.573509 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:40.573459 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" event={"ID":"12faea3e-3db7-4bc7-93bc-21b3028a3b5f","Type":"ContainerStarted","Data":"59f5cfe2a6708faeb8b0214c656ee0643c74a597a847d145745ebe86b8737667"} Jun 14 22:57:41.580031 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:41.579970 2548 generic.go:356] "Generic (PLEG): container finished" podID="12faea3e-3db7-4bc7-93bc-21b3028a3b5f" containerID="59f5cfe2a6708faeb8b0214c656ee0643c74a597a847d145745ebe86b8737667" exitCode=0 Jun 14 22:57:41.580342 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:41.580056 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" event={"ID":"12faea3e-3db7-4bc7-93bc-21b3028a3b5f","Type":"ContainerDied","Data":"59f5cfe2a6708faeb8b0214c656ee0643c74a597a847d145745ebe86b8737667"} Jun 14 22:57:41.582422 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:41.582390 2548 generic.go:356] "Generic (PLEG): container finished" podID="f9b598ca-049f-4d52-b7a6-57308e36b228" containerID="b3d1bc10fe6c65061a8cf3e5eecd99dde371c77cd975572cbe70bec4b0d9d469" exitCode=0 Jun 14 22:57:41.582514 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:41.582430 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" event={"ID":"f9b598ca-049f-4d52-b7a6-57308e36b228","Type":"ContainerDied","Data":"b3d1bc10fe6c65061a8cf3e5eecd99dde371c77cd975572cbe70bec4b0d9d469"} Jun 14 22:57:41.584620 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:41.584600 2548 generic.go:356] "Generic (PLEG): container finished" podID="4d94a73c-e405-4b64-8cfb-67fb59b3b630" containerID="ecff277c79cb8c6b507c9f8c6dc259ec71293b56dd0f1bd06283137a64096297" exitCode=0 Jun 14 22:57:41.584706 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:41.584673 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" event={"ID":"4d94a73c-e405-4b64-8cfb-67fb59b3b630","Type":"ContainerDied","Data":"ecff277c79cb8c6b507c9f8c6dc259ec71293b56dd0f1bd06283137a64096297"} Jun 14 22:57:41.586586 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:41.586566 2548 generic.go:356] "Generic (PLEG): container finished" podID="d597e994-6184-47a4-be52-4dcb8f9c3cba" containerID="8e19e7c40ff37aa20513770bf2299bd852873746a974021e7e2b80f3761a3852" exitCode=0 Jun 14 22:57:41.586683 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:41.586602 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" event={"ID":"d597e994-6184-47a4-be52-4dcb8f9c3cba","Type":"ContainerDied","Data":"8e19e7c40ff37aa20513770bf2299bd852873746a974021e7e2b80f3761a3852"} Jun 14 22:57:42.594545 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.594513 2548 generic.go:356] "Generic (PLEG): container finished" podID="12faea3e-3db7-4bc7-93bc-21b3028a3b5f" containerID="e5644c1f892aacd1754b9dbe1350451d151d0c2a6f7f4dc55ec364f2c9580af5" exitCode=0 Jun 14 22:57:42.594980 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.594601 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" event={"ID":"12faea3e-3db7-4bc7-93bc-21b3028a3b5f","Type":"ContainerDied","Data":"e5644c1f892aacd1754b9dbe1350451d151d0c2a6f7f4dc55ec364f2c9580af5"} Jun 14 22:57:42.596583 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.596559 2548 generic.go:356] "Generic (PLEG): container finished" podID="d597e994-6184-47a4-be52-4dcb8f9c3cba" containerID="ead7f6462262381dc7a4f0abc6060cc65a689a93a1ef50de305f90afb8649d28" exitCode=0 Jun 14 22:57:42.596714 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.596640 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" event={"ID":"d597e994-6184-47a4-be52-4dcb8f9c3cba","Type":"ContainerDied","Data":"ead7f6462262381dc7a4f0abc6060cc65a689a93a1ef50de305f90afb8649d28"} Jun 14 22:57:42.743647 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.743623 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:42.790511 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.790492 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:42.794550 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.794532 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9b598ca-049f-4d52-b7a6-57308e36b228-util\") pod \"f9b598ca-049f-4d52-b7a6-57308e36b228\" (UID: \"f9b598ca-049f-4d52-b7a6-57308e36b228\") " Jun 14 22:57:42.794639 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.794603 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9b598ca-049f-4d52-b7a6-57308e36b228-bundle\") pod \"f9b598ca-049f-4d52-b7a6-57308e36b228\" (UID: \"f9b598ca-049f-4d52-b7a6-57308e36b228\") " Jun 14 22:57:42.794672 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.794662 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsq6q\" (UniqueName: \"kubernetes.io/projected/f9b598ca-049f-4d52-b7a6-57308e36b228-kube-api-access-rsq6q\") pod \"f9b598ca-049f-4d52-b7a6-57308e36b228\" (UID: \"f9b598ca-049f-4d52-b7a6-57308e36b228\") " Jun 14 22:57:42.795099 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.795069 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9b598ca-049f-4d52-b7a6-57308e36b228-bundle" (OuterVolumeSpecName: "bundle") pod "f9b598ca-049f-4d52-b7a6-57308e36b228" (UID: "f9b598ca-049f-4d52-b7a6-57308e36b228"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:57:42.796675 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.796649 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9b598ca-049f-4d52-b7a6-57308e36b228-kube-api-access-rsq6q" (OuterVolumeSpecName: "kube-api-access-rsq6q") pod "f9b598ca-049f-4d52-b7a6-57308e36b228" (UID: "f9b598ca-049f-4d52-b7a6-57308e36b228"). InnerVolumeSpecName "kube-api-access-rsq6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:57:42.799988 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.799965 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9b598ca-049f-4d52-b7a6-57308e36b228-util" (OuterVolumeSpecName: "util") pod "f9b598ca-049f-4d52-b7a6-57308e36b228" (UID: "f9b598ca-049f-4d52-b7a6-57308e36b228"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:57:42.895517 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.895463 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d94a73c-e405-4b64-8cfb-67fb59b3b630-bundle\") pod \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\" (UID: \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\") " Jun 14 22:57:42.895517 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.895500 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d94a73c-e405-4b64-8cfb-67fb59b3b630-util\") pod \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\" (UID: \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\") " Jun 14 22:57:42.895657 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.895524 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qx55\" (UniqueName: \"kubernetes.io/projected/4d94a73c-e405-4b64-8cfb-67fb59b3b630-kube-api-access-7qx55\") pod \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\" (UID: \"4d94a73c-e405-4b64-8cfb-67fb59b3b630\") " Jun 14 22:57:42.895738 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.895722 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9b598ca-049f-4d52-b7a6-57308e36b228-bundle\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:57:42.895770 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.895746 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsq6q\" (UniqueName: \"kubernetes.io/projected/f9b598ca-049f-4d52-b7a6-57308e36b228-kube-api-access-rsq6q\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:57:42.895770 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.895761 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9b598ca-049f-4d52-b7a6-57308e36b228-util\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:57:42.895866 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.895844 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d94a73c-e405-4b64-8cfb-67fb59b3b630-bundle" (OuterVolumeSpecName: "bundle") pod "4d94a73c-e405-4b64-8cfb-67fb59b3b630" (UID: "4d94a73c-e405-4b64-8cfb-67fb59b3b630"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:57:42.897487 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.897457 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d94a73c-e405-4b64-8cfb-67fb59b3b630-kube-api-access-7qx55" (OuterVolumeSpecName: "kube-api-access-7qx55") pod "4d94a73c-e405-4b64-8cfb-67fb59b3b630" (UID: "4d94a73c-e405-4b64-8cfb-67fb59b3b630"). InnerVolumeSpecName "kube-api-access-7qx55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:57:42.900924 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.900905 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d94a73c-e405-4b64-8cfb-67fb59b3b630-util" (OuterVolumeSpecName: "util") pod "4d94a73c-e405-4b64-8cfb-67fb59b3b630" (UID: "4d94a73c-e405-4b64-8cfb-67fb59b3b630"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:57:42.996333 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.996311 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d94a73c-e405-4b64-8cfb-67fb59b3b630-bundle\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:57:42.996333 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.996330 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d94a73c-e405-4b64-8cfb-67fb59b3b630-util\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:57:42.996449 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:42.996338 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qx55\" (UniqueName: \"kubernetes.io/projected/4d94a73c-e405-4b64-8cfb-67fb59b3b630-kube-api-access-7qx55\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:57:43.603462 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.603431 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" event={"ID":"f9b598ca-049f-4d52-b7a6-57308e36b228","Type":"ContainerDied","Data":"038f7e324bfa8bc628186b5420b5c5fe96e4aff93251204ef6b4bd7c00683020"} Jun 14 22:57:43.603462 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.603461 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht" Jun 14 22:57:43.603893 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.603478 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="038f7e324bfa8bc628186b5420b5c5fe96e4aff93251204ef6b4bd7c00683020" Jun 14 22:57:43.605827 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.605804 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" Jun 14 22:57:43.605951 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.605804 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9" event={"ID":"4d94a73c-e405-4b64-8cfb-67fb59b3b630","Type":"ContainerDied","Data":"0b273302766350abb40b961b6d1c255dde8cccaa78691354477e2d0a4478590e"} Jun 14 22:57:43.605951 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.605946 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b273302766350abb40b961b6d1c255dde8cccaa78691354477e2d0a4478590e" Jun 14 22:57:43.724384 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.724356 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:43.769559 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.769537 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:43.800431 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.800407 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4pzf\" (UniqueName: \"kubernetes.io/projected/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-kube-api-access-h4pzf\") pod \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\" (UID: \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\") " Jun 14 22:57:43.800529 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.800439 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-bundle\") pod \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\" (UID: \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\") " Jun 14 22:57:43.800529 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.800491 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-util\") pod \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\" (UID: \"12faea3e-3db7-4bc7-93bc-21b3028a3b5f\") " Jun 14 22:57:43.800529 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.800515 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d597e994-6184-47a4-be52-4dcb8f9c3cba-bundle\") pod \"d597e994-6184-47a4-be52-4dcb8f9c3cba\" (UID: \"d597e994-6184-47a4-be52-4dcb8f9c3cba\") " Jun 14 22:57:43.800681 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.800546 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d597e994-6184-47a4-be52-4dcb8f9c3cba-util\") pod \"d597e994-6184-47a4-be52-4dcb8f9c3cba\" (UID: \"d597e994-6184-47a4-be52-4dcb8f9c3cba\") " Jun 14 22:57:43.800681 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.800603 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbn8g\" (UniqueName: \"kubernetes.io/projected/d597e994-6184-47a4-be52-4dcb8f9c3cba-kube-api-access-fbn8g\") pod \"d597e994-6184-47a4-be52-4dcb8f9c3cba\" (UID: \"d597e994-6184-47a4-be52-4dcb8f9c3cba\") " Jun 14 22:57:43.801281 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.801131 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-bundle" (OuterVolumeSpecName: "bundle") pod "12faea3e-3db7-4bc7-93bc-21b3028a3b5f" (UID: "12faea3e-3db7-4bc7-93bc-21b3028a3b5f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:57:43.801281 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.801240 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d597e994-6184-47a4-be52-4dcb8f9c3cba-bundle" (OuterVolumeSpecName: "bundle") pod "d597e994-6184-47a4-be52-4dcb8f9c3cba" (UID: "d597e994-6184-47a4-be52-4dcb8f9c3cba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:57:43.802919 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.802897 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d597e994-6184-47a4-be52-4dcb8f9c3cba-kube-api-access-fbn8g" (OuterVolumeSpecName: "kube-api-access-fbn8g") pod "d597e994-6184-47a4-be52-4dcb8f9c3cba" (UID: "d597e994-6184-47a4-be52-4dcb8f9c3cba"). InnerVolumeSpecName "kube-api-access-fbn8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:57:43.803165 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.803151 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-kube-api-access-h4pzf" (OuterVolumeSpecName: "kube-api-access-h4pzf") pod "12faea3e-3db7-4bc7-93bc-21b3028a3b5f" (UID: "12faea3e-3db7-4bc7-93bc-21b3028a3b5f"). InnerVolumeSpecName "kube-api-access-h4pzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:57:43.806680 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.806658 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d597e994-6184-47a4-be52-4dcb8f9c3cba-util" (OuterVolumeSpecName: "util") pod "d597e994-6184-47a4-be52-4dcb8f9c3cba" (UID: "d597e994-6184-47a4-be52-4dcb8f9c3cba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:57:43.806751 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.806720 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-util" (OuterVolumeSpecName: "util") pod "12faea3e-3db7-4bc7-93bc-21b3028a3b5f" (UID: "12faea3e-3db7-4bc7-93bc-21b3028a3b5f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:57:43.902165 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.902101 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbn8g\" (UniqueName: \"kubernetes.io/projected/d597e994-6184-47a4-be52-4dcb8f9c3cba-kube-api-access-fbn8g\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:57:43.902165 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.902124 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4pzf\" (UniqueName: \"kubernetes.io/projected/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-kube-api-access-h4pzf\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:57:43.902165 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.902133 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-bundle\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:57:43.902165 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.902142 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12faea3e-3db7-4bc7-93bc-21b3028a3b5f-util\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:57:43.902165 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.902150 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d597e994-6184-47a4-be52-4dcb8f9c3cba-bundle\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:57:43.902165 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:43.902157 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d597e994-6184-47a4-be52-4dcb8f9c3cba-util\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:57:44.612494 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:44.612466 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" Jun 14 22:57:44.612494 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:44.612485 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5" event={"ID":"12faea3e-3db7-4bc7-93bc-21b3028a3b5f","Type":"ContainerDied","Data":"0a2b018d6a53550dd4813bf1ec70f11599e5b5f115c76584714241ac3d3185c8"} Jun 14 22:57:44.612999 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:44.612531 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a2b018d6a53550dd4813bf1ec70f11599e5b5f115c76584714241ac3d3185c8" Jun 14 22:57:44.614465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:44.614445 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" Jun 14 22:57:44.614465 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:44.614458 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz" event={"ID":"d597e994-6184-47a4-be52-4dcb8f9c3cba","Type":"ContainerDied","Data":"cbfe2dbed18463935af7de6f4e7edcf8afce2ec2a5c123c1c2c0255932abc451"} Jun 14 22:57:44.614646 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:44.614490 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbfe2dbed18463935af7de6f4e7edcf8afce2ec2a5c123c1c2c0255932abc451" Jun 14 22:57:50.583089 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:50.583051 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:57:51.525210 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:51.525179 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:57:55.604458 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:55.604385 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:57:57.833015 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:57.832970 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:57:59.299815 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.299775 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2"] Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300072 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12faea3e-3db7-4bc7-93bc-21b3028a3b5f" containerName="util" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300085 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="12faea3e-3db7-4bc7-93bc-21b3028a3b5f" containerName="util" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300094 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d94a73c-e405-4b64-8cfb-67fb59b3b630" containerName="extract" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300101 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d94a73c-e405-4b64-8cfb-67fb59b3b630" containerName="extract" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300109 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d94a73c-e405-4b64-8cfb-67fb59b3b630" containerName="pull" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300116 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d94a73c-e405-4b64-8cfb-67fb59b3b630" containerName="pull" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300122 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b598ca-049f-4d52-b7a6-57308e36b228" containerName="extract" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300127 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b598ca-049f-4d52-b7a6-57308e36b228" containerName="extract" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300134 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d94a73c-e405-4b64-8cfb-67fb59b3b630" containerName="util" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300139 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d94a73c-e405-4b64-8cfb-67fb59b3b630" containerName="util" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300144 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d597e994-6184-47a4-be52-4dcb8f9c3cba" containerName="extract" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300149 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d597e994-6184-47a4-be52-4dcb8f9c3cba" containerName="extract" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300158 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d597e994-6184-47a4-be52-4dcb8f9c3cba" containerName="util" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300163 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d597e994-6184-47a4-be52-4dcb8f9c3cba" containerName="util" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300172 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b598ca-049f-4d52-b7a6-57308e36b228" containerName="util" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300177 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b598ca-049f-4d52-b7a6-57308e36b228" containerName="util" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300187 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12faea3e-3db7-4bc7-93bc-21b3028a3b5f" containerName="extract" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300192 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="12faea3e-3db7-4bc7-93bc-21b3028a3b5f" containerName="extract" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300202 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d597e994-6184-47a4-be52-4dcb8f9c3cba" containerName="pull" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300207 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d597e994-6184-47a4-be52-4dcb8f9c3cba" containerName="pull" Jun 14 22:57:59.300207 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300216 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b598ca-049f-4d52-b7a6-57308e36b228" containerName="pull" Jun 14 22:57:59.301101 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300222 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b598ca-049f-4d52-b7a6-57308e36b228" containerName="pull" Jun 14 22:57:59.301101 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300228 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12faea3e-3db7-4bc7-93bc-21b3028a3b5f" containerName="pull" Jun 14 22:57:59.301101 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300232 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="12faea3e-3db7-4bc7-93bc-21b3028a3b5f" containerName="pull" Jun 14 22:57:59.301101 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300277 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d94a73c-e405-4b64-8cfb-67fb59b3b630" containerName="extract" Jun 14 22:57:59.301101 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300286 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9b598ca-049f-4d52-b7a6-57308e36b228" containerName="extract" Jun 14 22:57:59.301101 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300293 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="d597e994-6184-47a4-be52-4dcb8f9c3cba" containerName="extract" Jun 14 22:57:59.301101 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.300299 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="12faea3e-3db7-4bc7-93bc-21b3028a3b5f" containerName="extract" Jun 14 22:57:59.303493 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.303475 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:57:59.305915 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.305895 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 22:57:59.306104 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.306083 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-65gmb\"" Jun 14 22:57:59.306169 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.306123 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 22:57:59.317499 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.317478 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2"] Jun 14 22:57:59.412352 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.412320 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" (UID: \"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:57:59.412486 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.412398 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smrq4\" (UniqueName: \"kubernetes.io/projected/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc-kube-api-access-smrq4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" (UID: \"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:57:59.512837 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.512811 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" (UID: \"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:57:59.512982 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.512861 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smrq4\" (UniqueName: \"kubernetes.io/projected/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc-kube-api-access-smrq4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" (UID: \"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:57:59.513211 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.513191 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" (UID: \"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:57:59.520475 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.520455 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smrq4\" (UniqueName: \"kubernetes.io/projected/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc-kube-api-access-smrq4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" (UID: \"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:57:59.613909 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.613853 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:57:59.748752 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:57:59.748723 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2"] Jun 14 22:57:59.750282 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:57:59.750258 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea3dd5a_c9f7_4ea8_8f4c_3c57943339fc.slice/crio-f649487153c33ab2aa7dd3012d053228a6d7e7c6b2ba68d82413bad11a6b81ed WatchSource:0}: Error finding container f649487153c33ab2aa7dd3012d053228a6d7e7c6b2ba68d82413bad11a6b81ed: Status 404 returned error can't find the container with id f649487153c33ab2aa7dd3012d053228a6d7e7c6b2ba68d82413bad11a6b81ed Jun 14 22:58:00.450247 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:00.450214 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:00.614337 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:00.614308 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:00.699446 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:00.699406 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" event={"ID":"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc","Type":"ContainerStarted","Data":"f649487153c33ab2aa7dd3012d053228a6d7e7c6b2ba68d82413bad11a6b81ed"} Jun 14 22:58:03.389366 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:03.389332 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:04.046589 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:04.046530 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:05.727003 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:05.726971 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" event={"ID":"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc","Type":"ContainerStarted","Data":"02d2aac2ee362d8b9c51cd375d446a6f59aa4ae711541cf27d3b7d6b577a9d83"} Jun 14 22:58:05.727385 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:05.727112 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:58:05.745054 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:05.745007 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" podStartSLOduration=1.521491638 podStartE2EDuration="6.744993468s" totalImagesPullingTime="5.22350183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:05.743845849 +0000 UTC m=+630.874298192" watchObservedRunningTime="2026-06-14 22:58:05.744993468 +0000 UTC m=+630.875445793" Jun 14 22:58:06.446709 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:06.446674 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:07.192051 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:07.192023 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:07.293851 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:07.293812 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:07.599763 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:07.599734 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:07.672774 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:07.672749 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:07.922831 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:07.922752 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:09.840559 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:09.840529 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:09.941361 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:09.941335 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:10.041837 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:10.041805 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:10.585279 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:10.585249 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:10.645880 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:10.645849 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:10.988423 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:10.988374 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:11.088650 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:11.088623 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:16.735907 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:16.735879 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:58:18.228823 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.228789 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:18.245393 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.245371 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw"] Jun 14 22:58:18.250155 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.250130 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" Jun 14 22:58:18.269893 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.269870 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw"] Jun 14 22:58:18.327384 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.327333 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:18.327835 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.327812 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw"] Jun 14 22:58:18.328062 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.328042 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-nzsmp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" podUID="06795028-612d-4e19-aeee-6075b02acddf" Jun 14 22:58:18.332729 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.332707 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw"] Jun 14 22:58:18.341414 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.341393 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2"] Jun 14 22:58:18.341592 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.341571 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" podUID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" containerName="manager" containerID="cri-o://02d2aac2ee362d8b9c51cd375d446a6f59aa4ae711541cf27d3b7d6b577a9d83" gracePeriod=2 Jun 14 22:58:18.351783 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.351765 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4"] Jun 14 22:58:18.355099 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.354998 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" Jun 14 22:58:18.357405 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.357387 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2"] Jun 14 22:58:18.359148 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.358815 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06795028-612d-4e19-aeee-6075b02acddf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8phqw\" (UID: \"06795028-612d-4e19-aeee-6075b02acddf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" Jun 14 22:58:18.359148 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.358926 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzsmp\" (UniqueName: \"kubernetes.io/projected/06795028-612d-4e19-aeee-6075b02acddf-kube-api-access-nzsmp\") pod \"kuadrant-operator-controller-manager-55467d9f7-8phqw\" (UID: \"06795028-612d-4e19-aeee-6075b02acddf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" Jun 14 22:58:18.366273 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.366242 2548 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\": pods \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:58:18.369763 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.369735 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h"] Jun 14 22:58:18.370101 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.370080 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" containerName="manager" Jun 14 22:58:18.370101 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.370102 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" containerName="manager" Jun 14 22:58:18.370250 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.370175 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" containerName="manager" Jun 14 22:58:18.373514 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.373495 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h" Jun 14 22:58:18.374127 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.374108 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4"] Jun 14 22:58:18.391127 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.391070 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h"] Jun 14 22:58:18.392052 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.392022 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" is forbidden: User \"system:node:ip-10-0-130-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-203.ec2.internal' and this object" podUID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:58:18.394331 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.394204 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" is forbidden: User \"system:node:ip-10-0-130-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-203.ec2.internal' and this object" podUID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:58:18.456642 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.456620 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h"] Jun 14 22:58:18.456838 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.456822 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-pq2sw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h" podUID="749e045d-6aff-4637-8768-91ecd72f4ce1" Jun 14 22:58:18.459242 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.459224 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90a5d427-de8e-4d57-9067-34e1b81535a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-swhf4\" (UID: \"90a5d427-de8e-4d57-9067-34e1b81535a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" Jun 14 22:58:18.459303 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.459257 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzsmp\" (UniqueName: \"kubernetes.io/projected/06795028-612d-4e19-aeee-6075b02acddf-kube-api-access-nzsmp\") pod \"kuadrant-operator-controller-manager-55467d9f7-8phqw\" (UID: \"06795028-612d-4e19-aeee-6075b02acddf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" Jun 14 22:58:18.459358 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.459342 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06795028-612d-4e19-aeee-6075b02acddf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8phqw\" (UID: \"06795028-612d-4e19-aeee-6075b02acddf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" Jun 14 22:58:18.459499 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.459483 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/749e045d-6aff-4637-8768-91ecd72f4ce1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d2r2h\" (UID: \"749e045d-6aff-4637-8768-91ecd72f4ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h" Jun 14 22:58:18.459552 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.459541 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq2sw\" (UniqueName: \"kubernetes.io/projected/749e045d-6aff-4637-8768-91ecd72f4ce1-kube-api-access-pq2sw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d2r2h\" (UID: \"749e045d-6aff-4637-8768-91ecd72f4ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h" Jun 14 22:58:18.459622 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.459597 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dcmq\" (UniqueName: \"kubernetes.io/projected/90a5d427-de8e-4d57-9067-34e1b81535a5-kube-api-access-4dcmq\") pod \"kuadrant-operator-controller-manager-55467d9f7-swhf4\" (UID: \"90a5d427-de8e-4d57-9067-34e1b81535a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" Jun 14 22:58:18.459730 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.459698 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06795028-612d-4e19-aeee-6075b02acddf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8phqw\" (UID: \"06795028-612d-4e19-aeee-6075b02acddf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" Jun 14 22:58:18.463649 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.463626 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nzsmp for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-8phqw" not found Jun 14 22:58:18.463781 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.463681 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06795028-612d-4e19-aeee-6075b02acddf-kube-api-access-nzsmp podName:06795028-612d-4e19-aeee-6075b02acddf nodeName:}" failed. No retries permitted until 2026-06-14 22:58:18.963666334 +0000 UTC m=+644.094118637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nzsmp" (UniqueName: "kubernetes.io/projected/06795028-612d-4e19-aeee-6075b02acddf-kube-api-access-nzsmp") pod "kuadrant-operator-controller-manager-55467d9f7-8phqw" (UID: "06795028-612d-4e19-aeee-6075b02acddf") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-8phqw" not found Jun 14 22:58:18.492977 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.492880 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:18.494463 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.494436 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t"] Jun 14 22:58:18.497718 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.497702 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" Jun 14 22:58:18.499818 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.499788 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" is forbidden: User \"system:node:ip-10-0-130-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-203.ec2.internal' and this object" podUID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:58:18.508628 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.508605 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t"] Jun 14 22:58:18.559963 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.559918 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba76af98-fb13-4e6b-b91f-1f911d032894-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p2s8t\" (UID: \"ba76af98-fb13-4e6b-b91f-1f911d032894\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" Jun 14 22:58:18.560075 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.560000 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/749e045d-6aff-4637-8768-91ecd72f4ce1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d2r2h\" (UID: \"749e045d-6aff-4637-8768-91ecd72f4ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h" Jun 14 22:58:18.560075 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.560033 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2sw\" (UniqueName: \"kubernetes.io/projected/749e045d-6aff-4637-8768-91ecd72f4ce1-kube-api-access-pq2sw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d2r2h\" (UID: \"749e045d-6aff-4637-8768-91ecd72f4ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h" Jun 14 22:58:18.560075 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.560061 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dcmq\" (UniqueName: \"kubernetes.io/projected/90a5d427-de8e-4d57-9067-34e1b81535a5-kube-api-access-4dcmq\") pod \"kuadrant-operator-controller-manager-55467d9f7-swhf4\" (UID: \"90a5d427-de8e-4d57-9067-34e1b81535a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" Jun 14 22:58:18.560179 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.560110 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90a5d427-de8e-4d57-9067-34e1b81535a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-swhf4\" (UID: \"90a5d427-de8e-4d57-9067-34e1b81535a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" Jun 14 22:58:18.560179 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.560150 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnhqn\" (UniqueName: \"kubernetes.io/projected/ba76af98-fb13-4e6b-b91f-1f911d032894-kube-api-access-rnhqn\") pod \"kuadrant-operator-controller-manager-86878c769f-p2s8t\" (UID: \"ba76af98-fb13-4e6b-b91f-1f911d032894\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" Jun 14 22:58:18.560373 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.560346 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/749e045d-6aff-4637-8768-91ecd72f4ce1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d2r2h\" (UID: \"749e045d-6aff-4637-8768-91ecd72f4ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h" Jun 14 22:58:18.560535 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.560514 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90a5d427-de8e-4d57-9067-34e1b81535a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-swhf4\" (UID: \"90a5d427-de8e-4d57-9067-34e1b81535a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" Jun 14 22:58:18.570304 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.570284 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dcmq\" (UniqueName: \"kubernetes.io/projected/90a5d427-de8e-4d57-9067-34e1b81535a5-kube-api-access-4dcmq\") pod \"kuadrant-operator-controller-manager-55467d9f7-swhf4\" (UID: \"90a5d427-de8e-4d57-9067-34e1b81535a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" Jun 14 22:58:18.570440 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.570421 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq2sw\" (UniqueName: \"kubernetes.io/projected/749e045d-6aff-4637-8768-91ecd72f4ce1-kube-api-access-pq2sw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d2r2h\" (UID: \"749e045d-6aff-4637-8768-91ecd72f4ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h" Jun 14 22:58:18.588630 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.588609 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:18.591862 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.591844 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:58:18.594090 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.594066 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" is forbidden: User \"system:node:ip-10-0-130-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-203.ec2.internal' and this object" podUID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:58:18.660894 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.660869 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc-extensions-socket-volume\") pod \"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc\" (UID: \"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc\") " Jun 14 22:58:18.661043 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.661027 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smrq4\" (UniqueName: \"kubernetes.io/projected/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc-kube-api-access-smrq4\") pod \"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc\" (UID: \"0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc\") " Jun 14 22:58:18.661133 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.661119 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba76af98-fb13-4e6b-b91f-1f911d032894-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p2s8t\" (UID: \"ba76af98-fb13-4e6b-b91f-1f911d032894\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" Jun 14 22:58:18.661228 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.661215 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnhqn\" (UniqueName: \"kubernetes.io/projected/ba76af98-fb13-4e6b-b91f-1f911d032894-kube-api-access-rnhqn\") pod \"kuadrant-operator-controller-manager-86878c769f-p2s8t\" (UID: \"ba76af98-fb13-4e6b-b91f-1f911d032894\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" Jun 14 22:58:18.661342 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.661321 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" (UID: "0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:58:18.661505 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.661487 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba76af98-fb13-4e6b-b91f-1f911d032894-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p2s8t\" (UID: \"ba76af98-fb13-4e6b-b91f-1f911d032894\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" Jun 14 22:58:18.663116 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.663088 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc-kube-api-access-smrq4" (OuterVolumeSpecName: "kube-api-access-smrq4") pod "0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" (UID: "0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc"). InnerVolumeSpecName "kube-api-access-smrq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:58:18.669423 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.669403 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnhqn\" (UniqueName: \"kubernetes.io/projected/ba76af98-fb13-4e6b-b91f-1f911d032894-kube-api-access-rnhqn\") pod \"kuadrant-operator-controller-manager-86878c769f-p2s8t\" (UID: \"ba76af98-fb13-4e6b-b91f-1f911d032894\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" Jun 14 22:58:18.735301 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.735274 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" Jun 14 22:58:18.761726 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.761705 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smrq4\" (UniqueName: \"kubernetes.io/projected/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc-kube-api-access-smrq4\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:58:18.761726 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.761725 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc-extensions-socket-volume\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:58:18.798272 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.798235 2548 generic.go:356] "Generic (PLEG): container finished" podID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" containerID="02d2aac2ee362d8b9c51cd375d446a6f59aa4ae711541cf27d3b7d6b577a9d83" exitCode=0 Jun 14 22:58:18.798413 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.798279 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:58:18.798413 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.798327 2548 scope.go:117] "RemoveContainer" containerID="02d2aac2ee362d8b9c51cd375d446a6f59aa4ae711541cf27d3b7d6b577a9d83" Jun 14 22:58:18.799063 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.799041 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h" Jun 14 22:58:18.799480 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.799462 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" Jun 14 22:58:18.803685 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.803656 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" is forbidden: User \"system:node:ip-10-0-130-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-203.ec2.internal' and this object" podUID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:58:18.805892 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.805857 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" is forbidden: User \"system:node:ip-10-0-130-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-203.ec2.internal' and this object" podUID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:58:18.807538 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.807522 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" Jun 14 22:58:18.808116 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.808087 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8phqw\" is forbidden: User \"system:node:ip-10-0-130-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-203.ec2.internal' and this object" podUID="06795028-612d-4e19-aeee-6075b02acddf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" Jun 14 22:58:18.815164 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.815144 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h" Jun 14 22:58:18.819535 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.819508 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" Jun 14 22:58:18.822821 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.822797 2548 scope.go:117] "RemoveContainer" containerID="02d2aac2ee362d8b9c51cd375d446a6f59aa4ae711541cf27d3b7d6b577a9d83" Jun 14 22:58:18.823163 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.823140 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02d2aac2ee362d8b9c51cd375d446a6f59aa4ae711541cf27d3b7d6b577a9d83\": container with ID starting with 02d2aac2ee362d8b9c51cd375d446a6f59aa4ae711541cf27d3b7d6b577a9d83 not found: ID does not exist" containerID="02d2aac2ee362d8b9c51cd375d446a6f59aa4ae711541cf27d3b7d6b577a9d83" Jun 14 22:58:18.823242 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.823174 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02d2aac2ee362d8b9c51cd375d446a6f59aa4ae711541cf27d3b7d6b577a9d83"} err="failed to get container status \"02d2aac2ee362d8b9c51cd375d446a6f59aa4ae711541cf27d3b7d6b577a9d83\": rpc error: code = NotFound desc = could not find container \"02d2aac2ee362d8b9c51cd375d446a6f59aa4ae711541cf27d3b7d6b577a9d83\": container with ID starting with 02d2aac2ee362d8b9c51cd375d446a6f59aa4ae711541cf27d3b7d6b577a9d83 not found: ID does not exist" Jun 14 22:58:18.832738 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.832711 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5r7v2\" is forbidden: User \"system:node:ip-10-0-130-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-203.ec2.internal' and this object" podUID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5r7v2" Jun 14 22:58:18.834852 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:18.834827 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8phqw\" is forbidden: User \"system:node:ip-10-0-130-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-203.ec2.internal' and this object" podUID="06795028-612d-4e19-aeee-6075b02acddf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" Jun 14 22:58:18.871759 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.871658 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4"] Jun 14 22:58:18.873386 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:58:18.873362 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a5d427_de8e_4d57_9067_34e1b81535a5.slice/crio-9ad2d03b6eb3aa3475dce6862f1e3c281289d12b3ff3d45513635d3e67856f86 WatchSource:0}: Error finding container 9ad2d03b6eb3aa3475dce6862f1e3c281289d12b3ff3d45513635d3e67856f86: Status 404 returned error can't find the container with id 9ad2d03b6eb3aa3475dce6862f1e3c281289d12b3ff3d45513635d3e67856f86 Jun 14 22:58:18.957130 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.957107 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t"] Jun 14 22:58:18.959087 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:58:18.959055 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba76af98_fb13_4e6b_b91f_1f911d032894.slice/crio-c6e0f88dbae21de3172ea1847cf7bdd1fdeb46f84e14ddeeb0175f049d12dfb2 WatchSource:0}: Error finding container c6e0f88dbae21de3172ea1847cf7bdd1fdeb46f84e14ddeeb0175f049d12dfb2: Status 404 returned error can't find the container with id c6e0f88dbae21de3172ea1847cf7bdd1fdeb46f84e14ddeeb0175f049d12dfb2 Jun 14 22:58:18.963181 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.963163 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/749e045d-6aff-4637-8768-91ecd72f4ce1-extensions-socket-volume\") pod \"749e045d-6aff-4637-8768-91ecd72f4ce1\" (UID: \"749e045d-6aff-4637-8768-91ecd72f4ce1\") " Jun 14 22:58:18.963257 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.963231 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06795028-612d-4e19-aeee-6075b02acddf-extensions-socket-volume\") pod \"06795028-612d-4e19-aeee-6075b02acddf\" (UID: \"06795028-612d-4e19-aeee-6075b02acddf\") " Jun 14 22:58:18.963292 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.963269 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq2sw\" (UniqueName: \"kubernetes.io/projected/749e045d-6aff-4637-8768-91ecd72f4ce1-kube-api-access-pq2sw\") pod \"749e045d-6aff-4637-8768-91ecd72f4ce1\" (UID: \"749e045d-6aff-4637-8768-91ecd72f4ce1\") " Jun 14 22:58:18.963415 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.963390 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749e045d-6aff-4637-8768-91ecd72f4ce1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "749e045d-6aff-4637-8768-91ecd72f4ce1" (UID: "749e045d-6aff-4637-8768-91ecd72f4ce1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:58:18.963497 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.963482 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzsmp\" (UniqueName: \"kubernetes.io/projected/06795028-612d-4e19-aeee-6075b02acddf-kube-api-access-nzsmp\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:58:18.963529 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.963505 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/749e045d-6aff-4637-8768-91ecd72f4ce1-extensions-socket-volume\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:58:18.963529 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.963500 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06795028-612d-4e19-aeee-6075b02acddf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "06795028-612d-4e19-aeee-6075b02acddf" (UID: "06795028-612d-4e19-aeee-6075b02acddf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:58:18.965316 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:18.965227 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/749e045d-6aff-4637-8768-91ecd72f4ce1-kube-api-access-pq2sw" (OuterVolumeSpecName: "kube-api-access-pq2sw") pod "749e045d-6aff-4637-8768-91ecd72f4ce1" (UID: "749e045d-6aff-4637-8768-91ecd72f4ce1"). InnerVolumeSpecName "kube-api-access-pq2sw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:58:19.064430 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.064408 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06795028-612d-4e19-aeee-6075b02acddf-extensions-socket-volume\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:58:19.064539 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.064434 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq2sw\" (UniqueName: \"kubernetes.io/projected/749e045d-6aff-4637-8768-91ecd72f4ce1-kube-api-access-pq2sw\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:58:19.346707 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.346631 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06795028-612d-4e19-aeee-6075b02acddf" path="/var/lib/kubelet/pods/06795028-612d-4e19-aeee-6075b02acddf/volumes" Jun 14 22:58:19.347060 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.346870 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc" path="/var/lib/kubelet/pods/0ea3dd5a-c9f7-4ea8-8f4c-3c57943339fc/volumes" Jun 14 22:58:19.805301 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.805261 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" event={"ID":"ba76af98-fb13-4e6b-b91f-1f911d032894","Type":"ContainerStarted","Data":"90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec"} Jun 14 22:58:19.805479 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.805319 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" event={"ID":"ba76af98-fb13-4e6b-b91f-1f911d032894","Type":"ContainerStarted","Data":"c6e0f88dbae21de3172ea1847cf7bdd1fdeb46f84e14ddeeb0175f049d12dfb2"} Jun 14 22:58:19.805479 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.805347 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" Jun 14 22:58:19.807825 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.807799 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" event={"ID":"90a5d427-de8e-4d57-9067-34e1b81535a5","Type":"ContainerStarted","Data":"e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee"} Jun 14 22:58:19.807825 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.807825 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h" Jun 14 22:58:19.807983 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.807848 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" event={"ID":"90a5d427-de8e-4d57-9067-34e1b81535a5","Type":"ContainerStarted","Data":"9ad2d03b6eb3aa3475dce6862f1e3c281289d12b3ff3d45513635d3e67856f86"} Jun 14 22:58:19.807983 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.807808 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" Jun 14 22:58:19.807983 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.807974 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" Jun 14 22:58:19.828848 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:19.828818 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8phqw\" is forbidden: User \"system:node:ip-10-0-130-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-203.ec2.internal' and this object" podUID="06795028-612d-4e19-aeee-6075b02acddf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8phqw" Jun 14 22:58:19.828848 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.828823 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" podStartSLOduration=1.828810264 podStartE2EDuration="1.828810264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:58:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:19.826766563 +0000 UTC m=+644.957218887" watchObservedRunningTime="2026-06-14 22:58:19.828810264 +0000 UTC m=+644.959262641" Jun 14 22:58:19.849417 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.849375 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" podStartSLOduration=1.849363051 podStartE2EDuration="1.849363051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:58:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:19.847382066 +0000 UTC m=+644.977834449" watchObservedRunningTime="2026-06-14 22:58:19.849363051 +0000 UTC m=+644.979815375" Jun 14 22:58:19.873948 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.873911 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h"] Jun 14 22:58:19.880331 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:19.880310 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2r2h"] Jun 14 22:58:21.110071 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:21.110041 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:21.210590 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:21.210563 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:21.313727 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:21.313693 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:21.346160 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:21.346135 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="749e045d-6aff-4637-8768-91ecd72f4ce1" path="/var/lib/kubelet/pods/749e045d-6aff-4637-8768-91ecd72f4ce1/volumes" Jun 14 22:58:21.418464 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:21.418398 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:22.409607 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:22.409562 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:22.509776 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:22.509751 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:26.205343 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:26.205311 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:26.264154 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:26.264124 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:26.415577 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:26.415551 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:26.469072 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:26.469047 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:28.954275 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:28.954239 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:29.054293 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:29.054266 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:30.814700 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:30.814672 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" Jun 14 22:58:30.815090 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:30.814830 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" Jun 14 22:58:30.894176 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:30.894147 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4"] Jun 14 22:58:30.894353 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:30.894333 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" podUID="90a5d427-de8e-4d57-9067-34e1b81535a5" containerName="manager" containerID="cri-o://e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee" gracePeriod=10 Jun 14 22:58:31.146830 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.146809 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" Jun 14 22:58:31.250574 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.250539 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dcmq\" (UniqueName: \"kubernetes.io/projected/90a5d427-de8e-4d57-9067-34e1b81535a5-kube-api-access-4dcmq\") pod \"90a5d427-de8e-4d57-9067-34e1b81535a5\" (UID: \"90a5d427-de8e-4d57-9067-34e1b81535a5\") " Jun 14 22:58:31.250724 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.250650 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90a5d427-de8e-4d57-9067-34e1b81535a5-extensions-socket-volume\") pod \"90a5d427-de8e-4d57-9067-34e1b81535a5\" (UID: \"90a5d427-de8e-4d57-9067-34e1b81535a5\") " Jun 14 22:58:31.251036 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.251011 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a5d427-de8e-4d57-9067-34e1b81535a5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "90a5d427-de8e-4d57-9067-34e1b81535a5" (UID: "90a5d427-de8e-4d57-9067-34e1b81535a5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:58:31.252551 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.252522 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a5d427-de8e-4d57-9067-34e1b81535a5-kube-api-access-4dcmq" (OuterVolumeSpecName: "kube-api-access-4dcmq") pod "90a5d427-de8e-4d57-9067-34e1b81535a5" (UID: "90a5d427-de8e-4d57-9067-34e1b81535a5"). InnerVolumeSpecName "kube-api-access-4dcmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:58:31.351640 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.351572 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90a5d427-de8e-4d57-9067-34e1b81535a5-extensions-socket-volume\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:58:31.351640 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.351597 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dcmq\" (UniqueName: \"kubernetes.io/projected/90a5d427-de8e-4d57-9067-34e1b81535a5-kube-api-access-4dcmq\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 22:58:31.868454 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.868425 2548 generic.go:356] "Generic (PLEG): container finished" podID="90a5d427-de8e-4d57-9067-34e1b81535a5" containerID="e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee" exitCode=0 Jun 14 22:58:31.868829 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.868467 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" Jun 14 22:58:31.868829 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.868508 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" event={"ID":"90a5d427-de8e-4d57-9067-34e1b81535a5","Type":"ContainerDied","Data":"e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee"} Jun 14 22:58:31.868829 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.868562 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4" event={"ID":"90a5d427-de8e-4d57-9067-34e1b81535a5","Type":"ContainerDied","Data":"9ad2d03b6eb3aa3475dce6862f1e3c281289d12b3ff3d45513635d3e67856f86"} Jun 14 22:58:31.868829 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.868590 2548 scope.go:117] "RemoveContainer" containerID="e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee" Jun 14 22:58:31.876980 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.876958 2548 scope.go:117] "RemoveContainer" containerID="e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee" Jun 14 22:58:31.877255 ip-10-0-130-203 kubenswrapper[2548]: E0614 22:58:31.877236 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee\": container with ID starting with e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee not found: ID does not exist" containerID="e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee" Jun 14 22:58:31.877314 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.877263 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee"} err="failed to get container status \"e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee\": rpc error: code = NotFound desc = could not find container \"e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee\": container with ID starting with e3a20c44373df25766954e8dd8d399677261a3ffda973205d881abd6decda4ee not found: ID does not exist" Jun 14 22:58:31.886426 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.886389 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4"] Jun 14 22:58:31.899966 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:31.899945 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swhf4"] Jun 14 22:58:33.346096 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:33.346053 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90a5d427-de8e-4d57-9067-34e1b81535a5" path="/var/lib/kubelet/pods/90a5d427-de8e-4d57-9067-34e1b81535a5/volumes" Jun 14 22:58:35.418724 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:35.418692 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:35.516518 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:35.516482 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:40.186589 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:40.186558 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:40.286487 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:40.286447 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:43.993786 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:43.993754 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:44.095022 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:44.094990 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:44.590241 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:44.590207 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:44.690911 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:44.690880 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:47.179727 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:47.179694 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:47.278313 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:47.278282 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:48.390159 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:48.390127 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:48.490324 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:48.490293 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:49.444412 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.444375 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:49.548070 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.548036 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:49.602641 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.602607 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:49.822257 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.822221 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 22:58:49.822533 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.822520 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a5d427-de8e-4d57-9067-34e1b81535a5" containerName="manager" Jun 14 22:58:49.822585 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.822534 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a5d427-de8e-4d57-9067-34e1b81535a5" containerName="manager" Jun 14 22:58:49.822619 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.822586 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="90a5d427-de8e-4d57-9067-34e1b81535a5" containerName="manager" Jun 14 22:58:49.825414 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.825396 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" Jun 14 22:58:49.827709 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.827694 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 22:58:49.827774 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.827720 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cv5t5\"" Jun 14 22:58:49.833784 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.833756 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 22:58:49.859846 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.859820 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 22:58:49.996031 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.996002 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv8ct\" (UniqueName: \"kubernetes.io/projected/9a001394-9596-48fa-8d8c-6c2bd72449f9-kube-api-access-sv8ct\") pod \"limitador-limitador-54d6d988d5-brvvh\" (UID: \"9a001394-9596-48fa-8d8c-6c2bd72449f9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" Jun 14 22:58:49.996193 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:49.996053 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a001394-9596-48fa-8d8c-6c2bd72449f9-config-file\") pod \"limitador-limitador-54d6d988d5-brvvh\" (UID: \"9a001394-9596-48fa-8d8c-6c2bd72449f9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" Jun 14 22:58:50.096613 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:50.096534 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv8ct\" (UniqueName: \"kubernetes.io/projected/9a001394-9596-48fa-8d8c-6c2bd72449f9-kube-api-access-sv8ct\") pod \"limitador-limitador-54d6d988d5-brvvh\" (UID: \"9a001394-9596-48fa-8d8c-6c2bd72449f9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" Jun 14 22:58:50.096613 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:50.096574 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a001394-9596-48fa-8d8c-6c2bd72449f9-config-file\") pod \"limitador-limitador-54d6d988d5-brvvh\" (UID: \"9a001394-9596-48fa-8d8c-6c2bd72449f9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" Jun 14 22:58:50.097190 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:50.097173 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a001394-9596-48fa-8d8c-6c2bd72449f9-config-file\") pod \"limitador-limitador-54d6d988d5-brvvh\" (UID: \"9a001394-9596-48fa-8d8c-6c2bd72449f9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" Jun 14 22:58:50.104466 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:50.104441 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv8ct\" (UniqueName: \"kubernetes.io/projected/9a001394-9596-48fa-8d8c-6c2bd72449f9-kube-api-access-sv8ct\") pod \"limitador-limitador-54d6d988d5-brvvh\" (UID: \"9a001394-9596-48fa-8d8c-6c2bd72449f9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" Jun 14 22:58:50.136300 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:50.136277 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" Jun 14 22:58:50.269632 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:50.269604 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 22:58:50.271492 ip-10-0-130-203 kubenswrapper[2548]: W0614 22:58:50.271460 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a001394_9596_48fa_8d8c_6c2bd72449f9.slice/crio-7a2325d88a68468530c5f5d8260929a0905ea881404264fcac35515ccf8d83c2 WatchSource:0}: Error finding container 7a2325d88a68468530c5f5d8260929a0905ea881404264fcac35515ccf8d83c2: Status 404 returned error can't find the container with id 7a2325d88a68468530c5f5d8260929a0905ea881404264fcac35515ccf8d83c2 Jun 14 22:58:50.272451 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:50.272422 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:50.328856 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:50.328825 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:50.963950 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:50.963899 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" event={"ID":"9a001394-9596-48fa-8d8c-6c2bd72449f9","Type":"ContainerStarted","Data":"7a2325d88a68468530c5f5d8260929a0905ea881404264fcac35515ccf8d83c2"} Jun 14 22:58:52.976808 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:52.976343 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" event={"ID":"9a001394-9596-48fa-8d8c-6c2bd72449f9","Type":"ContainerStarted","Data":"17e88020d9a0923fa4a9d906a02dfa14253955f21e71ebb01c6575cbcecf3d15"} Jun 14 22:58:52.977152 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:52.976837 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" Jun 14 22:58:52.992504 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:52.992461 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" podStartSLOduration=1.656100763 podStartE2EDuration="3.99244611s" totalImagesPullingTime="2.336345347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:52.99069214 +0000 UTC m=+678.121144485" watchObservedRunningTime="2026-06-14 22:58:52.99244611 +0000 UTC m=+678.122898434" Jun 14 22:58:54.450210 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:54.450176 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:54.549483 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:54.549453 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:59.200765 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:59.200733 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:58:59.262092 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:58:59.262067 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:59:03.982223 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:59:03.982195 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvvh" Jun 14 22:59:05.817462 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:59:05.817432 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:59:15.545076 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:59:15.545022 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:59:15.643924 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:59:15.643895 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:59:15.846360 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:59:15.846301 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:59:44.157833 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:59:44.157798 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 22:59:44.257575 ip-10-0-130-203 kubenswrapper[2548]: I0614 22:59:44.257544 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:05.992838 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:05.992794 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:13.650115 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:13.650077 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:14.149845 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:14.149796 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:19.032887 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:19.032852 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:19.123475 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:19.123444 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:19.180227 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:19.180200 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:19.419725 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:19.419646 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:23.253357 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:23.253310 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:23.341837 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:23.341807 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:27.717616 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:27.717586 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:27.766173 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:27.766143 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:54.335981 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:54.335917 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:54.451259 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:54.451229 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:54.756176 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:54.756142 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:54.860924 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:54.860893 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:00:54.987728 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:00:54.987696 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:01:30.939728 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:01:30.939693 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:01:31.040353 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:01:31.040325 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:01:45.847156 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:01:45.847121 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:01:45.936435 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:01:45.936408 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:01:52.171109 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:01:52.171063 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:01:52.527395 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:01:52.527356 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:02:03.369532 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.369494 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj"] Jun 14 23:02:03.372239 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.372216 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.374807 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.374788 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 23:02:03.376122 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.376098 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 23:02:03.376248 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.376226 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 14 23:02:03.376458 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.376436 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-h577z\"" Jun 14 23:02:03.387188 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.387166 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj"] Jun 14 23:02:03.401943 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.401907 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:02:03.487807 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.487776 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fadeb63-c64e-4126-8615-b8e99d726058-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.487987 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.487833 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fadeb63-c64e-4126-8615-b8e99d726058-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.487987 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.487883 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0fadeb63-c64e-4126-8615-b8e99d726058-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.487987 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.487919 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62xtc\" (UniqueName: \"kubernetes.io/projected/0fadeb63-c64e-4126-8615-b8e99d726058-kube-api-access-62xtc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.487987 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.487968 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fadeb63-c64e-4126-8615-b8e99d726058-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.488201 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.488018 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fadeb63-c64e-4126-8615-b8e99d726058-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.588729 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.588701 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62xtc\" (UniqueName: \"kubernetes.io/projected/0fadeb63-c64e-4126-8615-b8e99d726058-kube-api-access-62xtc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.588861 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.588734 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fadeb63-c64e-4126-8615-b8e99d726058-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.588861 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.588764 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fadeb63-c64e-4126-8615-b8e99d726058-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.588861 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.588814 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fadeb63-c64e-4126-8615-b8e99d726058-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.589074 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.588861 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fadeb63-c64e-4126-8615-b8e99d726058-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.589074 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.588895 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0fadeb63-c64e-4126-8615-b8e99d726058-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.589214 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.589193 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fadeb63-c64e-4126-8615-b8e99d726058-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.589270 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.589230 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0fadeb63-c64e-4126-8615-b8e99d726058-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.589305 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.589286 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fadeb63-c64e-4126-8615-b8e99d726058-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.591112 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.591092 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fadeb63-c64e-4126-8615-b8e99d726058-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.591277 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.591261 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fadeb63-c64e-4126-8615-b8e99d726058-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.596099 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.596076 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62xtc\" (UniqueName: \"kubernetes.io/projected/0fadeb63-c64e-4126-8615-b8e99d726058-kube-api-access-62xtc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jmwgj\" (UID: \"0fadeb63-c64e-4126-8615-b8e99d726058\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.689300 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.689240 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:03.819900 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.819871 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj"] Jun 14 23:02:03.821594 ip-10-0-130-203 kubenswrapper[2548]: W0614 23:02:03.821564 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fadeb63_c64e_4126_8615_b8e99d726058.slice/crio-50909bc12384ed2a0fda5590955fc9863390eabf9a12ff9f43df03c04425ffed WatchSource:0}: Error finding container 50909bc12384ed2a0fda5590955fc9863390eabf9a12ff9f43df03c04425ffed: Status 404 returned error can't find the container with id 50909bc12384ed2a0fda5590955fc9863390eabf9a12ff9f43df03c04425ffed Jun 14 23:02:03.894441 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.894412 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" event={"ID":"0fadeb63-c64e-4126-8615-b8e99d726058","Type":"ContainerStarted","Data":"50909bc12384ed2a0fda5590955fc9863390eabf9a12ff9f43df03c04425ffed"} Jun 14 23:02:03.966480 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:03.966451 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:02:06.912082 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:06.912045 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" event={"ID":"0fadeb63-c64e-4126-8615-b8e99d726058","Type":"ContainerStarted","Data":"b7c99aa750cd2fa628381d6dd38ea97ba48980a793248ae4a8c98ee19cb1d683"} Jun 14 23:02:08.061637 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:08.061593 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:02:08.162813 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:08.162774 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:02:08.930060 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:08.930032 2548 generic.go:356] "Generic (PLEG): container finished" podID="0fadeb63-c64e-4126-8615-b8e99d726058" containerID="b7c99aa750cd2fa628381d6dd38ea97ba48980a793248ae4a8c98ee19cb1d683" exitCode=0 Jun 14 23:02:08.930227 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:08.930101 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" event={"ID":"0fadeb63-c64e-4126-8615-b8e99d726058","Type":"ContainerDied","Data":"b7c99aa750cd2fa628381d6dd38ea97ba48980a793248ae4a8c98ee19cb1d683"} Jun 14 23:02:10.945492 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:10.945460 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" event={"ID":"0fadeb63-c64e-4126-8615-b8e99d726058","Type":"ContainerStarted","Data":"9d17c8c4e29dba6b3c711212d18448d523d9542a69269785d6412cf2edbeb2c7"} Jun 14 23:02:10.964649 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:10.964608 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" podStartSLOduration=2.577926254 podStartE2EDuration="7.964595286s" totalImagesPullingTime="4.071756305s" totalInitContainerRuntime="1.314912727s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:02:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:02:10.961874446 +0000 UTC m=+876.092326787" watchObservedRunningTime="2026-06-14 23:02:10.964595286 +0000 UTC m=+876.095047609" Jun 14 23:02:13.689987 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:13.689953 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:13.690385 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:13.690007 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:13.702737 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:13.702715 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:13.970174 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:13.970148 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jmwgj" Jun 14 23:02:14.959633 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:14.959604 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:02:15.662393 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:15.662360 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:02:25.103218 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:25.103134 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:02:25.971583 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:25.971549 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:02:29.456433 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.456403 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b"] Jun 14 23:02:29.460785 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.460763 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.463217 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.463193 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 14 23:02:29.472530 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.472505 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b"] Jun 14 23:02:29.484754 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.484728 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:02:29.582094 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.582066 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcba2b45-6c7c-4133-b7ac-4373c6344df0-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.582226 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.582105 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcba2b45-6c7c-4133-b7ac-4373c6344df0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.582226 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.582142 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7d4p\" (UniqueName: \"kubernetes.io/projected/fcba2b45-6c7c-4133-b7ac-4373c6344df0-kube-api-access-n7d4p\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.582344 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.582247 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcba2b45-6c7c-4133-b7ac-4373c6344df0-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.582344 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.582291 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcba2b45-6c7c-4133-b7ac-4373c6344df0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.582344 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.582320 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcba2b45-6c7c-4133-b7ac-4373c6344df0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.683309 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.683282 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcba2b45-6c7c-4133-b7ac-4373c6344df0-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.683417 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.683319 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcba2b45-6c7c-4133-b7ac-4373c6344df0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.683417 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.683349 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7d4p\" (UniqueName: \"kubernetes.io/projected/fcba2b45-6c7c-4133-b7ac-4373c6344df0-kube-api-access-n7d4p\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.683417 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.683380 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcba2b45-6c7c-4133-b7ac-4373c6344df0-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.683556 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.683417 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcba2b45-6c7c-4133-b7ac-4373c6344df0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.683556 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.683449 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcba2b45-6c7c-4133-b7ac-4373c6344df0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.683750 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.683726 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcba2b45-6c7c-4133-b7ac-4373c6344df0-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.683817 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.683768 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcba2b45-6c7c-4133-b7ac-4373c6344df0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.683817 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.683798 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcba2b45-6c7c-4133-b7ac-4373c6344df0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.685826 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.685792 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcba2b45-6c7c-4133-b7ac-4373c6344df0-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.686041 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.686023 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcba2b45-6c7c-4133-b7ac-4373c6344df0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.690884 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.690860 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7d4p\" (UniqueName: \"kubernetes.io/projected/fcba2b45-6c7c-4133-b7ac-4373c6344df0-kube-api-access-n7d4p\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6987b\" (UID: \"fcba2b45-6c7c-4133-b7ac-4373c6344df0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.773347 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.773321 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:29.898673 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:29.898646 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b"] Jun 14 23:02:29.900188 ip-10-0-130-203 kubenswrapper[2548]: W0614 23:02:29.900154 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcba2b45_6c7c_4133_b7ac_4373c6344df0.slice/crio-2f0f332b4d5f9559203a8e49874aead8081738a4b57a7ebac6693dbc237e30cc WatchSource:0}: Error finding container 2f0f332b4d5f9559203a8e49874aead8081738a4b57a7ebac6693dbc237e30cc: Status 404 returned error can't find the container with id 2f0f332b4d5f9559203a8e49874aead8081738a4b57a7ebac6693dbc237e30cc Jun 14 23:02:30.039147 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:30.039072 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" event={"ID":"fcba2b45-6c7c-4133-b7ac-4373c6344df0","Type":"ContainerStarted","Data":"b4d3d179500115ce88e0b0f65e96d065129379fb61a88065554e8adae7da861e"} Jun 14 23:02:30.039147 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:30.039129 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" event={"ID":"fcba2b45-6c7c-4133-b7ac-4373c6344df0","Type":"ContainerStarted","Data":"2f0f332b4d5f9559203a8e49874aead8081738a4b57a7ebac6693dbc237e30cc"} Jun 14 23:02:30.562445 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:30.562411 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:02:32.050633 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:32.050601 2548 generic.go:356] "Generic (PLEG): container finished" podID="fcba2b45-6c7c-4133-b7ac-4373c6344df0" containerID="b4d3d179500115ce88e0b0f65e96d065129379fb61a88065554e8adae7da861e" exitCode=0 Jun 14 23:02:32.051105 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:32.050679 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" event={"ID":"fcba2b45-6c7c-4133-b7ac-4373c6344df0","Type":"ContainerDied","Data":"b4d3d179500115ce88e0b0f65e96d065129379fb61a88065554e8adae7da861e"} Jun 14 23:02:33.059134 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:33.059084 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" event={"ID":"fcba2b45-6c7c-4133-b7ac-4373c6344df0","Type":"ContainerStarted","Data":"6f6ec7d8beabbf8c8ab3dfaa845a9f2b71a0ddbfac8264c619a75c826240c2ed"} Jun 14 23:02:33.081843 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:33.081795 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" podStartSLOduration=2.441989665 podStartE2EDuration="4.081781666s" totalImagesPullingTime="175.331579ms" totalInitContainerRuntime="1.464460422s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:02:33.079237739 +0000 UTC m=+898.209690311" watchObservedRunningTime="2026-06-14 23:02:33.081781666 +0000 UTC m=+898.212233989" Jun 14 23:02:33.092434 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:33.092405 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:02:34.870791 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:34.870757 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:02:35.361485 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:35.361458 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 23:02:35.361853 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:35.361675 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 23:02:38.246041 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:38.246009 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:02:39.773603 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:39.773566 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:39.779252 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:39.773642 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:39.786542 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:39.786520 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:02:40.108391 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:02:40.108317 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6987b" Jun 14 23:03:52.027010 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:03:52.026974 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:03:53.070427 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:03:53.070398 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:03:53.166840 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:03:53.166804 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:04:22.216753 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:04:22.216713 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:04:32.360454 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:04:32.360418 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:04:36.670239 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:04:36.670207 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:04:36.725639 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:04:36.725611 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:04:37.219449 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:04:37.219412 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:04:37.269706 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:04:37.269679 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:04:41.463191 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:04:41.463159 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:04:51.975093 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:04:51.975057 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:05:00.675334 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:05:00.675300 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:05:10.866589 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:05:10.866548 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:05:18.829477 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:05:18.829416 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:05:20.065576 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:05:20.065545 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:05:44.764499 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:05:44.764465 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:05:49.565580 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:05:49.565549 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:06:01.726530 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:01.726493 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:01.823628 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:01.823596 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:01.924463 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:01.924433 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:02.363804 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:02.363767 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:02.464764 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:02.464732 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:10.210169 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:10.210135 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:15.950193 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:15.950159 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:21.356153 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:21.356121 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:21.423122 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:21.423094 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:30.765130 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:30.765095 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:06:47.075193 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:47.075159 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:06:53.562885 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:53.562847 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:53.662154 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:53.662123 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:53.760671 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:53.760640 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:54.294040 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:54.294002 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:06:54.395000 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:06:54.394970 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:17.497518 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:17.497422 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:23.166507 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:23.166472 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:28.628595 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:28.628554 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:28.730079 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:28.730040 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:28.830868 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:28.830831 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:28.985227 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:28.985194 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:29.085566 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:29.085530 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:30.369208 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:30.369174 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:07:35.392262 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:35.392232 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 23:07:35.393989 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:35.393967 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 23:07:45.528504 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:45.528466 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:45.635822 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:45.635793 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:45.746364 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:45.746334 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:46.970979 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:46.970926 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:07:51.495687 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:51.495646 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:51.561756 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:51.561724 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:59.635607 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:59.635567 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:59.735626 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:59.735593 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:59.838132 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:59.838072 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:07:59.935447 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:07:59.935370 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:01.380104 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:01.380067 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:08:16.321035 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:16.321002 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:16.429266 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:16.429233 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:16.537196 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:16.537163 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:17.461579 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:17.461541 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:08:22.231652 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:22.231621 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:22.332322 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:22.332290 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:38.327671 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:38.327591 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:38.432917 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:38.432886 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:38.540901 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:38.540868 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:44.118669 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:44.118637 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:44.219231 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:44.219199 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:44.320202 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:44.320168 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:44.441003 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:44.440918 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:49.991279 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:49.991244 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:08:50.092161 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:08:50.092130 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:09:05.873865 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:09:05.873827 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:09:07.034567 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:09:07.034531 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:09:16.263975 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:09:16.263939 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:09:25.161450 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:09:25.161419 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:09:41.972484 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:09:41.972455 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:09:50.360593 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:09:50.360558 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:10:07.868530 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:10:07.868455 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:10:16.060952 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:10:16.060901 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:10:42.706610 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:10:42.706561 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:10:43.157577 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:10:43.157545 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:10:43.258240 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:10:43.258212 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:10:48.668592 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:10:48.668550 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:10:57.370950 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:10:57.370904 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:10:58.904620 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:10:58.904586 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:11:05.766528 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:11:05.766488 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:11:13.863871 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:11:13.863838 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:11:22.361740 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:11:22.361700 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:11:47.767797 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:11:47.767762 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:12:01.259181 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:12:01.259144 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:12:35.431375 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:12:35.431348 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 23:12:35.433232 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:12:35.433209 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 23:12:47.969291 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:12:47.969243 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:12:56.368652 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:12:56.368559 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:13:03.193967 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:13:03.193917 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:13:03.283055 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:13:03.283021 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:13:15.264439 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:13:15.264404 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:13:23.867213 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:13:23.867178 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:13:32.865459 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:13:32.865416 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:13:41.569648 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:13:41.569602 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:13:50.368164 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:13:50.368120 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:13:59.164334 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:13:59.164291 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:14:07.872026 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:14:07.871985 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:14:16.168636 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:14:16.168596 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:14:24.560302 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:14:24.560258 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:14:32.764650 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:14:32.764612 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:15:31.969562 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:31.969524 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:15:34.424791 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.424759 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t"] Jun 14 23:15:34.425257 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.424978 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" podUID="ba76af98-fb13-4e6b-b91f-1f911d032894" containerName="manager" containerID="cri-o://90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec" gracePeriod=10 Jun 14 23:15:34.677441 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.677378 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" Jun 14 23:15:34.773173 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.773138 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba76af98-fb13-4e6b-b91f-1f911d032894-extensions-socket-volume\") pod \"ba76af98-fb13-4e6b-b91f-1f911d032894\" (UID: \"ba76af98-fb13-4e6b-b91f-1f911d032894\") " Jun 14 23:15:34.773348 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.773205 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnhqn\" (UniqueName: \"kubernetes.io/projected/ba76af98-fb13-4e6b-b91f-1f911d032894-kube-api-access-rnhqn\") pod \"ba76af98-fb13-4e6b-b91f-1f911d032894\" (UID: \"ba76af98-fb13-4e6b-b91f-1f911d032894\") " Jun 14 23:15:34.773641 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.773607 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba76af98-fb13-4e6b-b91f-1f911d032894-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ba76af98-fb13-4e6b-b91f-1f911d032894" (UID: "ba76af98-fb13-4e6b-b91f-1f911d032894"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 23:15:34.775321 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.775301 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba76af98-fb13-4e6b-b91f-1f911d032894-kube-api-access-rnhqn" (OuterVolumeSpecName: "kube-api-access-rnhqn") pod "ba76af98-fb13-4e6b-b91f-1f911d032894" (UID: "ba76af98-fb13-4e6b-b91f-1f911d032894"). InnerVolumeSpecName "kube-api-access-rnhqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:15:34.874321 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.874275 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnhqn\" (UniqueName: \"kubernetes.io/projected/ba76af98-fb13-4e6b-b91f-1f911d032894-kube-api-access-rnhqn\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 23:15:34.874321 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.874316 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba76af98-fb13-4e6b-b91f-1f911d032894-extensions-socket-volume\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 23:15:34.908906 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.908862 2548 generic.go:356] "Generic (PLEG): container finished" podID="ba76af98-fb13-4e6b-b91f-1f911d032894" containerID="90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec" exitCode=0 Jun 14 23:15:34.908906 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.908905 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" Jun 14 23:15:34.909120 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.908951 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" event={"ID":"ba76af98-fb13-4e6b-b91f-1f911d032894","Type":"ContainerDied","Data":"90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec"} Jun 14 23:15:34.909120 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.909006 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t" event={"ID":"ba76af98-fb13-4e6b-b91f-1f911d032894","Type":"ContainerDied","Data":"c6e0f88dbae21de3172ea1847cf7bdd1fdeb46f84e14ddeeb0175f049d12dfb2"} Jun 14 23:15:34.909120 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.909029 2548 scope.go:117] "RemoveContainer" containerID="90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec" Jun 14 23:15:34.919153 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.919132 2548 scope.go:117] "RemoveContainer" containerID="90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec" Jun 14 23:15:34.919535 ip-10-0-130-203 kubenswrapper[2548]: E0614 23:15:34.919506 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec\": container with ID starting with 90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec not found: ID does not exist" containerID="90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec" Jun 14 23:15:34.919641 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.919543 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec"} err="failed to get container status \"90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec\": rpc error: code = NotFound desc = could not find container \"90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec\": container with ID starting with 90c04eca61c58e4506df964b93d7eca081dac4591c0d7c899e906c8a6c0bd0ec not found: ID does not exist" Jun 14 23:15:34.935084 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.930365 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t"] Jun 14 23:15:34.937583 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:34.937556 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p2s8t"] Jun 14 23:15:35.346843 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:15:35.346805 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba76af98-fb13-4e6b-b91f-1f911d032894" path="/var/lib/kubelet/pods/ba76af98-fb13-4e6b-b91f-1f911d032894/volumes" Jun 14 23:16:35.572891 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.572852 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9"] Jun 14 23:16:35.573347 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.573224 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba76af98-fb13-4e6b-b91f-1f911d032894" containerName="manager" Jun 14 23:16:35.573347 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.573236 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba76af98-fb13-4e6b-b91f-1f911d032894" containerName="manager" Jun 14 23:16:35.573347 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.573298 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba76af98-fb13-4e6b-b91f-1f911d032894" containerName="manager" Jun 14 23:16:35.576187 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.576171 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" Jun 14 23:16:35.578602 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.578583 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-65gmb\"" Jun 14 23:16:35.586182 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.586156 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9"] Jun 14 23:16:35.594365 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.594335 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80a09bd6-fb2f-4793-9d33-318810105d42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qpbl9\" (UID: \"80a09bd6-fb2f-4793-9d33-318810105d42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" Jun 14 23:16:35.594510 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.594398 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nw8w\" (UniqueName: \"kubernetes.io/projected/80a09bd6-fb2f-4793-9d33-318810105d42-kube-api-access-7nw8w\") pod \"kuadrant-operator-controller-manager-86878c769f-qpbl9\" (UID: \"80a09bd6-fb2f-4793-9d33-318810105d42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" Jun 14 23:16:35.695614 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.695574 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80a09bd6-fb2f-4793-9d33-318810105d42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qpbl9\" (UID: \"80a09bd6-fb2f-4793-9d33-318810105d42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" Jun 14 23:16:35.695786 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.695633 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nw8w\" (UniqueName: \"kubernetes.io/projected/80a09bd6-fb2f-4793-9d33-318810105d42-kube-api-access-7nw8w\") pod \"kuadrant-operator-controller-manager-86878c769f-qpbl9\" (UID: \"80a09bd6-fb2f-4793-9d33-318810105d42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" Jun 14 23:16:35.695982 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.695963 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80a09bd6-fb2f-4793-9d33-318810105d42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qpbl9\" (UID: \"80a09bd6-fb2f-4793-9d33-318810105d42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" Jun 14 23:16:35.704151 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.704118 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nw8w\" (UniqueName: \"kubernetes.io/projected/80a09bd6-fb2f-4793-9d33-318810105d42-kube-api-access-7nw8w\") pod \"kuadrant-operator-controller-manager-86878c769f-qpbl9\" (UID: \"80a09bd6-fb2f-4793-9d33-318810105d42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" Jun 14 23:16:35.886660 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:35.886562 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" Jun 14 23:16:36.029403 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:36.029367 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9"] Jun 14 23:16:36.031272 ip-10-0-130-203 kubenswrapper[2548]: W0614 23:16:36.031247 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a09bd6_fb2f_4793_9d33_318810105d42.slice/crio-fe488e619d21bff1e6346b9a90e481bb0d9c21cf320261344a3024d202dcf5ec WatchSource:0}: Error finding container fe488e619d21bff1e6346b9a90e481bb0d9c21cf320261344a3024d202dcf5ec: Status 404 returned error can't find the container with id fe488e619d21bff1e6346b9a90e481bb0d9c21cf320261344a3024d202dcf5ec Jun 14 23:16:36.212431 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:36.212392 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" event={"ID":"80a09bd6-fb2f-4793-9d33-318810105d42","Type":"ContainerStarted","Data":"41aefd90cd25d313b1b0f770f6e7852803f8a38a9de35b359743b563110a7303"} Jun 14 23:16:36.212656 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:36.212460 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" event={"ID":"80a09bd6-fb2f-4793-9d33-318810105d42","Type":"ContainerStarted","Data":"fe488e619d21bff1e6346b9a90e481bb0d9c21cf320261344a3024d202dcf5ec"} Jun 14 23:16:36.212656 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:36.212491 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" Jun 14 23:16:36.230598 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:36.230546 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" podStartSLOduration=1.230529057 podStartE2EDuration="1.230529057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:16:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:16:36.229733006 +0000 UTC m=+1741.360185359" watchObservedRunningTime="2026-06-14 23:16:36.230529057 +0000 UTC m=+1741.360981382" Jun 14 23:16:47.220379 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:47.220341 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpbl9" Jun 14 23:16:55.265455 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:16:55.265411 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:17:00.259088 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:17:00.259049 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:17:25.962262 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:17:25.962171 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:17:30.673090 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:17:30.673052 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:17:35.462425 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:17:35.462394 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 23:17:35.465541 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:17:35.465521 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 23:17:37.965206 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:17:37.965168 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:17:48.565343 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:17:48.565301 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:17:58.276702 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:17:58.276656 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:18:08.059342 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:18:08.059298 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:18:16.771876 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:18:16.771835 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:18:27.759361 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:18:27.759325 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:18:35.865371 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:18:35.865333 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:18:45.760296 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:18:45.760258 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:18:55.373675 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:18:55.373593 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:19:00.760779 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:19:00.760737 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:19:28.164679 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:19:28.164642 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:20:11.164789 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:20:11.164752 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:20:19.964470 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:20:19.964435 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:20:28.367001 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:20:28.366877 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:20:37.060708 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:20:37.060669 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:20:46.367944 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:20:46.367889 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:20:58.069182 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:20:58.069148 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:21:07.065874 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:21:07.065835 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:21:12.631888 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:21:12.631851 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:21:20.559914 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:21:20.559868 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:21:27.361823 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:21:27.361787 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:21:35.665913 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:21:35.665875 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:21:35.834034 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:21:35.833999 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:21:36.814872 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:21:36.814833 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:21:46.066258 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:21:46.066218 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:22:03.975565 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:22:03.975485 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:22:12.666094 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:22:12.666056 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:22:21.270686 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:22:21.270627 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:22:29.669131 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:22:29.669097 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:22:35.503581 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:22:35.503547 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 23:22:35.505447 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:22:35.505426 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c6wmz_6c4ad5dd-5283-404f-b55b-8ab360f24839/ovn-acl-logging/0.log" Jun 14 23:22:46.770361 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:22:46.770321 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:22:55.165806 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:22:55.165774 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:23:03.769671 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:23:03.769630 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:23:12.268760 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:23:12.268729 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:23:20.866788 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:23:20.866744 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:23:30.364917 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:23:30.364830 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:23:38.667719 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:23:38.667679 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:23:51.570205 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:23:51.570137 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:24:00.765310 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:24:00.765263 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:24:05.124537 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:24:05.124502 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:24:05.213633 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:24:05.213596 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:24:11.567793 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:24:11.567753 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:24:21.362297 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:24:21.362260 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:24:26.561594 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:24:26.561551 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:24:33.171605 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:24:33.171570 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:24:38.475682 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:24:38.475640 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:24:52.961858 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:24:52.961818 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:25:01.668952 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:01.668839 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:25:09.562588 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:09.562547 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:10.969108 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:10.969072 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:25:12.808246 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:12.808207 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:17.468961 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:17.468908 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:25:37.071562 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:37.071529 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:38.669784 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:38.669729 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:25:50.085685 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:50.085649 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:51.062855 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.062818 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:25:51.640417 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.640381 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:51.739803 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.739774 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:51.844634 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.844599 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:51.866374 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.866332 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk"] Jun 14 23:25:51.869732 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.869716 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:51.872386 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.872363 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 14 23:25:51.873256 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.873240 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bwv4g\"" Jun 14 23:25:51.880690 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.880619 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk"] Jun 14 23:25:51.940542 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.940508 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:51.955613 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.955583 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8aad251-648e-418e-881b-800414d800fa-maas-api-tls\") pod \"maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk\" (UID: \"e8aad251-648e-418e-881b-800414d800fa\") " pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:51.955814 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.955638 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8aad251-648e-418e-881b-800414d800fa-openshift-service-ca\") pod \"maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk\" (UID: \"e8aad251-648e-418e-881b-800414d800fa\") " pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:51.955814 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:51.955669 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj6q4\" (UniqueName: \"kubernetes.io/projected/e8aad251-648e-418e-881b-800414d800fa-kube-api-access-jj6q4\") pod \"maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk\" (UID: \"e8aad251-648e-418e-881b-800414d800fa\") " pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:52.056366 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.056330 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj6q4\" (UniqueName: \"kubernetes.io/projected/e8aad251-648e-418e-881b-800414d800fa-kube-api-access-jj6q4\") pod \"maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk\" (UID: \"e8aad251-648e-418e-881b-800414d800fa\") " pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:52.056557 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.056390 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8aad251-648e-418e-881b-800414d800fa-maas-api-tls\") pod \"maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk\" (UID: \"e8aad251-648e-418e-881b-800414d800fa\") " pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:52.056557 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.056433 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8aad251-648e-418e-881b-800414d800fa-openshift-service-ca\") pod \"maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk\" (UID: \"e8aad251-648e-418e-881b-800414d800fa\") " pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:52.057071 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.057041 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8aad251-648e-418e-881b-800414d800fa-openshift-service-ca\") pod \"maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk\" (UID: \"e8aad251-648e-418e-881b-800414d800fa\") " pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:52.058910 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.058887 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8aad251-648e-418e-881b-800414d800fa-maas-api-tls\") pod \"maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk\" (UID: \"e8aad251-648e-418e-881b-800414d800fa\") " pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:52.070029 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.070001 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj6q4\" (UniqueName: \"kubernetes.io/projected/e8aad251-648e-418e-881b-800414d800fa-kube-api-access-jj6q4\") pod \"maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk\" (UID: \"e8aad251-648e-418e-881b-800414d800fa\") " pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:52.107168 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.107113 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:52.182409 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.182315 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:52.333097 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.333016 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk"] Jun 14 23:25:52.335448 ip-10-0-130-203 kubenswrapper[2548]: W0614 23:25:52.335418 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8aad251_648e_418e_881b_800414d800fa.slice/crio-adc3c0d78b3add8a3d9427b2351a54850566e6f0b9349fbe2a601e395cdf9597 WatchSource:0}: Error finding container adc3c0d78b3add8a3d9427b2351a54850566e6f0b9349fbe2a601e395cdf9597: Status 404 returned error can't find the container with id adc3c0d78b3add8a3d9427b2351a54850566e6f0b9349fbe2a601e395cdf9597 Jun 14 23:25:52.337159 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.337123 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 23:25:52.457766 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.457678 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:52.559081 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.559048 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:52.982707 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:52.982665 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" event={"ID":"e8aad251-648e-418e-881b-800414d800fa","Type":"ContainerStarted","Data":"adc3c0d78b3add8a3d9427b2351a54850566e6f0b9349fbe2a601e395cdf9597"} Jun 14 23:25:54.995788 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:54.995751 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" event={"ID":"e8aad251-648e-418e-881b-800414d800fa","Type":"ContainerStarted","Data":"8ae232be8c6839bcf2b0ce24c50839bcd2b9c20395bb6f728a3899108f0ca24f"} Jun 14 23:25:54.996231 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:54.995872 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:55.012952 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:55.012889 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" podStartSLOduration=2.309187953 podStartE2EDuration="4.01287127s" totalImagesPullingTime="1.703683317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:25:55.010421696 +0000 UTC m=+2300.140874037" watchObservedRunningTime="2026-06-14 23:25:55.01287127 +0000 UTC m=+2300.143323587" Jun 14 23:25:55.083142 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:55.083107 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:57.470614 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:57.470576 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:25:57.783504 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:57.783405 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk"] Jun 14 23:25:57.783704 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:57.783648 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" podUID="e8aad251-648e-418e-881b-800414d800fa" containerName="maas-api" containerID="cri-o://8ae232be8c6839bcf2b0ce24c50839bcd2b9c20395bb6f728a3899108f0ca24f" gracePeriod=30 Jun 14 23:25:57.802654 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:57.802553 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:57.900037 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:57.900002 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:58.005342 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.005308 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:58.013682 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.013648 2548 generic.go:356] "Generic (PLEG): container finished" podID="e8aad251-648e-418e-881b-800414d800fa" containerID="8ae232be8c6839bcf2b0ce24c50839bcd2b9c20395bb6f728a3899108f0ca24f" exitCode=0 Jun 14 23:25:58.013834 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.013780 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" event={"ID":"e8aad251-648e-418e-881b-800414d800fa","Type":"ContainerDied","Data":"8ae232be8c6839bcf2b0ce24c50839bcd2b9c20395bb6f728a3899108f0ca24f"} Jun 14 23:25:58.013834 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.013827 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" event={"ID":"e8aad251-648e-418e-881b-800414d800fa","Type":"ContainerDied","Data":"adc3c0d78b3add8a3d9427b2351a54850566e6f0b9349fbe2a601e395cdf9597"} Jun 14 23:25:58.013972 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.013849 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="adc3c0d78b3add8a3d9427b2351a54850566e6f0b9349fbe2a601e395cdf9597" Jun 14 23:25:58.026403 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.026374 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:58.102702 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.102616 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:25:58.110640 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.110600 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8aad251-648e-418e-881b-800414d800fa-maas-api-tls\") pod \"e8aad251-648e-418e-881b-800414d800fa\" (UID: \"e8aad251-648e-418e-881b-800414d800fa\") " Jun 14 23:25:58.110640 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.110641 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj6q4\" (UniqueName: \"kubernetes.io/projected/e8aad251-648e-418e-881b-800414d800fa-kube-api-access-jj6q4\") pod \"e8aad251-648e-418e-881b-800414d800fa\" (UID: \"e8aad251-648e-418e-881b-800414d800fa\") " Jun 14 23:25:58.110913 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.110730 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8aad251-648e-418e-881b-800414d800fa-openshift-service-ca\") pod \"e8aad251-648e-418e-881b-800414d800fa\" (UID: \"e8aad251-648e-418e-881b-800414d800fa\") " Jun 14 23:25:58.111370 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.111337 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8aad251-648e-418e-881b-800414d800fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8aad251-648e-418e-881b-800414d800fa" (UID: "e8aad251-648e-418e-881b-800414d800fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 23:25:58.115185 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.113963 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8aad251-648e-418e-881b-800414d800fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8aad251-648e-418e-881b-800414d800fa" (UID: "e8aad251-648e-418e-881b-800414d800fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 23:25:58.115185 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.114063 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8aad251-648e-418e-881b-800414d800fa-kube-api-access-jj6q4" (OuterVolumeSpecName: "kube-api-access-jj6q4") pod "e8aad251-648e-418e-881b-800414d800fa" (UID: "e8aad251-648e-418e-881b-800414d800fa"). InnerVolumeSpecName "kube-api-access-jj6q4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:25:58.211950 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.211908 2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8aad251-648e-418e-881b-800414d800fa-openshift-service-ca\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 23:25:58.211950 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.211954 2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8aad251-648e-418e-881b-800414d800fa-maas-api-tls\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 23:25:58.212146 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:58.211969 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj6q4\" (UniqueName: \"kubernetes.io/projected/e8aad251-648e-418e-881b-800414d800fa-kube-api-access-jj6q4\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 23:25:59.018312 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:59.018276 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk" Jun 14 23:25:59.038659 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:59.038627 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk"] Jun 14 23:25:59.042353 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:59.042323 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-d5e070aa-9d48f767b-p5tfk"] Jun 14 23:25:59.347624 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:59.347538 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8aad251-648e-418e-881b-800414d800fa" path="/var/lib/kubelet/pods/e8aad251-648e-418e-881b-800414d800fa/volumes" Jun 14 23:25:59.673149 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:25:59.673121 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:00.664544 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:00.664500 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:26:03.864867 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:03.864828 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:03.916319 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:03.916285 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:04.071736 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.071705 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:04.170629 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.170540 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:04.269606 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.269568 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:04.291225 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.291187 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw"] Jun 14 23:26:04.291536 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.291524 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8aad251-648e-418e-881b-800414d800fa" containerName="maas-api" Jun 14 23:26:04.291583 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.291539 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8aad251-648e-418e-881b-800414d800fa" containerName="maas-api" Jun 14 23:26:04.291617 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.291603 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8aad251-648e-418e-881b-800414d800fa" containerName="maas-api" Jun 14 23:26:04.295848 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.295825 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:04.299315 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.299070 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bwv4g\"" Jun 14 23:26:04.299315 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.299082 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 14 23:26:04.302786 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.302757 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw"] Jun 14 23:26:04.364803 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.364762 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-openshift-service-ca\") pod \"maas-api-e2e-ait-671a43d2-9c56ff897-sgllw\" (UID: \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\") " pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:04.365002 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.364820 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-maas-api-tls\") pod \"maas-api-e2e-ait-671a43d2-9c56ff897-sgllw\" (UID: \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\") " pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:04.365002 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.364912 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bfsx\" (UniqueName: \"kubernetes.io/projected/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-kube-api-access-5bfsx\") pod \"maas-api-e2e-ait-671a43d2-9c56ff897-sgllw\" (UID: \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\") " pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:04.369292 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.369268 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:04.466180 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.466144 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bfsx\" (UniqueName: \"kubernetes.io/projected/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-kube-api-access-5bfsx\") pod \"maas-api-e2e-ait-671a43d2-9c56ff897-sgllw\" (UID: \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\") " pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:04.466464 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.466244 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-openshift-service-ca\") pod \"maas-api-e2e-ait-671a43d2-9c56ff897-sgllw\" (UID: \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\") " pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:04.466464 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.466328 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-maas-api-tls\") pod \"maas-api-e2e-ait-671a43d2-9c56ff897-sgllw\" (UID: \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\") " pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:04.467096 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.467075 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-openshift-service-ca\") pod \"maas-api-e2e-ait-671a43d2-9c56ff897-sgllw\" (UID: \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\") " pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:04.468989 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.468968 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-maas-api-tls\") pod \"maas-api-e2e-ait-671a43d2-9c56ff897-sgllw\" (UID: \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\") " pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:04.470134 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.470112 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:04.474597 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.474571 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bfsx\" (UniqueName: \"kubernetes.io/projected/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-kube-api-access-5bfsx\") pod \"maas-api-e2e-ait-671a43d2-9c56ff897-sgllw\" (UID: \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\") " pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:04.608943 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.608886 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:04.760517 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.760443 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw"] Jun 14 23:26:04.762874 ip-10-0-130-203 kubenswrapper[2548]: W0614 23:26:04.762843 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3841a7a3_c98f_4c3d_bbcd_d72d202f9cce.slice/crio-e30e86b8aa235c5f379d16cce5286ef6ed4bd351dd282bd426d60c05495c336f WatchSource:0}: Error finding container e30e86b8aa235c5f379d16cce5286ef6ed4bd351dd282bd426d60c05495c336f: Status 404 returned error can't find the container with id e30e86b8aa235c5f379d16cce5286ef6ed4bd351dd282bd426d60c05495c336f Jun 14 23:26:04.878658 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.878619 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:04.982487 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:04.982450 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:05.053392 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:05.053306 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" event={"ID":"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce","Type":"ContainerStarted","Data":"e30e86b8aa235c5f379d16cce5286ef6ed4bd351dd282bd426d60c05495c336f"} Jun 14 23:26:06.062551 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:06.062509 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" event={"ID":"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce","Type":"ContainerStarted","Data":"3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42"} Jun 14 23:26:06.062913 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:06.062649 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:06.079175 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:06.079122 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" podStartSLOduration=1.682793918 podStartE2EDuration="2.079106399s" totalImagesPullingTime="396.312481ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:26:06.077272078 +0000 UTC m=+2311.207724437" watchObservedRunningTime="2026-06-14 23:26:06.079106399 +0000 UTC m=+2311.209558764" Jun 14 23:26:06.174727 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:06.174684 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:26:07.241228 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:07.241185 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:10.227888 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.227836 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw"] Jun 14 23:26:10.228374 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.228261 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" podUID="3841a7a3-c98f-4c3d-bbcd-d72d202f9cce" containerName="maas-api" containerID="cri-o://3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42" gracePeriod=30 Jun 14 23:26:10.235066 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.235042 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:10.246772 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.246736 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:10.345399 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.345370 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:10.483739 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.483676 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:10.623713 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.623684 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-maas-api-tls\") pod \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\" (UID: \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\") " Jun 14 23:26:10.623891 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.623728 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-openshift-service-ca\") pod \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\" (UID: \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\") " Jun 14 23:26:10.623891 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.623815 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bfsx\" (UniqueName: \"kubernetes.io/projected/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-kube-api-access-5bfsx\") pod \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\" (UID: \"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce\") " Jun 14 23:26:10.624145 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.624112 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3841a7a3-c98f-4c3d-bbcd-d72d202f9cce" (UID: "3841a7a3-c98f-4c3d-bbcd-d72d202f9cce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 23:26:10.625821 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.625796 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3841a7a3-c98f-4c3d-bbcd-d72d202f9cce" (UID: "3841a7a3-c98f-4c3d-bbcd-d72d202f9cce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 23:26:10.625953 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.625919 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-kube-api-access-5bfsx" (OuterVolumeSpecName: "kube-api-access-5bfsx") pod "3841a7a3-c98f-4c3d-bbcd-d72d202f9cce" (UID: "3841a7a3-c98f-4c3d-bbcd-d72d202f9cce"). InnerVolumeSpecName "kube-api-access-5bfsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:26:10.724748 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.724710 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bfsx\" (UniqueName: \"kubernetes.io/projected/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-kube-api-access-5bfsx\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 23:26:10.724748 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.724743 2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-maas-api-tls\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 23:26:10.724748 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:10.724753 2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce-openshift-service-ca\") on node \"ip-10-0-130-203.ec2.internal\" DevicePath \"\"" Jun 14 23:26:11.088676 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.088638 2548 generic.go:356] "Generic (PLEG): container finished" podID="3841a7a3-c98f-4c3d-bbcd-d72d202f9cce" containerID="3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42" exitCode=0 Jun 14 23:26:11.088870 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.088681 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" Jun 14 23:26:11.088870 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.088726 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" event={"ID":"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce","Type":"ContainerDied","Data":"3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42"} Jun 14 23:26:11.088870 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.088776 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw" event={"ID":"3841a7a3-c98f-4c3d-bbcd-d72d202f9cce","Type":"ContainerDied","Data":"e30e86b8aa235c5f379d16cce5286ef6ed4bd351dd282bd426d60c05495c336f"} Jun 14 23:26:11.088870 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.088799 2548 scope.go:117] "RemoveContainer" containerID="3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42" Jun 14 23:26:11.098130 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.098113 2548 scope.go:117] "RemoveContainer" containerID="3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42" Jun 14 23:26:11.098406 ip-10-0-130-203 kubenswrapper[2548]: E0614 23:26:11.098389 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42\": container with ID starting with 3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42 not found: ID does not exist" containerID="3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42" Jun 14 23:26:11.098457 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.098415 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42"} err="failed to get container status \"3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42\": rpc error: code = NotFound desc = could not find container \"3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42\": container with ID starting with 3d3ddcd9c9e200da34f9231f3b7da9e0cb930e73710f269941febebff241aa42 not found: ID does not exist" Jun 14 23:26:11.114756 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.110605 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw"] Jun 14 23:26:11.118057 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.118026 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-671a43d2-9c56ff897-sgllw"] Jun 14 23:26:11.346610 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.346526 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3841a7a3-c98f-4c3d-bbcd-d72d202f9cce" path="/var/lib/kubelet/pods/3841a7a3-c98f-4c3d-bbcd-d72d202f9cce/volumes" Jun 14 23:26:11.368345 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.368272 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvvh"] Jun 14 23:26:11.465223 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.465189 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:11.571913 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:11.571875 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:14.130473 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:14.130439 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:17.215488 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:17.215433 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:17.278160 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:17.278125 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:27.765276 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:27.765205 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7dcf6b5898-8jccl_3f8c8879-1d24-4ff5-8d17-2924ec681577/nginx/0.log" Jun 14 23:26:27.998516 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:27.998483 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-f4jrw_a3b6f882-a04c-4133-adaf-290b81bdc593/manager/0.log" Jun 14 23:26:28.115227 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:28.115135 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-p2vfk_05c753b0-ca21-4e83-a607-7167ef049b14/manager/0.log" Jun 14 23:26:28.556830 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:28.556802 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-p5ksw_346a4127-a3b8-40f3-83d1-591a526ee5da/server/0.log" Jun 14 23:26:28.674850 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:28.674818 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-mkxft_6d2d20b1-7a42-47c9-9dca-7e0164915104/manager/0.log" Jun 14 23:26:29.017426 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:29.017397 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cf75689df-t6n7v_3ed51e43-7fa1-476b-bcef-b3b665448bfc/copy-manifests/0.log" Jun 14 23:26:29.029198 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:29.029167 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cf75689df-t6n7v_3ed51e43-7fa1-476b-bcef-b3b665448bfc/manager/0.log" Jun 14 23:26:29.865531 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:29.865500 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9_4d94a73c-e405-4b64-8cfb-67fb59b3b630/util/0.log" Jun 14 23:26:29.871388 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:29.871362 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9_4d94a73c-e405-4b64-8cfb-67fb59b3b630/pull/0.log" Jun 14 23:26:29.877280 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:29.877254 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9_4d94a73c-e405-4b64-8cfb-67fb59b3b630/extract/0.log" Jun 14 23:26:29.984502 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:29.984472 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht_f9b598ca-049f-4d52-b7a6-57308e36b228/util/0.log" Jun 14 23:26:29.990357 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:29.990333 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht_f9b598ca-049f-4d52-b7a6-57308e36b228/pull/0.log" Jun 14 23:26:29.998178 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:29.998159 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht_f9b598ca-049f-4d52-b7a6-57308e36b228/extract/0.log" Jun 14 23:26:30.103523 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:30.103493 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz_d597e994-6184-47a4-be52-4dcb8f9c3cba/pull/0.log" Jun 14 23:26:30.109797 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:30.109777 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz_d597e994-6184-47a4-be52-4dcb8f9c3cba/extract/0.log" Jun 14 23:26:30.116417 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:30.116359 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz_d597e994-6184-47a4-be52-4dcb8f9c3cba/util/0.log" Jun 14 23:26:30.219451 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:30.219420 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5_12faea3e-3db7-4bc7-93bc-21b3028a3b5f/extract/0.log" Jun 14 23:26:30.225289 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:30.225258 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5_12faea3e-3db7-4bc7-93bc-21b3028a3b5f/util/0.log" Jun 14 23:26:30.231166 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:30.231145 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5_12faea3e-3db7-4bc7-93bc-21b3028a3b5f/pull/0.log" Jun 14 23:26:30.894213 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:30.894182 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qpbl9_80a09bd6-fb2f-4793-9d33-318810105d42/manager/0.log" Jun 14 23:26:31.010165 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:31.010138 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-brvvh_9a001394-9596-48fa-8d8c-6c2bd72449f9/limitador/0.log" Jun 14 23:26:31.564161 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:31.564128 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-47n5s_67e73129-2bcb-4a04-9b47-b979497fa4ae/discovery/0.log" Jun 14 23:26:31.775680 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:31.775651 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f989997cb-tk98z_0e001a7d-d5db-45bc-9e62-7791702dd19a/kube-auth-proxy/0.log" Jun 14 23:26:32.655388 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:32.655360 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-jmwgj_0fadeb63-c64e-4126-8615-b8e99d726058/storage-initializer/0.log" Jun 14 23:26:32.662234 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:32.662212 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-jmwgj_0fadeb63-c64e-4126-8615-b8e99d726058/main/0.log" Jun 14 23:26:32.992540 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:32.992514 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-6987b_fcba2b45-6c7c-4133-b7ac-4373c6344df0/main/0.log" Jun 14 23:26:32.998521 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:32.998498 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-6987b_fcba2b45-6c7c-4133-b7ac-4373c6344df0/storage-initializer/0.log" Jun 14 23:26:36.591666 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:36.591624 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:36.652635 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:36.652599 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" limit=1024 Jun 14 23:26:39.720952 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:39.720907 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xx4zd_57671521-d126-4c0a-9ac7-ef06884dac62/global-pull-secret-syncer/0.log" Jun 14 23:26:39.763983 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:39.763948 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-78k5w_ab0cff7b-a262-4bd2-9fdb-35b311aa0646/konnectivity-agent/0.log" Jun 14 23:26:39.892050 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:39.892021 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-203.ec2.internal_738d6f7c5f4c9f5c3c78855ee0695e2a/haproxy/0.log" Jun 14 23:26:43.835427 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:43.835391 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-lf295_dc5a0130-96a0-4735-9ea5-12b711ba612b/sail-operator/0.log" Jun 14 23:26:44.266499 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:44.266471 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9_4d94a73c-e405-4b64-8cfb-67fb59b3b630/extract/0.log" Jun 14 23:26:44.303435 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:44.303403 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9_4d94a73c-e405-4b64-8cfb-67fb59b3b630/util/0.log" Jun 14 23:26:44.329221 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:44.329195 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592cfn9_4d94a73c-e405-4b64-8cfb-67fb59b3b630/pull/0.log" Jun 14 23:26:44.364158 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:44.364119 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht_f9b598ca-049f-4d52-b7a6-57308e36b228/extract/0.log" Jun 14 23:26:44.390924 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:44.390893 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht_f9b598ca-049f-4d52-b7a6-57308e36b228/util/0.log" Jun 14 23:26:44.414269 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:44.414241 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtrht_f9b598ca-049f-4d52-b7a6-57308e36b228/pull/0.log" Jun 14 23:26:44.476524 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:44.476491 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz_d597e994-6184-47a4-be52-4dcb8f9c3cba/extract/0.log" Jun 14 23:26:44.493377 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:44.493353 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz_d597e994-6184-47a4-be52-4dcb8f9c3cba/util/0.log" Jun 14 23:26:44.514874 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:44.514850 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fcbdz_d597e994-6184-47a4-be52-4dcb8f9c3cba/pull/0.log" Jun 14 23:26:44.552519 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:44.552434 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5_12faea3e-3db7-4bc7-93bc-21b3028a3b5f/extract/0.log" Jun 14 23:26:44.578150 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:44.578117 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5_12faea3e-3db7-4bc7-93bc-21b3028a3b5f/util/0.log" Jun 14 23:26:44.600120 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:44.600088 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rpbk5_12faea3e-3db7-4bc7-93bc-21b3028a3b5f/pull/0.log" Jun 14 23:26:45.232234 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:45.232199 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qpbl9_80a09bd6-fb2f-4793-9d33-318810105d42/manager/0.log" Jun 14 23:26:45.255560 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:45.255525 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-brvvh_9a001394-9596-48fa-8d8c-6c2bd72449f9/limitador/0.log" Jun 14 23:26:47.283163 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:47.283133 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llzjq_16a0c95f-ad51-43b5-9664-d0414555629c/node-exporter/0.log" Jun 14 23:26:47.301940 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:47.301900 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llzjq_16a0c95f-ad51-43b5-9664-d0414555629c/kube-rbac-proxy/0.log" Jun 14 23:26:47.326291 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:47.326265 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llzjq_16a0c95f-ad51-43b5-9664-d0414555629c/init-textfile/0.log" Jun 14 23:26:50.994429 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:50.994384 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc"] Jun 14 23:26:50.994813 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:50.994736 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3841a7a3-c98f-4c3d-bbcd-d72d202f9cce" containerName="maas-api" Jun 14 23:26:50.994813 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:50.994747 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="3841a7a3-c98f-4c3d-bbcd-d72d202f9cce" containerName="maas-api" Jun 14 23:26:50.994813 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:50.994807 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="3841a7a3-c98f-4c3d-bbcd-d72d202f9cce" containerName="maas-api" Jun 14 23:26:50.997809 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:50.997783 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.000099 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.000072 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jpxx4\"/\"default-dockercfg-wmz5r\"" Jun 14 23:26:51.000211 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.000154 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jpxx4\"/\"openshift-service-ca.crt\"" Jun 14 23:26:51.000971 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.000957 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jpxx4\"/\"kube-root-ca.crt\"" Jun 14 23:26:51.004847 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.004819 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc"] Jun 14 23:26:51.062626 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.062583 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5k88\" (UniqueName: \"kubernetes.io/projected/8c610e55-8429-48da-bb10-a89b60d779b5-kube-api-access-j5k88\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.062811 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.062696 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c610e55-8429-48da-bb10-a89b60d779b5-podres\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.062811 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.062742 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c610e55-8429-48da-bb10-a89b60d779b5-proc\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.062811 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.062765 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c610e55-8429-48da-bb10-a89b60d779b5-lib-modules\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.063004 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.062818 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c610e55-8429-48da-bb10-a89b60d779b5-sys\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.164029 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.163991 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c610e55-8429-48da-bb10-a89b60d779b5-podres\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.164029 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.164033 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c610e55-8429-48da-bb10-a89b60d779b5-proc\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.164295 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.164053 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c610e55-8429-48da-bb10-a89b60d779b5-lib-modules\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.164295 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.164072 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c610e55-8429-48da-bb10-a89b60d779b5-sys\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.164295 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.164128 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5k88\" (UniqueName: \"kubernetes.io/projected/8c610e55-8429-48da-bb10-a89b60d779b5-kube-api-access-j5k88\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.164295 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.164131 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c610e55-8429-48da-bb10-a89b60d779b5-proc\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.164295 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.164177 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c610e55-8429-48da-bb10-a89b60d779b5-lib-modules\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.164295 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.164180 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c610e55-8429-48da-bb10-a89b60d779b5-podres\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.164295 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.164207 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c610e55-8429-48da-bb10-a89b60d779b5-sys\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.171455 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.171432 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5k88\" (UniqueName: \"kubernetes.io/projected/8c610e55-8429-48da-bb10-a89b60d779b5-kube-api-access-j5k88\") pod \"perf-node-gather-daemonset-f64kc\" (UID: \"8c610e55-8429-48da-bb10-a89b60d779b5\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.309727 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.309633 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:51.448036 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:51.448004 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc"] Jun 14 23:26:51.449815 ip-10-0-130-203 kubenswrapper[2548]: W0614 23:26:51.449788 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8c610e55_8429_48da_bb10_a89b60d779b5.slice/crio-8d843e1768ce9371c9ff7a1c1e7ff712589a3390a8c9092ef2339f6c7aac953d WatchSource:0}: Error finding container 8d843e1768ce9371c9ff7a1c1e7ff712589a3390a8c9092ef2339f6c7aac953d: Status 404 returned error can't find the container with id 8d843e1768ce9371c9ff7a1c1e7ff712589a3390a8c9092ef2339f6c7aac953d Jun 14 23:26:52.295159 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:52.295125 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" event={"ID":"8c610e55-8429-48da-bb10-a89b60d779b5","Type":"ContainerStarted","Data":"1a4f892a47e1508a763246389519ec30e48d7716be5b2ad904458adfa49934f8"} Jun 14 23:26:52.295616 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:52.295181 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" event={"ID":"8c610e55-8429-48da-bb10-a89b60d779b5","Type":"ContainerStarted","Data":"8d843e1768ce9371c9ff7a1c1e7ff712589a3390a8c9092ef2339f6c7aac953d"} Jun 14 23:26:52.295616 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:52.295233 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:52.311039 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:52.310978 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" podStartSLOduration=2.310962104 podStartE2EDuration="2.310962104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 23:26:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:26:52.309564031 +0000 UTC m=+2357.440016376" watchObservedRunningTime="2026-06-14 23:26:52.310962104 +0000 UTC m=+2357.441414428" Jun 14 23:26:52.489077 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:52.489042 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w92nv_dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f/dns/0.log" Jun 14 23:26:52.511242 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:52.511211 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w92nv_dffaced6-6f1d-4dbb-bef5-02fcc4f5e93f/kube-rbac-proxy/0.log" Jun 14 23:26:52.552966 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:52.552865 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7n9hc_0e5475a9-0484-4dff-b9ae-20547c97da47/dns-node-resolver/0.log" Jun 14 23:26:53.123520 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:53.123493 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2sqmn_34aabfa6-3e0f-4bb3-bff8-8af5a2ec013b/node-ca/0.log" Jun 14 23:26:54.134022 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:54.133991 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-47n5s_67e73129-2bcb-4a04-9b47-b979497fa4ae/discovery/0.log" Jun 14 23:26:54.178365 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:54.178336 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f989997cb-tk98z_0e001a7d-d5db-45bc-9e62-7791702dd19a/kube-auth-proxy/0.log" Jun 14 23:26:55.036429 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:55.036398 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mkg5l_74c35091-736c-4700-a92d-ef31bf121160/serve-healthcheck-canary/0.log" Jun 14 23:26:55.622180 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:55.622152 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbwpr_52cdad12-3b19-411d-9420-20e04d29fbb8/kube-rbac-proxy/0.log" Jun 14 23:26:55.643628 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:55.643599 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbwpr_52cdad12-3b19-411d-9420-20e04d29fbb8/exporter/0.log" Jun 14 23:26:55.664695 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:55.664668 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbwpr_52cdad12-3b19-411d-9420-20e04d29fbb8/extractor/0.log" Jun 14 23:26:57.863465 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:57.863434 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7dcf6b5898-8jccl_3f8c8879-1d24-4ff5-8d17-2924ec681577/nginx/0.log" Jun 14 23:26:57.919016 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:57.918987 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-f4jrw_a3b6f882-a04c-4133-adaf-290b81bdc593/manager/0.log" Jun 14 23:26:57.995077 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:57.995047 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-p2vfk_05c753b0-ca21-4e83-a607-7167ef049b14/manager/0.log" Jun 14 23:26:58.169560 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:58.169482 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-p5ksw_346a4127-a3b8-40f3-83d1-591a526ee5da/server/0.log" Jun 14 23:26:58.214092 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:58.214064 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-mkxft_6d2d20b1-7a42-47c9-9dca-7e0164915104/manager/0.log" Jun 14 23:26:58.309616 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:58.309588 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-f64kc" Jun 14 23:26:58.395226 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:58.395194 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cf75689df-t6n7v_3ed51e43-7fa1-476b-bcef-b3b665448bfc/manager/0.log" Jun 14 23:26:58.413730 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:26:58.413705 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cf75689df-t6n7v_3ed51e43-7fa1-476b-bcef-b3b665448bfc/copy-manifests/0.log" Jun 14 23:27:04.744590 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:04.744558 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-47n5s_67e73129-2bcb-4a04-9b47-b979497fa4ae/discovery/0.log" Jun 14 23:27:04.768563 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:04.768535 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f989997cb-tk98z_0e001a7d-d5db-45bc-9e62-7791702dd19a/kube-auth-proxy/0.log" Jun 14 23:27:06.122173 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:06.122141 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-47n5s_67e73129-2bcb-4a04-9b47-b979497fa4ae/discovery/0.log" Jun 14 23:27:06.149443 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:06.149417 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f989997cb-tk98z_0e001a7d-d5db-45bc-9e62-7791702dd19a/kube-auth-proxy/0.log" Jun 14 23:27:07.000944 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:07.000901 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9rzk7_3ef50632-c406-4af6-8c83-2b11545bbbc5/kube-multus/0.log" Jun 14 23:27:07.322280 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:07.322199 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzmjl_5b3a225f-6eb8-47d9-a76e-2e46633fbc25/kube-multus-additional-cni-plugins/0.log" Jun 14 23:27:07.341813 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:07.341786 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzmjl_5b3a225f-6eb8-47d9-a76e-2e46633fbc25/egress-router-binary-copy/0.log" Jun 14 23:27:07.360542 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:07.360518 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzmjl_5b3a225f-6eb8-47d9-a76e-2e46633fbc25/cni-plugins/0.log" Jun 14 23:27:07.380333 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:07.380294 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzmjl_5b3a225f-6eb8-47d9-a76e-2e46633fbc25/bond-cni-plugin/0.log" Jun 14 23:27:07.399462 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:07.399434 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzmjl_5b3a225f-6eb8-47d9-a76e-2e46633fbc25/routeoverride-cni/0.log" Jun 14 23:27:07.420131 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:07.420102 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzmjl_5b3a225f-6eb8-47d9-a76e-2e46633fbc25/whereabouts-cni-bincopy/0.log" Jun 14 23:27:07.439148 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:07.439114 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pzmjl_5b3a225f-6eb8-47d9-a76e-2e46633fbc25/whereabouts-cni/0.log" Jun 14 23:27:07.490546 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:07.490519 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7znkl_b7f24fe8-cb38-4ac7-871f-f320c9e3393b/network-metrics-daemon/0.log" Jun 14 23:27:07.508519 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:07.508490 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7znkl_b7f24fe8-cb38-4ac7-871f-f320c9e3393b/kube-rbac-proxy/0.log" Jun 14 23:27:07.956343 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:07.956301 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-47n5s_67e73129-2bcb-4a04-9b47-b979497fa4ae/discovery/0.log" Jun 14 23:27:07.980697 ip-10-0-130-203 kubenswrapper[2548]: I0614 23:27:07.980642 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f989997cb-tk98z_0e001a7d-d5db-45bc-9e62-7791702dd19a/kube-auth-proxy/0.log"