Jun 11 09:59:54.446130 ip-10-0-137-68 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 09:59:54.446141 ip-10-0-137-68 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 09:59:54.446149 ip-10-0-137-68 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 09:59:54.446458 ip-10-0-137-68 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 10:00:03.578389 ip-10-0-137-68 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 11 10:00:03.578403 ip-10-0-137-68 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d951e12bc0b441b0ae79eb53e6772d7e -- Jun 11 10:02:27.696503 ip-10-0-137-68 systemd[1]: Starting Kubernetes Kubelet... Jun 11 10:02:28.185488 ip-10-0-137-68 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 10:02:28.185488 ip-10-0-137-68 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 10:02:28.185488 ip-10-0-137-68 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 10:02:28.185488 ip-10-0-137-68 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 10:02:28.185488 ip-10-0-137-68 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 10:02:28.186145 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.185585 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 10:02:28.191509 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191492 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 10:02:28.191509 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191508 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191512 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191515 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191518 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191521 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191525 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191529 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191532 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191534 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191537 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191540 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191542 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191545 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191548 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191551 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191554 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191556 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191559 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191562 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191564 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 10:02:28.191577 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191567 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191570 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191580 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191583 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191586 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191589 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191594 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191597 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191600 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191604 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191606 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191609 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191612 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191615 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191617 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191620 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191625 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191629 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191632 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 10:02:28.192056 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191635 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191638 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191641 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191644 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191646 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191649 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191651 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191655 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191658 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191661 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191663 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191666 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191669 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191671 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191674 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191677 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191680 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191683 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191686 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 10:02:28.192580 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191688 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191692 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191695 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191697 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191700 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191703 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191705 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191708 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191711 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191714 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191716 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191719 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191722 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191725 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191727 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191730 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191732 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191734 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191737 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191740 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 10:02:28.193037 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191742 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191745 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191747 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191750 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191752 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191755 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191757 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191760 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191764 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191767 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191769 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191772 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191774 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191777 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191779 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191782 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191784 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191787 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191789 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.191792 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 10:02:28.193537 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192543 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192550 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192553 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192556 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192558 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192561 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192564 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192567 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192570 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192572 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192575 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192577 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192580 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192583 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192586 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192588 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192591 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192594 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192597 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192600 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 10:02:28.194012 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192604 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192607 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192610 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192613 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192615 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192618 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192620 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192623 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192626 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192629 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192632 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192634 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192637 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192640 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192642 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192645 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192648 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192650 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192656 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 10:02:28.194517 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192659 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192662 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192665 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192668 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192671 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192674 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192677 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192679 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192682 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192685 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192688 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192692 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192694 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192697 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192699 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192702 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192704 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192708 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192710 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192713 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 10:02:28.194980 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192717 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192720 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192724 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192727 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192730 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192733 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192736 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192739 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192741 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192744 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192747 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192751 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192755 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192757 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192760 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192762 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192765 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192768 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192770 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192773 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 10:02:28.195487 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192775 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192778 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192781 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192783 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192786 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192789 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192791 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192794 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192796 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192799 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192801 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192804 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192806 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192809 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192811 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192814 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192817 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192820 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192822 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.192825 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 10:02:28.195993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193236 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193242 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193246 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193249 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193253 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193255 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193259 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193261 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193265 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193267 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193270 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193273 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193276 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193278 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193281 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193284 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193286 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193289 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193292 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193294 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 10:02:28.196497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193297 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193299 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193302 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193304 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193308 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193310 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193315 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193318 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193321 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193324 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193327 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193330 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193332 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193335 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193338 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193341 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193344 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193347 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193350 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 10:02:28.196974 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193352 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193355 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193357 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193360 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193362 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193365 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193368 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193370 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193373 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193376 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193378 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193381 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193383 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193387 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193390 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193393 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193396 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193401 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193404 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 10:02:28.197471 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193406 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193409 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193411 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193414 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193416 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193419 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193421 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193424 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193427 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193430 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193432 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193435 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193438 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193440 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193443 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193445 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193447 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193450 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193453 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193455 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 10:02:28.197938 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193459 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193463 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193467 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193470 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193472 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193474 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193477 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193480 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193482 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193485 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193489 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193491 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193494 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193497 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193499 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193502 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193504 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193506 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193509 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193512 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 10:02:28.198445 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.193514 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193587 2575 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193596 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193606 2575 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193612 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193633 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193641 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193647 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193655 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193662 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193667 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193672 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193677 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193680 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193683 2575 flags.go:64] FLAG: --cgroup-root="" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193686 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193689 2575 flags.go:64] FLAG: --client-ca-file="" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193692 2575 flags.go:64] FLAG: --cloud-provider="external" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193695 2575 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193699 2575 flags.go:64] FLAG: --cluster-domain="" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193703 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193706 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193711 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193714 2575 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 10:02:28.198922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193719 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193722 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193725 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193728 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193731 2575 flags.go:64] FLAG: --contention-profiling="false" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193734 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193737 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193740 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193743 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193747 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193750 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193753 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193756 2575 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193759 2575 flags.go:64] FLAG: --enable-server="true" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193762 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193767 2575 flags.go:64] FLAG: --event-burst="100" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193770 2575 flags.go:64] FLAG: --event-qps="50" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193773 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193776 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193779 2575 flags.go:64] FLAG: --eviction-hard="" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193783 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193786 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193790 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193793 2575 flags.go:64] FLAG: --eviction-soft="" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193795 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 10:02:28.199521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193799 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193802 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193805 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193807 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193810 2575 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193814 2575 flags.go:64] FLAG: --feature-gates="" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193818 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193821 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193824 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193827 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193830 2575 flags.go:64] FLAG: --healthz-port="10248" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193834 2575 flags.go:64] FLAG: --help="false" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193837 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193840 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193843 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193846 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193849 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193852 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193855 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193858 2575 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193861 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193864 2575 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193868 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193871 2575 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 10:02:28.200202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193874 2575 flags.go:64] FLAG: --kube-reserved="" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193876 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193879 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193884 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193887 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193890 2575 flags.go:64] FLAG: --lock-file="" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193893 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193896 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193899 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193904 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193907 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193910 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193912 2575 flags.go:64] FLAG: --logging-format="text" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193917 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193921 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193924 2575 flags.go:64] FLAG: --manifest-url="" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193926 2575 flags.go:64] FLAG: --manifest-url-header="" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193931 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193934 2575 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193938 2575 flags.go:64] FLAG: --max-pods="110" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193941 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193944 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193947 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193950 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193953 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 10:02:28.200796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193956 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193959 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193966 2575 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193968 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193971 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193974 2575 flags.go:64] FLAG: --pod-cidr="" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193978 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193983 2575 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193986 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193989 2575 flags.go:64] FLAG: --pods-per-core="0" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193992 2575 flags.go:64] FLAG: --port="10250" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193997 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.193999 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0703329e109b25727" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194002 2575 flags.go:64] FLAG: --qos-reserved="" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194005 2575 flags.go:64] FLAG: --read-only-port="10255" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194008 2575 flags.go:64] FLAG: --register-node="true" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194011 2575 flags.go:64] FLAG: --register-with-taints="" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194015 2575 flags.go:64] FLAG: --registry-burst="10" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194018 2575 flags.go:64] FLAG: --registry-qps="5" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194021 2575 flags.go:64] FLAG: --reserved-cpus="" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194025 2575 flags.go:64] FLAG: --reserved-memory="" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194029 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194032 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194035 2575 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194038 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 10:02:28.201427 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194041 2575 flags.go:64] FLAG: --runonce="false" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194044 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194047 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194050 2575 flags.go:64] FLAG: --seccomp-default="false" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194052 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194056 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194058 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194061 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194064 2575 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194067 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194070 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194073 2575 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194076 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194079 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194083 2575 flags.go:64] FLAG: --system-cgroups="" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194086 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194091 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194094 2575 flags.go:64] FLAG: --tls-cert-file="" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194098 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194102 2575 flags.go:64] FLAG: --tls-min-version="" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194105 2575 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194107 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194111 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194125 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194129 2575 flags.go:64] FLAG: --v="2" Jun 11 10:02:28.202034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194132 2575 flags.go:64] FLAG: --version="false" Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194136 2575 flags.go:64] FLAG: --vmodule="" Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194141 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.194144 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194268 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194272 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194275 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194278 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194281 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194284 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194286 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194289 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194291 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194294 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194297 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194299 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194302 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194305 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194307 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194310 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 10:02:28.202692 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194313 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194315 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194319 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194321 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194324 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194328 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194331 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194334 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194336 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194339 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194341 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194344 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194346 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194349 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194353 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194356 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194359 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194362 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194366 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194369 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 10:02:28.203205 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194371 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194374 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194377 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194380 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194382 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194385 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194387 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194390 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194392 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194395 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194397 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194400 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194402 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194405 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194407 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194410 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194413 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194417 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194420 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194422 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 10:02:28.203697 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194425 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194427 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194430 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194433 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194435 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194437 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194441 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194444 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194448 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194451 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194454 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194457 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194460 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194462 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194465 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194467 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194470 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194473 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194475 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 10:02:28.204344 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194478 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194480 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194483 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194485 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194488 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194490 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194493 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194495 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194498 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194501 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194505 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194507 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194510 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194512 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194515 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194517 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194520 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194523 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194526 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194530 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 10:02:28.204816 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.194532 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.195080 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.195086 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.195089 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.195094 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.201856 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.201871 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.201885 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.201891 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201946 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201951 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201954 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201957 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201960 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 10:02:28.205325 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201963 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201966 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201969 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201973 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201975 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201978 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201981 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201985 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201989 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201992 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201996 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.201998 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202001 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202004 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202007 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202009 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202012 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202014 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202017 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 10:02:28.205684 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202020 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202022 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202025 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202028 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202030 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202034 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202037 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202041 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202043 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202046 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202049 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202052 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202055 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202057 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202060 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202062 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202065 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202068 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202071 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202073 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 10:02:28.206158 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202076 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202078 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202081 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202084 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202086 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202089 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202091 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202093 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202096 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202098 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202101 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202103 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202106 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202109 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202111 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202129 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202134 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202139 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202143 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202146 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 10:02:28.206654 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202149 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202152 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202155 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202157 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202160 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202163 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202166 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202168 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202170 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202173 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202175 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202178 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202182 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202185 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202189 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202192 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202194 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202197 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202200 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 10:02:28.207236 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202202 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202205 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202208 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202210 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202213 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202215 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202217 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202220 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202223 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202225 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202229 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202231 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202234 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202237 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202241 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 10:02:28.207691 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202244 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.202249 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202361 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202366 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202369 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202372 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202375 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202377 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202380 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202383 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202387 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202391 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202394 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202396 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 10:02:28.208074 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202399 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202402 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202405 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202407 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202410 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202412 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202415 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202417 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202420 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202422 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202425 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202427 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202430 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202432 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202435 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202438 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202441 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202444 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202446 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202449 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 10:02:28.208431 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202452 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202455 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202457 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202460 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202463 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202467 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202470 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202473 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202476 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202479 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202481 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202484 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202486 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202489 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202491 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202494 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202496 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202499 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202501 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 10:02:28.208909 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202504 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202506 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202509 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202513 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202517 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202520 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202523 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202525 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202528 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202531 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202534 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202537 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202540 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202542 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202544 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202547 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202549 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202552 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202554 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 10:02:28.209376 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202557 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202559 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202562 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202565 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202567 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202570 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202572 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202575 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202577 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202580 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202582 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202584 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202587 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202589 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202592 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202594 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202597 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202599 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202602 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 10:02:28.209937 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202604 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202607 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202610 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202612 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202614 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202617 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202620 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202623 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202625 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:28.202628 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.202633 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.202740 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.205055 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.206632 2575 server.go:1019] "Starting client certificate rotation" Jun 11 10:02:28.210414 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.206737 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 10:02:28.210765 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.207467 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 10:02:28.210765 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.209571 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 10:02:28.212645 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.212588 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 10:02:28.226294 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.226275 2575 log.go:25] "Validated CRI v1 runtime API" Jun 11 10:02:28.228799 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.228785 2575 log.go:25] "Validated CRI v1 image API" Jun 11 10:02:28.229537 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.229517 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 10:02:28.232448 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.232422 2575 fs.go:135] Filesystem UUIDs: map[1441a22f-5e64-4ab8-b471-b635ca1dc1b5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8558854a-d6a1-480c-9c89-d2ff71446a98:/dev/nvme0n1p4] Jun 11 10:02:28.232519 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.232448 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 10:02:28.236829 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.236720 2575 manager.go:216] Machine: {Timestamp:2026-06-11 10:02:28.236242648 +0000 UTC m=+0.397539699 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099720 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c61d496b55c563960fef1873b627b SystemUUID:ec2c61d4-96b5-5c56-3960-fef1873b627b BootID:d951e12b-c0b4-41b0-ae79-eb53e6772d7e Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:2e:08:fa:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:2e:08:fa:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:89:ac:50:34:76 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 10:02:28.236829 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.236825 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 10:02:28.236946 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.236937 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 10:02:28.237390 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.237373 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 10:02:28.240522 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.240497 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 10:02:28.240669 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.240524 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 10:02:28.241415 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.241405 2575 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 10:02:28.241456 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.241418 2575 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 10:02:28.241456 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.241426 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 10:02:28.242060 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.242051 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 10:02:28.242949 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.242940 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 10:02:28.245940 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.245930 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 11 10:02:28.246057 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.246048 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 10:02:28.246092 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.246079 2575 kubelet.go:486] "Attempting to sync node with API server" Jun 11 10:02:28.246133 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.246097 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 10:02:28.246167 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.246134 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 10:02:28.246167 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.246145 2575 kubelet.go:398] "Adding apiserver pod source" Jun 11 10:02:28.246229 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.246182 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 10:02:28.246572 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.246559 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 10:02:28.246628 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.246618 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 10:02:28.249343 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.249328 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 10:02:28.250697 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.250684 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 10:02:28.250747 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.250714 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 10:02:28.252147 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.252109 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 10:02:28.252147 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.252150 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 10:02:28.252267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.252174 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 10:02:28.252267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.252187 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 10:02:28.252267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.252200 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 10:02:28.252267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.252207 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 10:02:28.252267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.252215 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 10:02:28.252267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.252222 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 10:02:28.252267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.252229 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 10:02:28.252267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.252234 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 10:02:28.252267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.252251 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 10:02:28.252267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.252259 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 10:02:28.253026 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.253014 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 10:02:28.253026 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.253027 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 10:02:28.256715 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.256699 2575 server.go:1268] "Started kubelet" Jun 11 10:02:28.256812 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.256789 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 10:02:28.257099 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.257043 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 10:02:28.257200 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.257136 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 10:02:28.257634 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.257613 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 10:02:28.257796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.257773 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nscgn" Jun 11 10:02:28.261201 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.261150 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 10:02:28.261764 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.261729 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 10:02:28.261802 ip-10-0-137-68 systemd[1]: Started Kubernetes Kubelet. Jun 11 10:02:28.262543 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.262465 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 10:02:28.264285 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.263680 2575 server.go:310] "Adding debug handlers to kubelet server" Jun 11 10:02:28.265064 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.265043 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nscgn" Jun 11 10:02:28.265878 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.265862 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 10:02:28.268812 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.267447 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-68.ec2.internal.18b7fea1bca88361 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-68.ec2.internal,UID:ip-10-0-137-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-68.ec2.internal,},FirstTimestamp:2026-06-11 10:02:28.256670561 +0000 UTC m=+0.417967611,LastTimestamp:2026-06-11 10:02:28.256670561 +0000 UTC m=+0.417967611,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-68.ec2.internal,}" Jun 11 10:02:28.270040 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.270022 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 10:02:28.270531 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.270515 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 10:02:28.270665 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.270646 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 11 10:02:28.271153 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.271081 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 10:02:28.271153 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.271082 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 10:02:28.271153 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.271131 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 10:02:28.271306 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.271237 2575 reconstruct.go:97] "Volume reconstruction finished" Jun 11 10:02:28.271306 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.271245 2575 reconciler.go:29] "Reconciler: start to sync state" Jun 11 10:02:28.271457 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.271441 2575 factory.go:55] Registering systemd factory Jun 11 10:02:28.271457 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.271458 2575 factory.go:223] Registration of the systemd container factory successfully Jun 11 10:02:28.271647 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.271636 2575 factory.go:153] Registering CRI-O factory Jun 11 10:02:28.271696 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.271649 2575 factory.go:223] Registration of the crio container factory successfully Jun 11 10:02:28.271696 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.271688 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 10:02:28.271782 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.271708 2575 factory.go:103] Registering Raw factory Jun 11 10:02:28.271782 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.271718 2575 manager.go:1196] Started watching for new ooms in manager Jun 11 10:02:28.272202 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.272187 2575 manager.go:349] Starting recovery of all containers Jun 11 10:02:28.273195 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.273176 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 10:02:28.276221 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.276202 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-68.ec2.internal\" not found" node="ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.280809 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.280791 2575 manager.go:354] Recovery completed Jun 11 10:02:28.285372 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.285354 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 10:02:28.287724 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.287708 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 11 10:02:28.287786 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.287737 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 10:02:28.287786 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.287748 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 11 10:02:28.288292 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.288279 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 10:02:28.288353 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.288292 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 10:02:28.288353 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.288309 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 11 10:02:28.288353 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.288331 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 10:02:28.289184 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.289167 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 11 10:02:28.289241 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.289201 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 10:02:28.289241 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.289215 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 11 10:02:28.289549 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.289539 2575 policy_none.go:49] "None policy: Start" Jun 11 10:02:28.289582 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.289568 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 10:02:28.289582 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.289579 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 10:02:28.290679 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.290668 2575 policy_none.go:47] "Start" Jun 11 10:02:28.316712 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.316688 2575 manager.go:337] "Starting Device Plugin manager" Jun 11 10:02:28.316802 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.316721 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 10:02:28.316802 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.316730 2575 server.go:87] "Starting device plugin registration server" Jun 11 10:02:28.316986 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.316956 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 10:02:28.316986 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.316971 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 10:02:28.317113 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.317095 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 10:02:28.317205 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.317193 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 10:02:28.317253 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.317206 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 10:02:28.317770 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.317749 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 10:02:28.317848 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.317796 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-68.ec2.internal\" not found" Jun 11 10:02:28.335780 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.335745 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 10:02:28.342309 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.336940 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 10:02:28.342309 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.336982 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 10:02:28.342309 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.337007 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 10:02:28.342309 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.337045 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 10:02:28.342309 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.338653 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 10:02:28.417965 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.417862 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 10:02:28.418889 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.418871 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 11 10:02:28.418973 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.418908 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 10:02:28.418973 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.418923 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 11 10:02:28.418973 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.418948 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.427705 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.427686 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.427828 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.427714 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-68.ec2.internal\": node \"ip-10-0-137-68.ec2.internal\" not found" Jun 11 10:02:28.437995 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.437974 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal"] Jun 11 10:02:28.438108 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.438049 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 10:02:28.438641 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.438624 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 11 10:02:28.440713 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.440698 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 11 10:02:28.440770 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.440727 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 10:02:28.440770 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.440738 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 11 10:02:28.442107 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.442095 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 10:02:28.442240 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.442223 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.442279 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.442264 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 10:02:28.442868 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.442853 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 11 10:02:28.442942 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.442875 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 10:02:28.442942 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.442855 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 11 10:02:28.442942 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.442886 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 11 10:02:28.442942 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.442915 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 10:02:28.442942 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.442934 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 11 10:02:28.444234 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.444219 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.444314 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.444250 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 10:02:28.445314 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.445295 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 11 10:02:28.445401 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.445331 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 10:02:28.445401 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.445347 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 11 10:02:28.468780 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.468761 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-68.ec2.internal\" not found" node="ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.471933 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.471916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab416f5f449937b161ec909743985e2b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal\" (UID: \"ab416f5f449937b161ec909743985e2b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.472017 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.471944 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab416f5f449937b161ec909743985e2b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal\" (UID: \"ab416f5f449937b161ec909743985e2b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.472017 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.471973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86da014a9cd3afb75ae148ad505b00b6-config\") pod \"kube-apiserver-proxy-ip-10-0-137-68.ec2.internal\" (UID: \"86da014a9cd3afb75ae148ad505b00b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.473092 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.473078 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-68.ec2.internal\" not found" node="ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.539388 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.539357 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 11 10:02:28.572451 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.572420 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab416f5f449937b161ec909743985e2b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal\" (UID: \"ab416f5f449937b161ec909743985e2b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.572525 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.572456 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86da014a9cd3afb75ae148ad505b00b6-config\") pod \"kube-apiserver-proxy-ip-10-0-137-68.ec2.internal\" (UID: \"86da014a9cd3afb75ae148ad505b00b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.572525 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.572472 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab416f5f449937b161ec909743985e2b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal\" (UID: \"ab416f5f449937b161ec909743985e2b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.572598 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.572527 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab416f5f449937b161ec909743985e2b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal\" (UID: \"ab416f5f449937b161ec909743985e2b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.572598 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.572533 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab416f5f449937b161ec909743985e2b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal\" (UID: \"ab416f5f449937b161ec909743985e2b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.572598 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.572542 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86da014a9cd3afb75ae148ad505b00b6-config\") pod \"kube-apiserver-proxy-ip-10-0-137-68.ec2.internal\" (UID: \"86da014a9cd3afb75ae148ad505b00b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.640370 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.640325 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 11 10:02:28.740934 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.740874 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 11 10:02:28.773359 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.773335 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.778194 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:28.778178 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" Jun 11 10:02:28.841808 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.841761 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 11 10:02:28.942272 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:28.942238 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 11 10:02:29.042800 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.042705 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 11 10:02:29.143383 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.143232 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 11 10:02:29.206730 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.206700 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 10:02:29.207402 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.206863 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 10:02:29.207402 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.206886 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 10:02:29.244911 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.244880 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 11 10:02:29.246194 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.246171 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 10:02:29.247019 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.247008 2575 apiserver.go:52] "Watching apiserver" Jun 11 10:02:29.259042 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.259022 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 10:02:29.259372 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.259352 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-5f2mf","openshift-network-operator/iptables-alerter-l7n82","kube-system/konnectivity-agent-wtrj6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd","openshift-dns/node-resolver-xjcfv","openshift-image-registry/node-ca-2jqvs","openshift-multus/multus-additional-cni-plugins-hxrtq","openshift-ovn-kubernetes/ovnkube-node-hjzkh","kube-system/global-pull-secret-syncer-pvbq4","openshift-cluster-node-tuning-operator/tuned-fksb5","openshift-multus/multus-bntjw","openshift-multus/network-metrics-daemon-mv8d6"] Jun 11 10:02:29.260942 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.260919 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:29.261032 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.261007 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:29.262176 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.262158 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l7n82" Jun 11 10:02:29.263708 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.263685 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wtrj6" Jun 11 10:02:29.263947 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:29.263919 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab416f5f449937b161ec909743985e2b.slice/crio-72839495e05fe6df26f6f5b288d0ac8e2a9d93b07a547b5deff3d5daef116e87 WatchSource:0}: Error finding container 72839495e05fe6df26f6f5b288d0ac8e2a9d93b07a547b5deff3d5daef116e87: Status 404 returned error can't find the container with id 72839495e05fe6df26f6f5b288d0ac8e2a9d93b07a547b5deff3d5daef116e87 Jun 11 10:02:29.264635 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:29.264617 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86da014a9cd3afb75ae148ad505b00b6.slice/crio-8dd4e37982eb188e92d9493f0b76fe3d11ac5969389f36803d40d432746ce0a6 WatchSource:0}: Error finding container 8dd4e37982eb188e92d9493f0b76fe3d11ac5969389f36803d40d432746ce0a6: Status 404 returned error can't find the container with id 8dd4e37982eb188e92d9493f0b76fe3d11ac5969389f36803d40d432746ce0a6 Jun 11 10:02:29.265237 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.264952 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j2rrb\"" Jun 11 10:02:29.265237 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.264975 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 10:02:29.265237 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.264984 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.265237 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.265025 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 10:02:29.265531 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.265511 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 10:02:29.267980 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.267958 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f97lt\"" Jun 11 10:02:29.268070 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.267965 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 10:02:29.268241 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.268222 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 10:02:29.268241 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.268234 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tt8q7\"" Jun 11 10:02:29.268362 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.268257 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 10:02:29.268876 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.268819 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xjcfv" Jun 11 10:02:29.269425 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.269309 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 10:02:29.269425 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.269330 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 09:57:28 +0000 UTC" deadline="2027-12-12 07:43:53.756233185 +0000 UTC" Jun 11 10:02:29.269425 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.269393 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13173h41m24.486843923s" Jun 11 10:02:29.269425 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.269420 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 10:02:29.269884 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.269865 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2jqvs" Jun 11 10:02:29.270133 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.270101 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 10:02:29.270945 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.270927 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" Jun 11 10:02:29.271404 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.271375 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.272275 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.272243 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 10:02:29.272275 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.272255 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8sf9d\"" Jun 11 10:02:29.272433 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.272412 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 10:02:29.272561 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.272537 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 10:02:29.272651 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.272620 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 10:02:29.272711 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.272655 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 10:02:29.272766 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.272754 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 10:02:29.272984 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.272963 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fbjdr\"" Jun 11 10:02:29.273245 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.273224 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.274133 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.274105 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 10:02:29.274236 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.274140 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 10:02:29.274236 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.274228 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 10:02:29.274804 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.274783 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 10:02:29.274874 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.274845 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vqpsf\"" Jun 11 10:02:29.274932 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.274919 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:29.275015 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.274992 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:29.275438 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.275424 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 10:02:29.275619 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.275602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28a97a3a-5f40-4d67-bf31-71562e304205-konnectivity-ca\") pod \"konnectivity-agent-wtrj6\" (UID: \"28a97a3a-5f40-4d67-bf31-71562e304205\") " pod="kube-system/konnectivity-agent-wtrj6" Jun 11 10:02:29.275692 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.275635 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.275692 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.275658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d2a03f3-1cd0-4ff2-95e8-8d764948c65e-hosts-file\") pod \"node-resolver-xjcfv\" (UID: \"2d2a03f3-1cd0-4ff2-95e8-8d764948c65e\") " pod="openshift-dns/node-resolver-xjcfv" Jun 11 10:02:29.275824 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.275682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-run-openvswitch\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.275824 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.275730 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8462886-9f16-4e49-9990-86e5c70d0695-env-overrides\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.275824 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.275753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8462886-9f16-4e49-9990-86e5c70d0695-ovn-node-metrics-cert\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.275824 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.275797 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8462886-9f16-4e49-9990-86e5c70d0695-ovnkube-script-lib\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.275998 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.275857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stwnb\" (UniqueName: \"kubernetes.io/projected/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-kube-api-access-stwnb\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.275998 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.275913 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-etc-selinux\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.275998 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.275948 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rmq5\" (UniqueName: \"kubernetes.io/projected/13ed28f9-7a85-46b7-8c28-2582db440199-kube-api-access-7rmq5\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.275998 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.275980 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-systemd-units\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276189 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276003 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-slash\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276189 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-var-lib-openvswitch\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276189 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276046 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-run-ovn\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276189 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276069 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276189 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276080 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 10:02:29.276189 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-cni-binary-copy\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.276189 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276131 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-run-netns\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276420 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276209 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-etc-openvswitch\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276420 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fb7q\" (UniqueName: \"kubernetes.io/projected/d8462886-9f16-4e49-9990-86e5c70d0695-kube-api-access-4fb7q\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276420 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276276 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-cnibin\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.276420 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276290 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.276420 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276362 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d2a03f3-1cd0-4ff2-95e8-8d764948c65e-tmp-dir\") pod \"node-resolver-xjcfv\" (UID: \"2d2a03f3-1cd0-4ff2-95e8-8d764948c65e\") " pod="openshift-dns/node-resolver-xjcfv" Jun 11 10:02:29.276420 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276377 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8360a73-ef7e-4c2d-8906-fd2431a63516-host\") pod \"node-ca-2jqvs\" (UID: \"d8360a73-ef7e-4c2d-8906-fd2431a63516\") " pod="openshift-image-registry/node-ca-2jqvs" Jun 11 10:02:29.276420 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276394 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls2nt\" (UniqueName: \"kubernetes.io/projected/d8360a73-ef7e-4c2d-8906-fd2431a63516-kube-api-access-ls2nt\") pod \"node-ca-2jqvs\" (UID: \"d8360a73-ef7e-4c2d-8906-fd2431a63516\") " pod="openshift-image-registry/node-ca-2jqvs" Jun 11 10:02:29.276420 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276416 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28a97a3a-5f40-4d67-bf31-71562e304205-agent-certs\") pod \"konnectivity-agent-wtrj6\" (UID: \"28a97a3a-5f40-4d67-bf31-71562e304205\") " pod="kube-system/konnectivity-agent-wtrj6" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276458 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276465 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276483 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276459 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-sys-fs\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276569 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zgp49\"" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276571 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-kubelet\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276595 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-run-systemd\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276618 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-node-log\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-cni-bin\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-cni-netd\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276686 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hcfp\" (UniqueName: \"kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp\") pod \"network-check-target-5f2mf\" (UID: \"729a4b22-d1d8-4894-8a4b-7cae4c3b04c6\") " pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276708 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-os-release\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276727 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.276757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8462886-9f16-4e49-9990-86e5c70d0695-ovnkube-config\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c993f270-96de-4982-98e6-a6595b401ce7-iptables-alerter-script\") pod \"iptables-alerter-l7n82\" (UID: \"c993f270-96de-4982-98e6-a6595b401ce7\") " pod="openshift-network-operator/iptables-alerter-l7n82" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276811 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c993f270-96de-4982-98e6-a6595b401ce7-host-slash\") pod \"iptables-alerter-l7n82\" (UID: \"c993f270-96de-4982-98e6-a6595b401ce7\") " pod="openshift-network-operator/iptables-alerter-l7n82" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-system-cni-dir\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-device-dir\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276884 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q22fm\" (UniqueName: \"kubernetes.io/projected/2d2a03f3-1cd0-4ff2-95e8-8d764948c65e-kube-api-access-q22fm\") pod \"node-resolver-xjcfv\" (UID: \"2d2a03f3-1cd0-4ff2-95e8-8d764948c65e\") " pod="openshift-dns/node-resolver-xjcfv" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d8360a73-ef7e-4c2d-8906-fd2431a63516-serviceca\") pod \"node-ca-2jqvs\" (UID: \"d8360a73-ef7e-4c2d-8906-fd2431a63516\") " pod="openshift-image-registry/node-ca-2jqvs" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276939 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-log-socket\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.276983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9dg6\" (UniqueName: \"kubernetes.io/projected/c993f270-96de-4982-98e6-a6595b401ce7-kube-api-access-s9dg6\") pod \"iptables-alerter-l7n82\" (UID: \"c993f270-96de-4982-98e6-a6595b401ce7\") " pod="openshift-network-operator/iptables-alerter-l7n82" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.277019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.277050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-socket-dir\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.277092 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.277099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-registration-dir\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.277474 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.277234 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 10:02:29.278891 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.278874 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.279719 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.279702 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 10:02:29.279801 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.279743 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9dc5g\"" Jun 11 10:02:29.280156 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.280138 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 10:02:29.280804 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.280788 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:29.280889 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.280860 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:29.281342 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.281325 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 10:02:29.281424 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.281353 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mnjlb\"" Jun 11 10:02:29.282652 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.282630 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 10:02:29.282743 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.282716 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal"] Jun 11 10:02:29.282743 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.282724 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 11 10:02:29.285308 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.285291 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 10:02:29.292332 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.292312 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 10:02:29.292985 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.292928 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal"] Jun 11 10:02:29.307222 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.307205 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cdsd9" Jun 11 10:02:29.316572 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.316555 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cdsd9" Jun 11 10:02:29.339929 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.339893 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" event={"ID":"ab416f5f449937b161ec909743985e2b","Type":"ContainerStarted","Data":"72839495e05fe6df26f6f5b288d0ac8e2a9d93b07a547b5deff3d5daef116e87"} Jun 11 10:02:29.340937 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.340912 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" event={"ID":"86da014a9cd3afb75ae148ad505b00b6","Type":"ContainerStarted","Data":"8dd4e37982eb188e92d9493f0b76fe3d11ac5969389f36803d40d432746ce0a6"} Jun 11 10:02:29.372087 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.372067 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 10:02:29.377781 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.377764 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-etc-openvswitch\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.377827 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.377794 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-systemd\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.377827 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.377815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-os-release\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.377924 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.377830 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.377924 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.377884 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-etc-openvswitch\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.377924 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.377897 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-kubelet\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.378058 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.377936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-node-log\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.378058 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.377965 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8462886-9f16-4e49-9990-86e5c70d0695-ovnkube-config\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.378058 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.377982 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.378058 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.377993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:29.378058 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.377985 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-kubelet\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.378058 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378021 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-node-log\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.378058 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378023 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-sys\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378062 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-run-k8s-cni-cncf-io\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ba76fc15-0a09-4485-a2af-868156b60f32-multus-daemon-config\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378105 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcfp\" (UniqueName: \"kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp\") pod \"network-check-target-5f2mf\" (UID: \"729a4b22-d1d8-4894-8a4b-7cae4c3b04c6\") " pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378138 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-run-netns\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378179 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c993f270-96de-4982-98e6-a6595b401ce7-host-slash\") pod \"iptables-alerter-l7n82\" (UID: \"c993f270-96de-4982-98e6-a6595b401ce7\") " pod="openshift-network-operator/iptables-alerter-l7n82" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q22fm\" (UniqueName: \"kubernetes.io/projected/2d2a03f3-1cd0-4ff2-95e8-8d764948c65e-kube-api-access-q22fm\") pod \"node-resolver-xjcfv\" (UID: \"2d2a03f3-1cd0-4ff2-95e8-8d764948c65e\") " pod="openshift-dns/node-resolver-xjcfv" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378193 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378210 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d8360a73-ef7e-4c2d-8906-fd2431a63516-serviceca\") pod \"node-ca-2jqvs\" (UID: \"d8360a73-ef7e-4c2d-8906-fd2431a63516\") " pod="openshift-image-registry/node-ca-2jqvs" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-sysctl-d\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378241 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c993f270-96de-4982-98e6-a6595b401ce7-host-slash\") pod \"iptables-alerter-l7n82\" (UID: \"c993f270-96de-4982-98e6-a6595b401ce7\") " pod="openshift-network-operator/iptables-alerter-l7n82" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-multus-socket-dir-parent\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fkv6\" (UniqueName: \"kubernetes.io/projected/ba76fc15-0a09-4485-a2af-868156b60f32-kube-api-access-5fkv6\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378363 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9dg6\" (UniqueName: \"kubernetes.io/projected/c993f270-96de-4982-98e6-a6595b401ce7-kube-api-access-s9dg6\") pod \"iptables-alerter-l7n82\" (UID: \"c993f270-96de-4982-98e6-a6595b401ce7\") " pod="openshift-network-operator/iptables-alerter-l7n82" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378385 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-socket-dir\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378427 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-registration-dir\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.378498 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378477 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-registration-dir\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378491 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-socket-dir\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378531 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8462886-9f16-4e49-9990-86e5c70d0695-ovnkube-config\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-lib-modules\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28a97a3a-5f40-4d67-bf31-71562e304205-konnectivity-ca\") pod \"konnectivity-agent-wtrj6\" (UID: \"28a97a3a-5f40-4d67-bf31-71562e304205\") " pod="kube-system/konnectivity-agent-wtrj6" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378610 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378611 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d8360a73-ef7e-4c2d-8906-fd2431a63516-serviceca\") pod \"node-ca-2jqvs\" (UID: \"d8360a73-ef7e-4c2d-8906-fd2431a63516\") " pod="openshift-image-registry/node-ca-2jqvs" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8462886-9f16-4e49-9990-86e5c70d0695-env-overrides\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378642 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8462886-9f16-4e49-9990-86e5c70d0695-ovnkube-script-lib\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378661 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-run-multus-certs\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378665 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378697 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stwnb\" (UniqueName: \"kubernetes.io/projected/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-kube-api-access-stwnb\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378726 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rmq5\" (UniqueName: \"kubernetes.io/projected/13ed28f9-7a85-46b7-8c28-2582db440199-kube-api-access-7rmq5\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378751 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-run-ovn\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378796 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378823 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-kubernetes\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378847 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-sysctl-conf\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.379351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378871 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-run-ovn\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378911 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378946 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-multus-cni-dir\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.378990 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-cni-binary-copy\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379004 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8462886-9f16-4e49-9990-86e5c70d0695-env-overrides\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-run-netns\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379039 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fb7q\" (UniqueName: \"kubernetes.io/projected/d8462886-9f16-4e49-9990-86e5c70d0695-kube-api-access-4fb7q\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379046 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-run-netns\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379062 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-cnibin\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379156 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28a97a3a-5f40-4d67-bf31-71562e304205-konnectivity-ca\") pod \"konnectivity-agent-wtrj6\" (UID: \"28a97a3a-5f40-4d67-bf31-71562e304205\") " pod="kube-system/konnectivity-agent-wtrj6" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-cnibin\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379216 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d2a03f3-1cd0-4ff2-95e8-8d764948c65e-tmp-dir\") pod \"node-resolver-xjcfv\" (UID: \"2d2a03f3-1cd0-4ff2-95e8-8d764948c65e\") " pod="openshift-dns/node-resolver-xjcfv" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379257 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-cnibin\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379288 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8360a73-ef7e-4c2d-8906-fd2431a63516-host\") pod \"node-ca-2jqvs\" (UID: \"d8360a73-ef7e-4c2d-8906-fd2431a63516\") " pod="openshift-image-registry/node-ca-2jqvs" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379313 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls2nt\" (UniqueName: \"kubernetes.io/projected/d8360a73-ef7e-4c2d-8906-fd2431a63516-kube-api-access-ls2nt\") pod \"node-ca-2jqvs\" (UID: \"d8360a73-ef7e-4c2d-8906-fd2431a63516\") " pod="openshift-image-registry/node-ca-2jqvs" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379329 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8360a73-ef7e-4c2d-8906-fd2431a63516-host\") pod \"node-ca-2jqvs\" (UID: \"d8360a73-ef7e-4c2d-8906-fd2431a63516\") " pod="openshift-image-registry/node-ca-2jqvs" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379336 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28a97a3a-5f40-4d67-bf31-71562e304205-agent-certs\") pod \"konnectivity-agent-wtrj6\" (UID: \"28a97a3a-5f40-4d67-bf31-71562e304205\") " pod="kube-system/konnectivity-agent-wtrj6" Jun 11 10:02:29.380083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379277 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8462886-9f16-4e49-9990-86e5c70d0695-ovnkube-script-lib\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379362 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-sys-fs\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379411 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-cni-binary-copy\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379415 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-run-systemd\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379440 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-cni-bin\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379464 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-cni-netd\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379489 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-run-systemd\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379491 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-hostroot\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379487 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d2a03f3-1cd0-4ff2-95e8-8d764948c65e-tmp-dir\") pod \"node-resolver-xjcfv\" (UID: \"2d2a03f3-1cd0-4ff2-95e8-8d764948c65e\") " pod="openshift-dns/node-resolver-xjcfv" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379467 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-sys-fs\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379516 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-etc-kubernetes\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379527 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-cni-netd\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-os-release\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379574 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-cni-bin\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379580 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvwfs\" (UniqueName: \"kubernetes.io/projected/9b05be19-d3e1-4216-8727-bd84bf476b4b-kube-api-access-cvwfs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379607 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09b38e2b-4c8d-496a-930c-9cf28a6ef771-kubelet-config\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:29.380764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379632 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-host\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379634 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-os-release\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379659 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c993f270-96de-4982-98e6-a6595b401ce7-iptables-alerter-script\") pod \"iptables-alerter-l7n82\" (UID: \"c993f270-96de-4982-98e6-a6595b401ce7\") " pod="openshift-network-operator/iptables-alerter-l7n82" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379632 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-system-cni-dir\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379779 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-device-dir\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379794 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-log-socket\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-sysconfig\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379840 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-system-cni-dir\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-var-lib-kubelet\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379864 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-device-dir\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-tuned\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379877 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-log-socket\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379905 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.379938 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-var-lib-cni-bin\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.381257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-var-lib-cni-multus\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-multus-conf-dir\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380099 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d2a03f3-1cd0-4ff2-95e8-8d764948c65e-hosts-file\") pod \"node-resolver-xjcfv\" (UID: \"2d2a03f3-1cd0-4ff2-95e8-8d764948c65e\") " pod="openshift-dns/node-resolver-xjcfv" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380149 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-run-openvswitch\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380170 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c993f270-96de-4982-98e6-a6595b401ce7-iptables-alerter-script\") pod \"iptables-alerter-l7n82\" (UID: \"c993f270-96de-4982-98e6-a6595b401ce7\") " pod="openshift-network-operator/iptables-alerter-l7n82" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380208 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d2a03f3-1cd0-4ff2-95e8-8d764948c65e-hosts-file\") pod \"node-resolver-xjcfv\" (UID: \"2d2a03f3-1cd0-4ff2-95e8-8d764948c65e\") " pod="openshift-dns/node-resolver-xjcfv" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380218 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-run-openvswitch\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380245 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8462886-9f16-4e49-9990-86e5c70d0695-ovn-node-metrics-cert\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380266 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09b38e2b-4c8d-496a-930c-9cf28a6ef771-dbus\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-modprobe-d\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-run\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2dcec05-0202-4db7-b4f3-6d37ab857972-tmp\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380334 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380343 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-system-cni-dir\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380365 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-etc-selinux\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380384 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-systemd-units\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380403 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-slash\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.381756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380418 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-var-lib-openvswitch\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.382326 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380420 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/13ed28f9-7a85-46b7-8c28-2582db440199-etc-selinux\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.382326 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380446 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-systemd-units\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.382326 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380433 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w7gn\" (UniqueName: \"kubernetes.io/projected/a2dcec05-0202-4db7-b4f3-6d37ab857972-kube-api-access-7w7gn\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.382326 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba76fc15-0a09-4485-a2af-868156b60f32-cni-binary-copy\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.382326 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380488 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-host-slash\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.382326 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380493 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8462886-9f16-4e49-9990-86e5c70d0695-var-lib-openvswitch\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.382326 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.380509 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-var-lib-kubelet\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.382719 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.382702 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8462886-9f16-4e49-9990-86e5c70d0695-ovn-node-metrics-cert\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.382812 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.382798 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28a97a3a-5f40-4d67-bf31-71562e304205-agent-certs\") pod \"konnectivity-agent-wtrj6\" (UID: \"28a97a3a-5f40-4d67-bf31-71562e304205\") " pod="kube-system/konnectivity-agent-wtrj6" Jun 11 10:02:29.386448 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.386428 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 10:02:29.386518 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.386451 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 10:02:29.386518 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.386461 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2hcfp for pod openshift-network-diagnostics/network-check-target-5f2mf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:02:29.386587 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.386525 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp podName:729a4b22-d1d8-4894-8a4b-7cae4c3b04c6 nodeName:}" failed. No retries permitted until 2026-06-11 10:02:29.88649563 +0000 UTC m=+2.047792670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2hcfp" (UniqueName: "kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp") pod "network-check-target-5f2mf" (UID: "729a4b22-d1d8-4894-8a4b-7cae4c3b04c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:02:29.390081 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.390054 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls2nt\" (UniqueName: \"kubernetes.io/projected/d8360a73-ef7e-4c2d-8906-fd2431a63516-kube-api-access-ls2nt\") pod \"node-ca-2jqvs\" (UID: \"d8360a73-ef7e-4c2d-8906-fd2431a63516\") " pod="openshift-image-registry/node-ca-2jqvs" Jun 11 10:02:29.390175 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.390097 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rmq5\" (UniqueName: \"kubernetes.io/projected/13ed28f9-7a85-46b7-8c28-2582db440199-kube-api-access-7rmq5\") pod \"aws-ebs-csi-driver-node-vr5gd\" (UID: \"13ed28f9-7a85-46b7-8c28-2582db440199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.390227 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.390189 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9dg6\" (UniqueName: \"kubernetes.io/projected/c993f270-96de-4982-98e6-a6595b401ce7-kube-api-access-s9dg6\") pod \"iptables-alerter-l7n82\" (UID: \"c993f270-96de-4982-98e6-a6595b401ce7\") " pod="openshift-network-operator/iptables-alerter-l7n82" Jun 11 10:02:29.390227 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.390214 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q22fm\" (UniqueName: \"kubernetes.io/projected/2d2a03f3-1cd0-4ff2-95e8-8d764948c65e-kube-api-access-q22fm\") pod \"node-resolver-xjcfv\" (UID: \"2d2a03f3-1cd0-4ff2-95e8-8d764948c65e\") " pod="openshift-dns/node-resolver-xjcfv" Jun 11 10:02:29.390300 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.390223 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stwnb\" (UniqueName: \"kubernetes.io/projected/6f223dd5-92de-45ba-8a4a-734cc6a4ecd2-kube-api-access-stwnb\") pod \"multus-additional-cni-plugins-hxrtq\" (UID: \"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2\") " pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.390769 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.390753 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fb7q\" (UniqueName: \"kubernetes.io/projected/d8462886-9f16-4e49-9990-86e5c70d0695-kube-api-access-4fb7q\") pod \"ovnkube-node-hjzkh\" (UID: \"d8462886-9f16-4e49-9990-86e5c70d0695\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.481608 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481577 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-run-multus-certs\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.481608 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-kubernetes\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-sysctl-conf\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481644 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-multus-cni-dir\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481665 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-cnibin\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481692 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-hostroot\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481702 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-run-multus-certs\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481711 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-etc-kubernetes\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481752 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-cnibin\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvwfs\" (UniqueName: \"kubernetes.io/projected/9b05be19-d3e1-4216-8727-bd84bf476b4b-kube-api-access-cvwfs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481775 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-hostroot\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481796 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-sysctl-conf\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481710 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-kubernetes\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481814 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-etc-kubernetes\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481807 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09b38e2b-4c8d-496a-930c-9cf28a6ef771-kubelet-config\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481841 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09b38e2b-4c8d-496a-930c-9cf28a6ef771-kubelet-config\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:29.481855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481751 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-multus-cni-dir\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-host\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-sysconfig\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-var-lib-kubelet\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481967 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-sysconfig\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481975 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-var-lib-kubelet\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-tuned\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.481968 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-host\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482039 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-var-lib-cni-bin\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482076 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-var-lib-cni-multus\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-multus-conf-dir\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09b38e2b-4c8d-496a-930c-9cf28a6ef771-dbus\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.482142 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-modprobe-d\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482163 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-var-lib-cni-multus\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482182 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-multus-conf-dir\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.482520 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.482200 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret podName:09b38e2b-4c8d-496a-930c-9cf28a6ef771 nodeName:}" failed. No retries permitted until 2026-06-11 10:02:29.982181168 +0000 UTC m=+2.143478224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret") pod "global-pull-secret-syncer-pvbq4" (UID: "09b38e2b-4c8d-496a-930c-9cf28a6ef771") : object "kube-system"/"original-pull-secret" not registered Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482222 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-run\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482226 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09b38e2b-4c8d-496a-930c-9cf28a6ef771-dbus\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482247 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2dcec05-0202-4db7-b4f3-6d37ab857972-tmp\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482249 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-modprobe-d\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-system-cni-dir\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482186 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-var-lib-cni-bin\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482282 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-run\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482320 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-system-cni-dir\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482327 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w7gn\" (UniqueName: \"kubernetes.io/projected/a2dcec05-0202-4db7-b4f3-6d37ab857972-kube-api-access-7w7gn\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482407 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba76fc15-0a09-4485-a2af-868156b60f32-cni-binary-copy\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482434 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-var-lib-kubelet\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482462 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-systemd\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-os-release\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482512 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-sys\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482554 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-run-k8s-cni-cncf-io\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482569 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-systemd\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.483291 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ba76fc15-0a09-4485-a2af-868156b60f32-multus-daemon-config\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482620 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-var-lib-kubelet\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.482660 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482667 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-sys\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482710 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-run-k8s-cni-cncf-io\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.482721 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs podName:9b05be19-d3e1-4216-8727-bd84bf476b4b nodeName:}" failed. No retries permitted until 2026-06-11 10:02:29.982704476 +0000 UTC m=+2.144001531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs") pod "network-metrics-daemon-mv8d6" (UID: "9b05be19-d3e1-4216-8727-bd84bf476b4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-run-netns\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482773 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-os-release\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482791 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-sysctl-d\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482814 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-host-run-netns\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-multus-socket-dir-parent\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fkv6\" (UniqueName: \"kubernetes.io/projected/ba76fc15-0a09-4485-a2af-868156b60f32-kube-api-access-5fkv6\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482862 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ba76fc15-0a09-4485-a2af-868156b60f32-multus-socket-dir-parent\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482874 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-lib-modules\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.482970 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-lib-modules\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.483005 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba76fc15-0a09-4485-a2af-868156b60f32-cni-binary-copy\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.483012 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-sysctl-d\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.484093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.483040 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ba76fc15-0a09-4485-a2af-868156b60f32-multus-daemon-config\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.484776 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.484236 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2dcec05-0202-4db7-b4f3-6d37ab857972-etc-tuned\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.484776 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.484401 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2dcec05-0202-4db7-b4f3-6d37ab857972-tmp\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.493551 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.493530 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvwfs\" (UniqueName: \"kubernetes.io/projected/9b05be19-d3e1-4216-8727-bd84bf476b4b-kube-api-access-cvwfs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:29.493684 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.493668 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fkv6\" (UniqueName: \"kubernetes.io/projected/ba76fc15-0a09-4485-a2af-868156b60f32-kube-api-access-5fkv6\") pod \"multus-bntjw\" (UID: \"ba76fc15-0a09-4485-a2af-868156b60f32\") " pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.493723 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.493693 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w7gn\" (UniqueName: \"kubernetes.io/projected/a2dcec05-0202-4db7-b4f3-6d37ab857972-kube-api-access-7w7gn\") pod \"tuned-fksb5\" (UID: \"a2dcec05-0202-4db7-b4f3-6d37ab857972\") " pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.576891 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.576816 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l7n82" Jun 11 10:02:29.585287 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:29.585257 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc993f270_96de_4982_98e6_a6595b401ce7.slice/crio-9e55d97bd987953e0d0bcb403e48a85996a10bdc68a9e2418f0d67ae835a3634 WatchSource:0}: Error finding container 9e55d97bd987953e0d0bcb403e48a85996a10bdc68a9e2418f0d67ae835a3634: Status 404 returned error can't find the container with id 9e55d97bd987953e0d0bcb403e48a85996a10bdc68a9e2418f0d67ae835a3634 Jun 11 10:02:29.589363 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.589345 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wtrj6" Jun 11 10:02:29.596028 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.596011 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" Jun 11 10:02:29.596607 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:29.596586 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a97a3a_5f40_4d67_bf31_71562e304205.slice/crio-1f5c3c00f127e0629a39e6995b23a160b0ef72de94945c415e328ca663824cee WatchSource:0}: Error finding container 1f5c3c00f127e0629a39e6995b23a160b0ef72de94945c415e328ca663824cee: Status 404 returned error can't find the container with id 1f5c3c00f127e0629a39e6995b23a160b0ef72de94945c415e328ca663824cee Jun 11 10:02:29.600137 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.600009 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xjcfv" Jun 11 10:02:29.604591 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:29.604563 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ed28f9_7a85_46b7_8c28_2582db440199.slice/crio-958250ad0a5515ce04b5698c44ac4860c61ef467eb4c65c70786a78be56b0aa3 WatchSource:0}: Error finding container 958250ad0a5515ce04b5698c44ac4860c61ef467eb4c65c70786a78be56b0aa3: Status 404 returned error can't find the container with id 958250ad0a5515ce04b5698c44ac4860c61ef467eb4c65c70786a78be56b0aa3 Jun 11 10:02:29.605554 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.605517 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2jqvs" Jun 11 10:02:29.609373 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:29.609335 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2a03f3_1cd0_4ff2_95e8_8d764948c65e.slice/crio-32ee7b0c8f01535f1e410fc2e827e5fbb2a3ebcbf8acddf1a7e4cdb357a9322f WatchSource:0}: Error finding container 32ee7b0c8f01535f1e410fc2e827e5fbb2a3ebcbf8acddf1a7e4cdb357a9322f: Status 404 returned error can't find the container with id 32ee7b0c8f01535f1e410fc2e827e5fbb2a3ebcbf8acddf1a7e4cdb357a9322f Jun 11 10:02:29.610495 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.610445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hxrtq" Jun 11 10:02:29.616985 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.616964 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:29.618640 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:29.618478 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8360a73_ef7e_4c2d_8906_fd2431a63516.slice/crio-e8e58af5751219a5e7a4cdea589cab729d865dbba539803dd23621fb392113fe WatchSource:0}: Error finding container e8e58af5751219a5e7a4cdea589cab729d865dbba539803dd23621fb392113fe: Status 404 returned error can't find the container with id e8e58af5751219a5e7a4cdea589cab729d865dbba539803dd23621fb392113fe Jun 11 10:02:29.621670 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:29.621637 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f223dd5_92de_45ba_8a4a_734cc6a4ecd2.slice/crio-31388e5a3a7f6f247b5243620f1450493f89c1821c34df2949c5bdee64951caf WatchSource:0}: Error finding container 31388e5a3a7f6f247b5243620f1450493f89c1821c34df2949c5bdee64951caf: Status 404 returned error can't find the container with id 31388e5a3a7f6f247b5243620f1450493f89c1821c34df2949c5bdee64951caf Jun 11 10:02:29.622606 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.622579 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fksb5" Jun 11 10:02:29.625854 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.625835 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 10:02:29.627303 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.627283 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bntjw" Jun 11 10:02:29.627620 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:29.627599 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8462886_9f16_4e49_9990_86e5c70d0695.slice/crio-a90de61fdb65102643fbb2a2dfe5bde416f13452af8e804436d04e7d17b99b56 WatchSource:0}: Error finding container a90de61fdb65102643fbb2a2dfe5bde416f13452af8e804436d04e7d17b99b56: Status 404 returned error can't find the container with id a90de61fdb65102643fbb2a2dfe5bde416f13452af8e804436d04e7d17b99b56 Jun 11 10:02:29.633679 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:29.633656 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2dcec05_0202_4db7_b4f3_6d37ab857972.slice/crio-32b6a30abc7325e80575f45c353e611ff04ca7b640a393c6a1de0c02051b010e WatchSource:0}: Error finding container 32b6a30abc7325e80575f45c353e611ff04ca7b640a393c6a1de0c02051b010e: Status 404 returned error can't find the container with id 32b6a30abc7325e80575f45c353e611ff04ca7b640a393c6a1de0c02051b010e Jun 11 10:02:29.637253 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:02:29.637231 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba76fc15_0a09_4485_a2af_868156b60f32.slice/crio-f3db5022ce9453ee7991b43bd3320928322fa229ed5720a293db5b7f65118348 WatchSource:0}: Error finding container f3db5022ce9453ee7991b43bd3320928322fa229ed5720a293db5b7f65118348: Status 404 returned error can't find the container with id f3db5022ce9453ee7991b43bd3320928322fa229ed5720a293db5b7f65118348 Jun 11 10:02:29.987311 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.987234 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:29.987311 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.987287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcfp\" (UniqueName: \"kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp\") pod \"network-check-target-5f2mf\" (UID: \"729a4b22-d1d8-4894-8a4b-7cae4c3b04c6\") " pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:29.987526 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:29.987368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:29.987526 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.987502 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 10:02:29.987625 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.987566 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret podName:09b38e2b-4c8d-496a-930c-9cf28a6ef771 nodeName:}" failed. No retries permitted until 2026-06-11 10:02:30.987547741 +0000 UTC m=+3.148844793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret") pod "global-pull-secret-syncer-pvbq4" (UID: "09b38e2b-4c8d-496a-930c-9cf28a6ef771") : object "kube-system"/"original-pull-secret" not registered Jun 11 10:02:29.988002 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.987980 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:02:29.988079 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.988038 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs podName:9b05be19-d3e1-4216-8727-bd84bf476b4b nodeName:}" failed. No retries permitted until 2026-06-11 10:02:30.988020534 +0000 UTC m=+3.149317590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs") pod "network-metrics-daemon-mv8d6" (UID: "9b05be19-d3e1-4216-8727-bd84bf476b4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:02:29.988156 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.988131 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 10:02:29.988156 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.988148 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 10:02:29.988305 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.988162 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2hcfp for pod openshift-network-diagnostics/network-check-target-5f2mf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:02:29.988305 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:29.988214 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp podName:729a4b22-d1d8-4894-8a4b-7cae4c3b04c6 nodeName:}" failed. No retries permitted until 2026-06-11 10:02:30.988200446 +0000 UTC m=+3.149497496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2hcfp" (UniqueName: "kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp") pod "network-check-target-5f2mf" (UID: "729a4b22-d1d8-4894-8a4b-7cae4c3b04c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:02:30.319303 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.319220 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 09:57:29 +0000 UTC" deadline="2027-11-30 20:45:37.665704806 +0000 UTC" Jun 11 10:02:30.319303 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.319257 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12898h43m7.346452403s" Jun 11 10:02:30.354066 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.354029 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bntjw" event={"ID":"ba76fc15-0a09-4485-a2af-868156b60f32","Type":"ContainerStarted","Data":"f3db5022ce9453ee7991b43bd3320928322fa229ed5720a293db5b7f65118348"} Jun 11 10:02:30.367354 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.367315 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fksb5" event={"ID":"a2dcec05-0202-4db7-b4f3-6d37ab857972","Type":"ContainerStarted","Data":"32b6a30abc7325e80575f45c353e611ff04ca7b640a393c6a1de0c02051b010e"} Jun 11 10:02:30.386342 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.386303 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" event={"ID":"d8462886-9f16-4e49-9990-86e5c70d0695","Type":"ContainerStarted","Data":"a90de61fdb65102643fbb2a2dfe5bde416f13452af8e804436d04e7d17b99b56"} Jun 11 10:02:30.404481 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.404437 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" event={"ID":"13ed28f9-7a85-46b7-8c28-2582db440199","Type":"ContainerStarted","Data":"958250ad0a5515ce04b5698c44ac4860c61ef467eb4c65c70786a78be56b0aa3"} Jun 11 10:02:30.411771 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.411734 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wtrj6" event={"ID":"28a97a3a-5f40-4d67-bf31-71562e304205","Type":"ContainerStarted","Data":"1f5c3c00f127e0629a39e6995b23a160b0ef72de94945c415e328ca663824cee"} Jun 11 10:02:30.417669 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.417625 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l7n82" event={"ID":"c993f270-96de-4982-98e6-a6595b401ce7","Type":"ContainerStarted","Data":"9e55d97bd987953e0d0bcb403e48a85996a10bdc68a9e2418f0d67ae835a3634"} Jun 11 10:02:30.429379 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.429344 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxrtq" event={"ID":"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2","Type":"ContainerStarted","Data":"31388e5a3a7f6f247b5243620f1450493f89c1821c34df2949c5bdee64951caf"} Jun 11 10:02:30.431109 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.431079 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2jqvs" event={"ID":"d8360a73-ef7e-4c2d-8906-fd2431a63516","Type":"ContainerStarted","Data":"e8e58af5751219a5e7a4cdea589cab729d865dbba539803dd23621fb392113fe"} Jun 11 10:02:30.438195 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.438106 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xjcfv" event={"ID":"2d2a03f3-1cd0-4ff2-95e8-8d764948c65e","Type":"ContainerStarted","Data":"32ee7b0c8f01535f1e410fc2e827e5fbb2a3ebcbf8acddf1a7e4cdb357a9322f"} Jun 11 10:02:30.531484 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.531271 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 10:02:30.562694 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.562639 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 10:02:30.993919 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.993876 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:30.994147 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.993977 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:30.994147 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:30.994008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcfp\" (UniqueName: \"kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp\") pod \"network-check-target-5f2mf\" (UID: \"729a4b22-d1d8-4894-8a4b-7cae4c3b04c6\") " pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:30.994268 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:30.994197 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 10:02:30.994268 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:30.994217 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 10:02:30.994268 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:30.994231 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2hcfp for pod openshift-network-diagnostics/network-check-target-5f2mf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:02:30.994418 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:30.994291 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp podName:729a4b22-d1d8-4894-8a4b-7cae4c3b04c6 nodeName:}" failed. No retries permitted until 2026-06-11 10:02:32.994271939 +0000 UTC m=+5.155568990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2hcfp" (UniqueName: "kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp") pod "network-check-target-5f2mf" (UID: "729a4b22-d1d8-4894-8a4b-7cae4c3b04c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:02:30.994742 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:30.994720 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 10:02:30.994845 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:30.994779 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret podName:09b38e2b-4c8d-496a-930c-9cf28a6ef771 nodeName:}" failed. No retries permitted until 2026-06-11 10:02:32.994762792 +0000 UTC m=+5.156059835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret") pod "global-pull-secret-syncer-pvbq4" (UID: "09b38e2b-4c8d-496a-930c-9cf28a6ef771") : object "kube-system"/"original-pull-secret" not registered Jun 11 10:02:30.994845 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:30.994833 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:02:30.994952 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:30.994863 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs podName:9b05be19-d3e1-4216-8727-bd84bf476b4b nodeName:}" failed. No retries permitted until 2026-06-11 10:02:32.994852089 +0000 UTC m=+5.156149129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs") pod "network-metrics-daemon-mv8d6" (UID: "9b05be19-d3e1-4216-8727-bd84bf476b4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:02:31.320335 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:31.320214 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 09:57:29 +0000 UTC" deadline="2028-02-07 19:04:56.548613264 +0000 UTC" Jun 11 10:02:31.320335 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:31.320276 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14553h2m25.2283408s" Jun 11 10:02:31.337716 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:31.337683 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:31.337716 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:31.337701 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:31.338025 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:31.337835 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:31.338025 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:31.337904 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:31.338025 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:31.337923 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:31.338025 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:31.338018 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:33.014539 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:33.014220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:33.014539 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:33.014284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:33.014539 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:33.014317 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcfp\" (UniqueName: \"kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp\") pod \"network-check-target-5f2mf\" (UID: \"729a4b22-d1d8-4894-8a4b-7cae4c3b04c6\") " pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:33.014539 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:33.014388 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 10:02:33.014539 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:33.014429 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:02:33.014539 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:33.014446 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 10:02:33.014539 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:33.014462 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 10:02:33.014539 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:33.014465 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret podName:09b38e2b-4c8d-496a-930c-9cf28a6ef771 nodeName:}" failed. No retries permitted until 2026-06-11 10:02:37.014444788 +0000 UTC m=+9.175741830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret") pod "global-pull-secret-syncer-pvbq4" (UID: "09b38e2b-4c8d-496a-930c-9cf28a6ef771") : object "kube-system"/"original-pull-secret" not registered Jun 11 10:02:33.014539 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:33.014474 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2hcfp for pod openshift-network-diagnostics/network-check-target-5f2mf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:02:33.014539 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:33.014485 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs podName:9b05be19-d3e1-4216-8727-bd84bf476b4b nodeName:}" failed. No retries permitted until 2026-06-11 10:02:37.014475591 +0000 UTC m=+9.175772631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs") pod "network-metrics-daemon-mv8d6" (UID: "9b05be19-d3e1-4216-8727-bd84bf476b4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:02:33.014539 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:33.014512 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp podName:729a4b22-d1d8-4894-8a4b-7cae4c3b04c6 nodeName:}" failed. No retries permitted until 2026-06-11 10:02:37.014497855 +0000 UTC m=+9.175794891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2hcfp" (UniqueName: "kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp") pod "network-check-target-5f2mf" (UID: "729a4b22-d1d8-4894-8a4b-7cae4c3b04c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:02:33.337659 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:33.337582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:33.337828 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:33.337578 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:33.337828 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:33.337700 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:33.337828 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:33.337727 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:33.337966 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:33.337847 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:33.337966 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:33.337921 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:35.337962 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:35.337921 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:35.338543 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:35.338520 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:35.338648 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:35.338543 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:35.338709 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:35.338512 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:35.338709 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:35.338685 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:35.340966 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:35.338861 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:37.048810 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:37.048771 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:37.049269 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:37.048845 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:37.049269 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:37.048874 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcfp\" (UniqueName: \"kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp\") pod \"network-check-target-5f2mf\" (UID: \"729a4b22-d1d8-4894-8a4b-7cae4c3b04c6\") " pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:37.049269 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:37.049001 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 10:02:37.049269 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:37.049021 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 10:02:37.049269 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:37.049043 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 10:02:37.049269 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:37.049056 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2hcfp for pod openshift-network-diagnostics/network-check-target-5f2mf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:02:37.049269 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:37.049061 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret podName:09b38e2b-4c8d-496a-930c-9cf28a6ef771 nodeName:}" failed. No retries permitted until 2026-06-11 10:02:45.049046408 +0000 UTC m=+17.210343445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret") pod "global-pull-secret-syncer-pvbq4" (UID: "09b38e2b-4c8d-496a-930c-9cf28a6ef771") : object "kube-system"/"original-pull-secret" not registered Jun 11 10:02:37.049269 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:37.049131 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp podName:729a4b22-d1d8-4894-8a4b-7cae4c3b04c6 nodeName:}" failed. No retries permitted until 2026-06-11 10:02:45.0490903 +0000 UTC m=+17.210387359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2hcfp" (UniqueName: "kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp") pod "network-check-target-5f2mf" (UID: "729a4b22-d1d8-4894-8a4b-7cae4c3b04c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:02:37.049269 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:37.049196 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:02:37.049269 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:37.049237 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs podName:9b05be19-d3e1-4216-8727-bd84bf476b4b nodeName:}" failed. No retries permitted until 2026-06-11 10:02:45.049225101 +0000 UTC m=+17.210522149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs") pod "network-metrics-daemon-mv8d6" (UID: "9b05be19-d3e1-4216-8727-bd84bf476b4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:02:37.339070 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:37.338262 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:37.339070 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:37.338392 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:37.339070 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:37.338772 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:37.339070 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:37.338871 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:37.339070 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:37.338922 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:37.339070 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:37.338988 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:39.337728 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:39.337689 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:39.338313 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:39.337865 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:39.338313 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:39.337689 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:39.338313 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:39.337689 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:39.338313 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:39.338080 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:39.338313 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:39.337958 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:41.337690 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:41.337597 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:41.337690 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:41.337650 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:41.338193 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:41.337725 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:41.338193 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:41.337739 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:41.338193 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:41.337812 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:41.338193 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:41.337877 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:43.337681 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:43.337628 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:43.338256 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:43.337765 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:43.338256 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:43.337774 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:43.338256 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:43.337799 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:43.338256 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:43.337902 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:43.338256 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:43.337979 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:45.107146 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:45.107087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:45.107598 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:45.107165 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:45.107598 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:45.107187 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcfp\" (UniqueName: \"kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp\") pod \"network-check-target-5f2mf\" (UID: \"729a4b22-d1d8-4894-8a4b-7cae4c3b04c6\") " pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:45.107598 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:45.107238 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 10:02:45.107598 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:45.107284 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:02:45.107598 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:45.107301 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 10:02:45.107598 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:45.107315 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 10:02:45.107598 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:45.107318 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret podName:09b38e2b-4c8d-496a-930c-9cf28a6ef771 nodeName:}" failed. No retries permitted until 2026-06-11 10:03:01.107294558 +0000 UTC m=+33.268591596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret") pod "global-pull-secret-syncer-pvbq4" (UID: "09b38e2b-4c8d-496a-930c-9cf28a6ef771") : object "kube-system"/"original-pull-secret" not registered Jun 11 10:02:45.107598 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:45.107327 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2hcfp for pod openshift-network-diagnostics/network-check-target-5f2mf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:02:45.107598 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:45.107342 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs podName:9b05be19-d3e1-4216-8727-bd84bf476b4b nodeName:}" failed. No retries permitted until 2026-06-11 10:03:01.107326244 +0000 UTC m=+33.268623297 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs") pod "network-metrics-daemon-mv8d6" (UID: "9b05be19-d3e1-4216-8727-bd84bf476b4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:02:45.107598 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:45.107364 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp podName:729a4b22-d1d8-4894-8a4b-7cae4c3b04c6 nodeName:}" failed. No retries permitted until 2026-06-11 10:03:01.10735243 +0000 UTC m=+33.268649483 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2hcfp" (UniqueName: "kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp") pod "network-check-target-5f2mf" (UID: "729a4b22-d1d8-4894-8a4b-7cae4c3b04c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:02:45.337468 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:45.337388 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:45.337468 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:45.337422 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:45.337688 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:45.337388 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:45.337688 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:45.337511 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:45.337688 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:45.337578 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:45.337688 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:45.337660 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:47.337953 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:47.337912 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:47.337953 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:47.337937 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:47.338457 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:47.338023 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:47.338457 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:47.338043 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:47.338457 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:47.338095 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:47.338457 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:47.338230 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:49.337261 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:49.337236 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:49.337560 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:49.337332 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:49.337560 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:49.337334 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:49.337560 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:49.337339 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:49.337560 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:49.337434 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:49.337560 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:49.337517 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:50.480036 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:50.479830 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" event={"ID":"86da014a9cd3afb75ae148ad505b00b6","Type":"ContainerStarted","Data":"7c96bd84a17ef20295ab964a9db89bc4a9649e11d33597bb50decc78014647bd"} Jun 11 10:02:50.481475 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:50.481449 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bntjw" event={"ID":"ba76fc15-0a09-4485-a2af-868156b60f32","Type":"ContainerStarted","Data":"27e5a66bc773ef803f8f35e8a8f48b3033c60eaf7118e05d4578a0a035a7191b"} Jun 11 10:02:50.482913 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:50.482895 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fksb5" event={"ID":"a2dcec05-0202-4db7-b4f3-6d37ab857972","Type":"ContainerStarted","Data":"27c9b7edc4fcef13a5c560138a7aa7b5cf97dac468f0aba3785f6139a2de80f3"} Jun 11 10:02:50.484428 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:50.484412 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:02:50.484741 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:50.484720 2575 generic.go:356] "Generic (PLEG): container finished" podID="d8462886-9f16-4e49-9990-86e5c70d0695" containerID="a39de878dcdb1849f206f6aad27b0bf16ff8d429ec0a6d445cab52b86b2a31c3" exitCode=1 Jun 11 10:02:50.484789 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:50.484754 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" event={"ID":"d8462886-9f16-4e49-9990-86e5c70d0695","Type":"ContainerDied","Data":"a39de878dcdb1849f206f6aad27b0bf16ff8d429ec0a6d445cab52b86b2a31c3"} Jun 11 10:02:50.484823 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:50.484802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" event={"ID":"d8462886-9f16-4e49-9990-86e5c70d0695","Type":"ContainerStarted","Data":"c8bb01ba558cf3bf4160ceff0de8c71f4cc805c32a84834b99d649009e1bbe07"} Jun 11 10:02:50.493845 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:50.493792 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" podStartSLOduration=21.493779292 podStartE2EDuration="21.493779292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:02:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:02:50.493519306 +0000 UTC m=+22.654816366" watchObservedRunningTime="2026-06-11 10:02:50.493779292 +0000 UTC m=+22.655076361" Jun 11 10:02:50.509825 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:50.509782 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fksb5" podStartSLOduration=2.824057917 podStartE2EDuration="22.509768103s" totalImagesPullingTime="19.685710186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:02:50.509510316 +0000 UTC m=+22.670807387" watchObservedRunningTime="2026-06-11 10:02:50.509768103 +0000 UTC m=+22.671065158" Jun 11 10:02:50.525962 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:50.525921 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bntjw" podStartSLOduration=2.586905483 podStartE2EDuration="22.52590505s" totalImagesPullingTime="19.938999567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:02:50.525483065 +0000 UTC m=+22.686780123" watchObservedRunningTime="2026-06-11 10:02:50.52590505 +0000 UTC m=+22.687202108" Jun 11 10:02:51.337998 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.337748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:51.338236 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.337748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:51.338236 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:51.338040 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:51.338236 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:51.338156 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:51.338236 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.337748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:51.338466 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:51.338254 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:51.489260 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.489233 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:02:51.489726 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.489653 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" event={"ID":"d8462886-9f16-4e49-9990-86e5c70d0695","Type":"ContainerStarted","Data":"d3880e44264751e023520248a13c442e276e87587343c108ed3284533c5d34a2"} Jun 11 10:02:51.489726 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.489717 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" event={"ID":"d8462886-9f16-4e49-9990-86e5c70d0695","Type":"ContainerStarted","Data":"bec3e455c4b18a25eb2a702763613865129943548ebfea9c7436ec6f4b141030"} Jun 11 10:02:51.489820 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.489762 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" event={"ID":"d8462886-9f16-4e49-9990-86e5c70d0695","Type":"ContainerStarted","Data":"64315762cbaacefcb27c07aa2a0e1ab7464f70c50e216a0b5606ac1ac0e86712"} Jun 11 10:02:51.489820 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.489792 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" event={"ID":"d8462886-9f16-4e49-9990-86e5c70d0695","Type":"ContainerStarted","Data":"efe9ce70d5f96ac9032ca40f7f2c866bd1222f984c5730e600631fe8d4d7379f"} Jun 11 10:02:51.491044 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.491019 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" event={"ID":"13ed28f9-7a85-46b7-8c28-2582db440199","Type":"ContainerStarted","Data":"8895b042773ff2405d01894d19ef564b0199e287397a70e45dbd2d84aff0d1a8"} Jun 11 10:02:51.492390 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.492363 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wtrj6" event={"ID":"28a97a3a-5f40-4d67-bf31-71562e304205","Type":"ContainerStarted","Data":"0d1726a65d644f233f8e08cf8ffe8196c585174c25401652f7be7eca62012268"} Jun 11 10:02:51.493672 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.493644 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l7n82" event={"ID":"c993f270-96de-4982-98e6-a6595b401ce7","Type":"ContainerStarted","Data":"3a0479bb44da718f271edd72c0720e84307cfedd795be5bda981b5e873994f18"} Jun 11 10:02:51.495089 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.494935 2575 generic.go:356] "Generic (PLEG): container finished" podID="ab416f5f449937b161ec909743985e2b" containerID="1c0b43d449a4797e2e33ac86636bf836265645b4af4f936f0889667ddad350e9" exitCode=0 Jun 11 10:02:51.495198 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.495006 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" event={"ID":"ab416f5f449937b161ec909743985e2b","Type":"ContainerDied","Data":"1c0b43d449a4797e2e33ac86636bf836265645b4af4f936f0889667ddad350e9"} Jun 11 10:02:51.496782 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.496761 2575 generic.go:356] "Generic (PLEG): container finished" podID="6f223dd5-92de-45ba-8a4a-734cc6a4ecd2" containerID="ea93ff45cd951c18f84d6116b1c60f44dcd4c534363402ec03878b46bed970f4" exitCode=0 Jun 11 10:02:51.496868 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.496790 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxrtq" event={"ID":"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2","Type":"ContainerDied","Data":"ea93ff45cd951c18f84d6116b1c60f44dcd4c534363402ec03878b46bed970f4"} Jun 11 10:02:51.500844 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.500818 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2jqvs" event={"ID":"d8360a73-ef7e-4c2d-8906-fd2431a63516","Type":"ContainerStarted","Data":"5f69f3736203a4ee62e0e88c4d71253b389957a47e6f9f509e662a41d59479b8"} Jun 11 10:02:51.502385 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.502361 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xjcfv" event={"ID":"2d2a03f3-1cd0-4ff2-95e8-8d764948c65e","Type":"ContainerStarted","Data":"9cf02fec405c17ad0e98cdacd9f4d3a60b87a02dc00e37538b01733583f6c6cd"} Jun 11 10:02:51.507673 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.507636 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wtrj6" podStartSLOduration=3.809291363 podStartE2EDuration="23.507623974s" totalImagesPullingTime="19.698332611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:02:51.50759521 +0000 UTC m=+23.668892268" watchObservedRunningTime="2026-06-11 10:02:51.507623974 +0000 UTC m=+23.668921026" Jun 11 10:02:51.521943 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.521893 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2jqvs" podStartSLOduration=3.823285382 podStartE2EDuration="23.521871723s" totalImagesPullingTime="19.698586341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:02:51.521712115 +0000 UTC m=+23.683009174" watchObservedRunningTime="2026-06-11 10:02:51.521871723 +0000 UTC m=+23.683168782" Jun 11 10:02:51.569653 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.569595 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l7n82" podStartSLOduration=3.835975749 podStartE2EDuration="23.56957633s" totalImagesPullingTime="19.733600581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:02:51.569074671 +0000 UTC m=+23.730371728" watchObservedRunningTime="2026-06-11 10:02:51.56957633 +0000 UTC m=+23.730873388" Jun 11 10:02:51.583073 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.583022 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xjcfv" podStartSLOduration=3.878539499 podStartE2EDuration="23.58300355s" totalImagesPullingTime="19.704464051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:02:51.582662031 +0000 UTC m=+23.743959089" watchObservedRunningTime="2026-06-11 10:02:51.58300355 +0000 UTC m=+23.744300607" Jun 11 10:02:51.655093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.655007 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wtrj6" Jun 11 10:02:51.655820 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:51.655787 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wtrj6" Jun 11 10:02:52.109414 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:52.109390 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 10:02:52.328250 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:52.328069 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T10:02:52.109409332Z","UUID":"1fab1e08-942a-44bd-bc81-849026c1c53a","Handler":null,"Name":"","Endpoint":""} Jun 11 10:02:52.329403 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:52.329386 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 10:02:52.329509 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:52.329419 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 10:02:52.507342 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:52.507305 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" event={"ID":"13ed28f9-7a85-46b7-8c28-2582db440199","Type":"ContainerStarted","Data":"c1a297c621534307433051768365fc76f1ff2d110353e1c5172175992addd98c"} Jun 11 10:02:52.511159 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:52.510777 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" event={"ID":"ab416f5f449937b161ec909743985e2b","Type":"ContainerStarted","Data":"2a89239366139f49b9c65f683b14a112a49dad1b9d1ffc741473ad022285ad23"} Jun 11 10:02:52.511159 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:52.511093 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wtrj6" Jun 11 10:02:52.511764 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:52.511732 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wtrj6" Jun 11 10:02:52.527739 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:52.527679 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" podStartSLOduration=23.527662029 podStartE2EDuration="23.527662029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:02:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:02:52.526963049 +0000 UTC m=+24.688260109" watchObservedRunningTime="2026-06-11 10:02:52.527662029 +0000 UTC m=+24.688959087" Jun 11 10:02:53.338394 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:53.338309 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:53.338621 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:53.338309 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:53.338621 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:53.338452 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:53.338621 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:53.338313 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:53.338621 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:53.338521 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:53.338902 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:53.338615 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:53.515494 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:53.515465 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:02:53.516152 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:53.515966 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" event={"ID":"d8462886-9f16-4e49-9990-86e5c70d0695","Type":"ContainerStarted","Data":"588f0c1d8633d340eb8fa7b9ed5dc49cdcde207dd9b8bb48b780602a73310798"} Jun 11 10:02:53.518382 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:53.518336 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" event={"ID":"13ed28f9-7a85-46b7-8c28-2582db440199","Type":"ContainerStarted","Data":"22bbbb334d31e652f73d982efc574eb4cd2c30285b7c4e13ea7772f07a774c3b"} Jun 11 10:02:53.538034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:53.537985 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vr5gd" podStartSLOduration=3.86002681 podStartE2EDuration="25.537967857s" totalImagesPullingTime="21.677941047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:02:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:02:53.537304523 +0000 UTC m=+25.698601584" watchObservedRunningTime="2026-06-11 10:02:53.537967857 +0000 UTC m=+25.699264918" Jun 11 10:02:55.337695 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:55.337490 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:55.338138 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:55.337543 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:55.338138 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:55.337778 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:55.338138 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:55.337548 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:55.338138 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:55.337861 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:55.338138 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:55.337942 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:56.528496 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:56.528478 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:02:56.529593 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:56.528838 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" event={"ID":"d8462886-9f16-4e49-9990-86e5c70d0695","Type":"ContainerStarted","Data":"ee3614807c09859c44fdff6e188874917f32e4dc876e095eac0324bd3848bc28"} Jun 11 10:02:56.529593 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:56.529216 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:56.529593 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:56.529290 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:56.529593 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:56.529338 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:56.529593 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:56.529451 2575 scope.go:117] "RemoveContainer" containerID="a39de878dcdb1849f206f6aad27b0bf16ff8d429ec0a6d445cab52b86b2a31c3" Jun 11 10:02:56.546437 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:56.546273 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:56.546565 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:56.546472 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:02:57.337804 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:57.337611 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:57.338043 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:57.337654 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:57.338043 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:57.337876 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:57.338043 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:57.337957 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:57.338043 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:57.337658 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:57.338043 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:57.338022 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:57.534376 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:57.534347 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:02:57.534792 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:57.534729 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" event={"ID":"d8462886-9f16-4e49-9990-86e5c70d0695","Type":"ContainerStarted","Data":"99d1a6a0e8407838caee0ced2b160031baa1ad1fafbede0f41def800d4b2fb3c"} Jun 11 10:02:57.536557 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:57.536533 2575 generic.go:356] "Generic (PLEG): container finished" podID="6f223dd5-92de-45ba-8a4a-734cc6a4ecd2" containerID="0a14228c194c78c4cd2abbe5380ec93f5ce635f4dabacbbefcde91981d736dc7" exitCode=0 Jun 11 10:02:57.536651 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:57.536573 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxrtq" event={"ID":"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2","Type":"ContainerDied","Data":"0a14228c194c78c4cd2abbe5380ec93f5ce635f4dabacbbefcde91981d736dc7"} Jun 11 10:02:57.562566 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:57.562522 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" podStartSLOduration=9.025842181 podStartE2EDuration="29.562508451s" totalImagesPullingTime="20.53666627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:02:57.560630984 +0000 UTC m=+29.721928042" watchObservedRunningTime="2026-06-11 10:02:57.562508451 +0000 UTC m=+29.723805524" Jun 11 10:02:58.470715 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:58.470677 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mv8d6"] Jun 11 10:02:58.470868 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:58.470822 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:02:58.470960 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:58.470937 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:02:58.471487 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:58.471448 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pvbq4"] Jun 11 10:02:58.471588 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:58.471575 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:02:58.471688 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:58.471670 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:02:58.472522 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:58.472500 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5f2mf"] Jun 11 10:02:58.472653 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:58.472593 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:02:58.472718 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:02:58.472673 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:02:59.543703 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:59.543628 2575 generic.go:356] "Generic (PLEG): container finished" podID="6f223dd5-92de-45ba-8a4a-734cc6a4ecd2" containerID="56fe41f7d1836370f897281c67055c141e0960370efacc943ce9d9dfa7af644f" exitCode=0 Jun 11 10:02:59.543703 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:02:59.543671 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxrtq" event={"ID":"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2","Type":"ContainerDied","Data":"56fe41f7d1836370f897281c67055c141e0960370efacc943ce9d9dfa7af644f"} Jun 11 10:03:00.337817 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:00.337622 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:03:00.338034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:00.337622 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:03:00.338034 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:00.337889 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:03:00.338034 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:00.337955 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:03:00.338034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:00.337702 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:03:00.338034 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:00.338028 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:03:01.129426 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:01.129391 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:03:01.129779 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:01.129440 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:03:01.129779 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:01.129466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcfp\" (UniqueName: \"kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp\") pod \"network-check-target-5f2mf\" (UID: \"729a4b22-d1d8-4894-8a4b-7cae4c3b04c6\") " pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:03:01.129779 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:01.129541 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 10:03:01.129779 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:01.129583 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 10:03:01.129779 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:01.129596 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 10:03:01.129779 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:01.129605 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret podName:09b38e2b-4c8d-496a-930c-9cf28a6ef771 nodeName:}" failed. No retries permitted until 2026-06-11 10:03:33.129586808 +0000 UTC m=+65.290883862 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret") pod "global-pull-secret-syncer-pvbq4" (UID: "09b38e2b-4c8d-496a-930c-9cf28a6ef771") : object "kube-system"/"original-pull-secret" not registered Jun 11 10:03:01.129779 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:01.129608 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2hcfp for pod openshift-network-diagnostics/network-check-target-5f2mf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:03:01.129779 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:01.129542 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:03:01.129779 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:01.129643 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp podName:729a4b22-d1d8-4894-8a4b-7cae4c3b04c6 nodeName:}" failed. No retries permitted until 2026-06-11 10:03:33.129633168 +0000 UTC m=+65.290930217 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2hcfp" (UniqueName: "kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp") pod "network-check-target-5f2mf" (UID: "729a4b22-d1d8-4894-8a4b-7cae4c3b04c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 10:03:01.129779 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:01.129678 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs podName:9b05be19-d3e1-4216-8727-bd84bf476b4b nodeName:}" failed. No retries permitted until 2026-06-11 10:03:33.129662079 +0000 UTC m=+65.290959119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs") pod "network-metrics-daemon-mv8d6" (UID: "9b05be19-d3e1-4216-8727-bd84bf476b4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 10:03:01.550342 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:01.550307 2575 generic.go:356] "Generic (PLEG): container finished" podID="6f223dd5-92de-45ba-8a4a-734cc6a4ecd2" containerID="e460b1e24f33e015d7865751c28968ba9e4e4147d0f44b99d97e07aaf49d32eb" exitCode=0 Jun 11 10:03:01.550492 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:01.550349 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxrtq" event={"ID":"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2","Type":"ContainerDied","Data":"e460b1e24f33e015d7865751c28968ba9e4e4147d0f44b99d97e07aaf49d32eb"} Jun 11 10:03:02.340951 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.340883 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:03:02.341440 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.341000 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:03:02.341440 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:02.341010 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5f2mf" podUID="729a4b22-d1d8-4894-8a4b-7cae4c3b04c6" Jun 11 10:03:02.341440 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.341061 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:03:02.341440 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:02.341175 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvbq4" podUID="09b38e2b-4c8d-496a-930c-9cf28a6ef771" Jun 11 10:03:02.341440 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:02.341260 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:03:02.630386 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.630308 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeReady" Jun 11 10:03:02.630538 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.630452 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 10:03:02.673760 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.673723 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9nxqp"] Jun 11 10:03:02.687703 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.687667 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k4fzc"] Jun 11 10:03:02.687937 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.687816 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:02.691364 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.690529 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 10:03:02.691364 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.690780 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m2lwr\"" Jun 11 10:03:02.691364 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.690788 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 10:03:02.702255 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.702233 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9nxqp"] Jun 11 10:03:02.702384 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.702275 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k4fzc"] Jun 11 10:03:02.702384 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.702358 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k4fzc" Jun 11 10:03:02.705295 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.705275 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 10:03:02.705424 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.705309 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 10:03:02.705424 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.705278 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 10:03:02.705539 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.705410 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b7mvj\"" Jun 11 10:03:02.844361 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.844296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:02.844361 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.844348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c1a2525-5e0e-4b4f-ab12-7148711938f3-config-volume\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:02.844732 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.844420 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06917c6e-4f6f-4b26-8973-c11a7b6c789f-cert\") pod \"ingress-canary-k4fzc\" (UID: \"06917c6e-4f6f-4b26-8973-c11a7b6c789f\") " pod="openshift-ingress-canary/ingress-canary-k4fzc" Jun 11 10:03:02.844732 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.844449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzdxg\" (UniqueName: \"kubernetes.io/projected/06917c6e-4f6f-4b26-8973-c11a7b6c789f-kube-api-access-hzdxg\") pod \"ingress-canary-k4fzc\" (UID: \"06917c6e-4f6f-4b26-8973-c11a7b6c789f\") " pod="openshift-ingress-canary/ingress-canary-k4fzc" Jun 11 10:03:02.844732 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.844474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1a2525-5e0e-4b4f-ab12-7148711938f3-tmp-dir\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:02.844732 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.844511 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bldcw\" (UniqueName: \"kubernetes.io/projected/5c1a2525-5e0e-4b4f-ab12-7148711938f3-kube-api-access-bldcw\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:02.945603 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.945521 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c1a2525-5e0e-4b4f-ab12-7148711938f3-config-volume\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:02.945603 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.945578 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06917c6e-4f6f-4b26-8973-c11a7b6c789f-cert\") pod \"ingress-canary-k4fzc\" (UID: \"06917c6e-4f6f-4b26-8973-c11a7b6c789f\") " pod="openshift-ingress-canary/ingress-canary-k4fzc" Jun 11 10:03:02.945826 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.945707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdxg\" (UniqueName: \"kubernetes.io/projected/06917c6e-4f6f-4b26-8973-c11a7b6c789f-kube-api-access-hzdxg\") pod \"ingress-canary-k4fzc\" (UID: \"06917c6e-4f6f-4b26-8973-c11a7b6c789f\") " pod="openshift-ingress-canary/ingress-canary-k4fzc" Jun 11 10:03:02.945826 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.945748 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1a2525-5e0e-4b4f-ab12-7148711938f3-tmp-dir\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:02.945826 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.945795 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bldcw\" (UniqueName: \"kubernetes.io/projected/5c1a2525-5e0e-4b4f-ab12-7148711938f3-kube-api-access-bldcw\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:02.945971 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.945856 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:02.946021 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:02.945989 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 10:03:02.946148 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:02.946050 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls podName:5c1a2525-5e0e-4b4f-ab12-7148711938f3 nodeName:}" failed. No retries permitted until 2026-06-11 10:03:03.446031122 +0000 UTC m=+35.607328175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls") pod "dns-default-9nxqp" (UID: "5c1a2525-5e0e-4b4f-ab12-7148711938f3") : secret "dns-default-metrics-tls" not found Jun 11 10:03:02.946285 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.946254 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c1a2525-5e0e-4b4f-ab12-7148711938f3-config-volume\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:02.946373 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.946281 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1a2525-5e0e-4b4f-ab12-7148711938f3-tmp-dir\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:02.950496 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.950471 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06917c6e-4f6f-4b26-8973-c11a7b6c789f-cert\") pod \"ingress-canary-k4fzc\" (UID: \"06917c6e-4f6f-4b26-8973-c11a7b6c789f\") " pod="openshift-ingress-canary/ingress-canary-k4fzc" Jun 11 10:03:02.957681 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.957659 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzdxg\" (UniqueName: \"kubernetes.io/projected/06917c6e-4f6f-4b26-8973-c11a7b6c789f-kube-api-access-hzdxg\") pod \"ingress-canary-k4fzc\" (UID: \"06917c6e-4f6f-4b26-8973-c11a7b6c789f\") " pod="openshift-ingress-canary/ingress-canary-k4fzc" Jun 11 10:03:02.957681 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:02.957672 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bldcw\" (UniqueName: \"kubernetes.io/projected/5c1a2525-5e0e-4b4f-ab12-7148711938f3-kube-api-access-bldcw\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:03.012452 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:03.012417 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k4fzc" Jun 11 10:03:03.165247 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:03.165221 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k4fzc"] Jun 11 10:03:03.167497 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:03:03.167461 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06917c6e_4f6f_4b26_8973_c11a7b6c789f.slice/crio-9ddef36c4a3378d74c36f8e1a89cb81a161b5c53eb960054912c79938d8c5d55 WatchSource:0}: Error finding container 9ddef36c4a3378d74c36f8e1a89cb81a161b5c53eb960054912c79938d8c5d55: Status 404 returned error can't find the container with id 9ddef36c4a3378d74c36f8e1a89cb81a161b5c53eb960054912c79938d8c5d55 Jun 11 10:03:03.450393 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:03.450361 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:03.450810 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:03.450512 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 10:03:03.450810 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:03.450592 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls podName:5c1a2525-5e0e-4b4f-ab12-7148711938f3 nodeName:}" failed. No retries permitted until 2026-06-11 10:03:04.450572204 +0000 UTC m=+36.611869245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls") pod "dns-default-9nxqp" (UID: "5c1a2525-5e0e-4b4f-ab12-7148711938f3") : secret "dns-default-metrics-tls" not found Jun 11 10:03:03.556735 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:03.556677 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k4fzc" event={"ID":"06917c6e-4f6f-4b26-8973-c11a7b6c789f","Type":"ContainerStarted","Data":"9ddef36c4a3378d74c36f8e1a89cb81a161b5c53eb960054912c79938d8c5d55"} Jun 11 10:03:04.337582 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:04.337371 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:03:04.337773 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:04.337371 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:03:04.337773 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:04.337381 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:03:04.343028 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:04.342800 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 10:03:04.343028 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:04.342807 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 10:03:04.343028 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:04.342809 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 10:03:04.343028 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:04.342910 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9p7qb\"" Jun 11 10:03:04.343028 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:04.343024 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 10:03:04.343336 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:04.343178 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fr8s2\"" Jun 11 10:03:04.459279 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:04.459243 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:04.459726 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:04.459444 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 10:03:04.459726 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:04.459576 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls podName:5c1a2525-5e0e-4b4f-ab12-7148711938f3 nodeName:}" failed. No retries permitted until 2026-06-11 10:03:06.459551318 +0000 UTC m=+38.620848373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls") pod "dns-default-9nxqp" (UID: "5c1a2525-5e0e-4b4f-ab12-7148711938f3") : secret "dns-default-metrics-tls" not found Jun 11 10:03:06.475066 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:06.475033 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:06.475880 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:06.475223 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 10:03:06.475880 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:06.475301 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls podName:5c1a2525-5e0e-4b4f-ab12-7148711938f3 nodeName:}" failed. No retries permitted until 2026-06-11 10:03:10.475281448 +0000 UTC m=+42.636578500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls") pod "dns-default-9nxqp" (UID: "5c1a2525-5e0e-4b4f-ab12-7148711938f3") : secret "dns-default-metrics-tls" not found Jun 11 10:03:06.565870 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:06.565838 2575 generic.go:356] "Generic (PLEG): container finished" podID="6f223dd5-92de-45ba-8a4a-734cc6a4ecd2" containerID="8eb8dc13d3d05eaee040ac3c044f7da172591f30d5f37a2d28c0d9799d731d5d" exitCode=0 Jun 11 10:03:06.566046 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:06.565916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxrtq" event={"ID":"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2","Type":"ContainerDied","Data":"8eb8dc13d3d05eaee040ac3c044f7da172591f30d5f37a2d28c0d9799d731d5d"} Jun 11 10:03:06.567367 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:06.567344 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k4fzc" event={"ID":"06917c6e-4f6f-4b26-8973-c11a7b6c789f","Type":"ContainerStarted","Data":"60dc8b8804e8afba23f8472ea3f768eb94f8d511d966eca8bff17ca3ea896c22"} Jun 11 10:03:06.606805 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:06.606744 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k4fzc" podStartSLOduration=1.592080251 podStartE2EDuration="4.606726237s" totalImagesPullingTime="3.014645986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:03:06.605558614 +0000 UTC m=+38.766855693" watchObservedRunningTime="2026-06-11 10:03:06.606726237 +0000 UTC m=+38.768023295" Jun 11 10:03:07.573126 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:07.573092 2575 generic.go:356] "Generic (PLEG): container finished" podID="6f223dd5-92de-45ba-8a4a-734cc6a4ecd2" containerID="e0bd5abcaca879369fbd964271c0a90d7b807a5541c5326f32e544b2bda50d40" exitCode=0 Jun 11 10:03:07.573622 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:07.573186 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxrtq" event={"ID":"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2","Type":"ContainerDied","Data":"e0bd5abcaca879369fbd964271c0a90d7b807a5541c5326f32e544b2bda50d40"} Jun 11 10:03:08.578821 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:08.578787 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxrtq" event={"ID":"6f223dd5-92de-45ba-8a4a-734cc6a4ecd2","Type":"ContainerStarted","Data":"810fba070739435e14006014586797e8726d2140591c10973994a34bd49ac82e"} Jun 11 10:03:08.618258 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:08.618211 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hxrtq" podStartSLOduration=9.0582049 podStartE2EDuration="40.618196187s" totalImagesPullingTime="31.559991287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:02:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:03:08.602940859 +0000 UTC m=+40.764237917" watchObservedRunningTime="2026-06-11 10:03:08.618196187 +0000 UTC m=+40.779493245" Jun 11 10:03:10.501597 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:10.501554 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:10.501983 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:10.501710 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 10:03:10.501983 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:10.501775 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls podName:5c1a2525-5e0e-4b4f-ab12-7148711938f3 nodeName:}" failed. No retries permitted until 2026-06-11 10:03:18.501758184 +0000 UTC m=+50.663055220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls") pod "dns-default-9nxqp" (UID: "5c1a2525-5e0e-4b4f-ab12-7148711938f3") : secret "dns-default-metrics-tls" not found Jun 11 10:03:18.556855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:18.556818 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:18.557338 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:18.556977 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 10:03:18.557338 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:18.557045 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls podName:5c1a2525-5e0e-4b4f-ab12-7148711938f3 nodeName:}" failed. No retries permitted until 2026-06-11 10:03:34.557029134 +0000 UTC m=+66.718326173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls") pod "dns-default-9nxqp" (UID: "5c1a2525-5e0e-4b4f-ab12-7148711938f3") : secret "dns-default-metrics-tls" not found Jun 11 10:03:28.557965 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:28.557934 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjzkh" Jun 11 10:03:33.153377 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.153322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:03:33.153377 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.153379 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcfp\" (UniqueName: \"kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp\") pod \"network-check-target-5f2mf\" (UID: \"729a4b22-d1d8-4894-8a4b-7cae4c3b04c6\") " pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:03:33.153872 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.153431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:03:33.156569 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.156543 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 10:03:33.156569 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.156560 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 10:03:33.156753 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.156586 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 10:03:33.164036 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:33.164017 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 10:03:33.164139 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:33.164098 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs podName:9b05be19-d3e1-4216-8727-bd84bf476b4b nodeName:}" failed. No retries permitted until 2026-06-11 10:04:37.164075466 +0000 UTC m=+129.325372506 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs") pod "network-metrics-daemon-mv8d6" (UID: "9b05be19-d3e1-4216-8727-bd84bf476b4b") : secret "metrics-daemon-secret" not found Jun 11 10:03:33.166420 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.166405 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 10:03:33.167077 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.167058 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09b38e2b-4c8d-496a-930c-9cf28a6ef771-original-pull-secret\") pod \"global-pull-secret-syncer-pvbq4\" (UID: \"09b38e2b-4c8d-496a-930c-9cf28a6ef771\") " pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:03:33.176828 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.176807 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hcfp\" (UniqueName: \"kubernetes.io/projected/729a4b22-d1d8-4894-8a4b-7cae4c3b04c6-kube-api-access-2hcfp\") pod \"network-check-target-5f2mf\" (UID: \"729a4b22-d1d8-4894-8a4b-7cae4c3b04c6\") " pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:03:33.451185 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.451150 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvbq4" Jun 11 10:03:33.461958 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.461932 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9p7qb\"" Jun 11 10:03:33.469766 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.469736 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:03:33.584663 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.584635 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pvbq4"] Jun 11 10:03:33.595890 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.595845 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5f2mf"] Jun 11 10:03:33.599089 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:03:33.599058 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod729a4b22_d1d8_4894_8a4b_7cae4c3b04c6.slice/crio-319cf608a9258b673ff3628adfa2b69a303bb6346e617c44ea40a9417f1e39e8 WatchSource:0}: Error finding container 319cf608a9258b673ff3628adfa2b69a303bb6346e617c44ea40a9417f1e39e8: Status 404 returned error can't find the container with id 319cf608a9258b673ff3628adfa2b69a303bb6346e617c44ea40a9417f1e39e8 Jun 11 10:03:33.637092 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.637063 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5f2mf" event={"ID":"729a4b22-d1d8-4894-8a4b-7cae4c3b04c6","Type":"ContainerStarted","Data":"319cf608a9258b673ff3628adfa2b69a303bb6346e617c44ea40a9417f1e39e8"} Jun 11 10:03:33.638034 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:33.638013 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pvbq4" event={"ID":"09b38e2b-4c8d-496a-930c-9cf28a6ef771","Type":"ContainerStarted","Data":"136bb9e8a8fb20eb8825470eaa5f0e283d5856cc5a1d2d117adbf3fc76ed73f0"} Jun 11 10:03:34.562177 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:34.562146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:03:34.562633 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:34.562314 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 10:03:34.562633 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:03:34.562392 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls podName:5c1a2525-5e0e-4b4f-ab12-7148711938f3 nodeName:}" failed. No retries permitted until 2026-06-11 10:04:06.562370997 +0000 UTC m=+98.723668035 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls") pod "dns-default-9nxqp" (UID: "5c1a2525-5e0e-4b4f-ab12-7148711938f3") : secret "dns-default-metrics-tls" not found Jun 11 10:03:38.653843 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:38.653804 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5f2mf" event={"ID":"729a4b22-d1d8-4894-8a4b-7cae4c3b04c6","Type":"ContainerStarted","Data":"26b2029e95f7064510c4602c61c006884c1cd35d9a1aedd4d300a34c6d198c38"} Jun 11 10:03:38.654324 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:38.653869 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:03:38.655242 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:38.655218 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pvbq4" event={"ID":"09b38e2b-4c8d-496a-930c-9cf28a6ef771","Type":"ContainerStarted","Data":"8a7c4466654890794f433c04494ebb024ff1f13c51fb9e5455657776c6f565d0"} Jun 11 10:03:38.670682 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:38.670641 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5f2mf" podStartSLOduration=66.251531505 podStartE2EDuration="1m10.670629348s" totalImagesPullingTime="4.419097843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:03:38.66905144 +0000 UTC m=+70.830348499" watchObservedRunningTime="2026-06-11 10:03:38.670629348 +0000 UTC m=+70.831926400" Jun 11 10:03:38.684037 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:38.683988 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pvbq4" podStartSLOduration=66.247990002 podStartE2EDuration="1m10.683971487s" totalImagesPullingTime="4.435981485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:03:38.682653865 +0000 UTC m=+70.843950924" watchObservedRunningTime="2026-06-11 10:03:38.683971487 +0000 UTC m=+70.845268544" Jun 11 10:03:56.779915 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.779878 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s"] Jun 11 10:03:56.782851 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.782835 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.785621 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.785590 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 10:03:56.785621 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.785590 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 10:03:56.785844 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.785686 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 10:03:56.785929 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.785907 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 10:03:56.786113 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.786096 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 10:03:56.787151 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.787132 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 10:03:56.787257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.787214 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 10:03:56.792817 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.792798 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s"] Jun 11 10:03:56.808923 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.808903 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4974ae97-9b1d-4274-8d0b-0ad245a87e78-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.809016 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.808945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4974ae97-9b1d-4274-8d0b-0ad245a87e78-ca\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.809016 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.808985 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b45t\" (UniqueName: \"kubernetes.io/projected/4974ae97-9b1d-4274-8d0b-0ad245a87e78-kube-api-access-4b45t\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.809096 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.809027 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4974ae97-9b1d-4274-8d0b-0ad245a87e78-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.809096 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.809053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4974ae97-9b1d-4274-8d0b-0ad245a87e78-hub\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.809096 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.809068 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4974ae97-9b1d-4274-8d0b-0ad245a87e78-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.909397 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.909364 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4974ae97-9b1d-4274-8d0b-0ad245a87e78-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.909599 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.909423 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4974ae97-9b1d-4274-8d0b-0ad245a87e78-hub\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.909599 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.909450 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4974ae97-9b1d-4274-8d0b-0ad245a87e78-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.909599 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.909476 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4974ae97-9b1d-4274-8d0b-0ad245a87e78-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.909599 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.909517 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4974ae97-9b1d-4274-8d0b-0ad245a87e78-ca\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.909599 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.909563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b45t\" (UniqueName: \"kubernetes.io/projected/4974ae97-9b1d-4274-8d0b-0ad245a87e78-kube-api-access-4b45t\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.910266 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.910237 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4974ae97-9b1d-4274-8d0b-0ad245a87e78-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.911875 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.911853 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4974ae97-9b1d-4274-8d0b-0ad245a87e78-hub\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.912057 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.912035 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4974ae97-9b1d-4274-8d0b-0ad245a87e78-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.912275 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.912259 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4974ae97-9b1d-4274-8d0b-0ad245a87e78-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.912348 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.912287 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4974ae97-9b1d-4274-8d0b-0ad245a87e78-ca\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:56.917783 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:56.917760 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b45t\" (UniqueName: \"kubernetes.io/projected/4974ae97-9b1d-4274-8d0b-0ad245a87e78-kube-api-access-4b45t\") pod \"cluster-proxy-proxy-agent-65d4f57b87-ldk4s\" (UID: \"4974ae97-9b1d-4274-8d0b-0ad245a87e78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:57.101587 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:57.101481 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:03:57.220500 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:57.220470 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s"] Jun 11 10:03:57.224869 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:03:57.224836 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4974ae97_9b1d_4274_8d0b_0ad245a87e78.slice/crio-06236cf9f5375688c4161f71880bac69e32db312909b6b2ac8436fbff7c11310 WatchSource:0}: Error finding container 06236cf9f5375688c4161f71880bac69e32db312909b6b2ac8436fbff7c11310: Status 404 returned error can't find the container with id 06236cf9f5375688c4161f71880bac69e32db312909b6b2ac8436fbff7c11310 Jun 11 10:03:57.699640 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:03:57.699603 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" event={"ID":"4974ae97-9b1d-4274-8d0b-0ad245a87e78","Type":"ContainerStarted","Data":"06236cf9f5375688c4161f71880bac69e32db312909b6b2ac8436fbff7c11310"} Jun 11 10:04:01.713901 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:04:01.713866 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" event={"ID":"4974ae97-9b1d-4274-8d0b-0ad245a87e78","Type":"ContainerStarted","Data":"9b97a442529f9b62abd2c7fa02ac4ff47797d22d21d1a76aabee5eb8dda94657"} Jun 11 10:04:01.714292 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:04:01.713910 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" event={"ID":"4974ae97-9b1d-4274-8d0b-0ad245a87e78","Type":"ContainerStarted","Data":"845a85466a0a31aba3a9099d13ddeb47bab1ec07b530996f98c39412db8e86d7"} Jun 11 10:04:01.714292 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:04:01.713924 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" event={"ID":"4974ae97-9b1d-4274-8d0b-0ad245a87e78","Type":"ContainerStarted","Data":"a48cf3229002458c32868ce39d43e1a53d5bb03781440b425e735d6a45bdd700"} Jun 11 10:04:01.735316 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:04:01.735273 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" podStartSLOduration=2.048275219 podStartE2EDuration="5.735257643s" totalImagesPullingTime="3.686982424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:04:01.734520306 +0000 UTC m=+93.895817363" watchObservedRunningTime="2026-06-11 10:04:01.735257643 +0000 UTC m=+93.896554732" Jun 11 10:04:06.580725 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:04:06.580679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:04:06.581225 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:04:06.580831 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 10:04:06.581225 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:04:06.580906 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls podName:5c1a2525-5e0e-4b4f-ab12-7148711938f3 nodeName:}" failed. No retries permitted until 2026-06-11 10:05:10.580885063 +0000 UTC m=+162.742182118 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls") pod "dns-default-9nxqp" (UID: "5c1a2525-5e0e-4b4f-ab12-7148711938f3") : secret "dns-default-metrics-tls" not found Jun 11 10:04:09.660000 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:04:09.659969 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5f2mf" Jun 11 10:04:37.193349 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:04:37.193292 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:04:37.193841 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:04:37.193455 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 10:04:37.193841 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:04:37.193548 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs podName:9b05be19-d3e1-4216-8727-bd84bf476b4b nodeName:}" failed. No retries permitted until 2026-06-11 10:06:39.193530729 +0000 UTC m=+251.354827766 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs") pod "network-metrics-daemon-mv8d6" (UID: "9b05be19-d3e1-4216-8727-bd84bf476b4b") : secret "metrics-daemon-secret" not found Jun 11 10:05:05.699639 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:05:05.699583 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9nxqp" podUID="5c1a2525-5e0e-4b4f-ab12-7148711938f3" Jun 11 10:05:05.897717 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:05:05.897685 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9nxqp" Jun 11 10:05:07.364233 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:05:07.364191 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:05:10.631558 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:05:10.631522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:05:10.631942 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:05:10.631678 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 10:05:10.631942 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:05:10.631743 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls podName:5c1a2525-5e0e-4b4f-ab12-7148711938f3 nodeName:}" failed. No retries permitted until 2026-06-11 10:07:12.631727667 +0000 UTC m=+284.793024703 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls") pod "dns-default-9nxqp" (UID: "5c1a2525-5e0e-4b4f-ab12-7148711938f3") : secret "dns-default-metrics-tls" not found Jun 11 10:05:19.338224 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:05:19.338106 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:06:30.116516 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.116482 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch"] Jun 11 10:06:30.118389 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.118373 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" Jun 11 10:06:30.121408 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.121386 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 10:06:30.122669 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.122648 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 10:06:30.122767 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.122681 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 10:06:30.122767 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.122681 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 10:06:30.122874 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.122653 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-z5s7l\"" Jun 11 10:06:30.132529 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.132511 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch"] Jun 11 10:06:30.272000 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.271965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bc30512-30a4-4fa1-bc86-fa38bac28aca-config\") pod \"service-ca-operator-6bc5ff68f5-znjch\" (UID: \"9bc30512-30a4-4fa1-bc86-fa38bac28aca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" Jun 11 10:06:30.272166 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.272019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc30512-30a4-4fa1-bc86-fa38bac28aca-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-znjch\" (UID: \"9bc30512-30a4-4fa1-bc86-fa38bac28aca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" Jun 11 10:06:30.272166 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.272049 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6688\" (UniqueName: \"kubernetes.io/projected/9bc30512-30a4-4fa1-bc86-fa38bac28aca-kube-api-access-c6688\") pod \"service-ca-operator-6bc5ff68f5-znjch\" (UID: \"9bc30512-30a4-4fa1-bc86-fa38bac28aca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" Jun 11 10:06:30.372949 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.372872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc30512-30a4-4fa1-bc86-fa38bac28aca-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-znjch\" (UID: \"9bc30512-30a4-4fa1-bc86-fa38bac28aca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" Jun 11 10:06:30.372949 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.372918 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6688\" (UniqueName: \"kubernetes.io/projected/9bc30512-30a4-4fa1-bc86-fa38bac28aca-kube-api-access-c6688\") pod \"service-ca-operator-6bc5ff68f5-znjch\" (UID: \"9bc30512-30a4-4fa1-bc86-fa38bac28aca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" Jun 11 10:06:30.373144 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.373060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bc30512-30a4-4fa1-bc86-fa38bac28aca-config\") pod \"service-ca-operator-6bc5ff68f5-znjch\" (UID: \"9bc30512-30a4-4fa1-bc86-fa38bac28aca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" Jun 11 10:06:30.373573 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.373551 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bc30512-30a4-4fa1-bc86-fa38bac28aca-config\") pod \"service-ca-operator-6bc5ff68f5-znjch\" (UID: \"9bc30512-30a4-4fa1-bc86-fa38bac28aca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" Jun 11 10:06:30.375031 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.375012 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc30512-30a4-4fa1-bc86-fa38bac28aca-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-znjch\" (UID: \"9bc30512-30a4-4fa1-bc86-fa38bac28aca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" Jun 11 10:06:30.380341 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.380314 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6688\" (UniqueName: \"kubernetes.io/projected/9bc30512-30a4-4fa1-bc86-fa38bac28aca-kube-api-access-c6688\") pod \"service-ca-operator-6bc5ff68f5-znjch\" (UID: \"9bc30512-30a4-4fa1-bc86-fa38bac28aca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" Jun 11 10:06:30.427369 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.427333 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" Jun 11 10:06:30.543798 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:30.543777 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch"] Jun 11 10:06:30.546234 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:06:30.546208 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc30512_30a4_4fa1_bc86_fa38bac28aca.slice/crio-ee65fb95677f8be820d05279d3215b8cb5691c2ca2754fc9ff48bf3902fec1f4 WatchSource:0}: Error finding container ee65fb95677f8be820d05279d3215b8cb5691c2ca2754fc9ff48bf3902fec1f4: Status 404 returned error can't find the container with id ee65fb95677f8be820d05279d3215b8cb5691c2ca2754fc9ff48bf3902fec1f4 Jun 11 10:06:31.138020 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:31.137978 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" event={"ID":"9bc30512-30a4-4fa1-bc86-fa38bac28aca","Type":"ContainerStarted","Data":"ee65fb95677f8be820d05279d3215b8cb5691c2ca2754fc9ff48bf3902fec1f4"} Jun 11 10:06:33.146184 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:33.146147 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" event={"ID":"9bc30512-30a4-4fa1-bc86-fa38bac28aca","Type":"ContainerStarted","Data":"531865154dcdc9de0673962accc1d3164698ac7e61a73da312b9962e4e1b3a89"} Jun 11 10:06:33.163201 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:33.163151 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" podStartSLOduration=0.777966838 podStartE2EDuration="3.163113124s" totalImagesPullingTime="2.385146286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:06:33.161784459 +0000 UTC m=+245.323081517" watchObservedRunningTime="2026-06-11 10:06:33.163113124 +0000 UTC m=+245.324410181" Jun 11 10:06:37.662288 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:37.662256 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xjcfv_2d2a03f3-1cd0-4ff2-95e8-8d764948c65e/dns-node-resolver/0.log" Jun 11 10:06:38.261513 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:38.261484 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2jqvs_d8360a73-ef7e-4c2d-8906-fd2431a63516/node-ca/0.log" Jun 11 10:06:39.239868 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:39.239825 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:06:39.240287 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:06:39.239974 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 10:06:39.240287 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:06:39.240037 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs podName:9b05be19-d3e1-4216-8727-bd84bf476b4b nodeName:}" failed. No retries permitted until 2026-06-11 10:08:41.240022159 +0000 UTC m=+373.401319196 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs") pod "network-metrics-daemon-mv8d6" (UID: "9b05be19-d3e1-4216-8727-bd84bf476b4b") : secret "metrics-daemon-secret" not found Jun 11 10:06:39.261514 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:39.261485 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k4fzc_06917c6e-4f6f-4b26-8973-c11a7b6c789f/serve-healthcheck-canary/0.log" Jun 11 10:06:55.806591 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.806560 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x2rgq"] Jun 11 10:06:55.808657 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.808640 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.811241 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.811220 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8tfs6\"" Jun 11 10:06:55.812955 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.812934 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 10:06:55.813050 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.812951 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 10:06:55.813050 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.812960 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 10:06:55.813050 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.812934 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 10:06:55.822806 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.822785 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x2rgq"] Jun 11 10:06:55.852991 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.852955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlp96\" (UniqueName: \"kubernetes.io/projected/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-kube-api-access-wlp96\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.853151 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.852996 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-data-volume\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.853151 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.853026 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.853151 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.853066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-crio-socket\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.853151 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.853090 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.857807 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.857781 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77888dc649-wh8qm"] Jun 11 10:06:55.859440 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.859420 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:55.862695 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.862671 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 10:06:55.862695 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.862682 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 10:06:55.862866 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.862819 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wwvqm\"" Jun 11 10:06:55.862866 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.862820 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 10:06:55.873160 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.873110 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 10:06:55.874020 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.873998 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77888dc649-wh8qm"] Jun 11 10:06:55.954188 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cq44\" (UniqueName: \"kubernetes.io/projected/299366ae-e2cc-4b58-91e4-a0562ffb9311-kube-api-access-5cq44\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:55.954188 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954196 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlp96\" (UniqueName: \"kubernetes.io/projected/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-kube-api-access-wlp96\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.954428 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954215 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/299366ae-e2cc-4b58-91e4-a0562ffb9311-registry-certificates\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:55.954428 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954235 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.954428 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954250 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/299366ae-e2cc-4b58-91e4-a0562ffb9311-installation-pull-secrets\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:55.954428 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-crio-socket\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.954428 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.954428 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954305 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/299366ae-e2cc-4b58-91e4-a0562ffb9311-image-registry-private-configuration\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:55.954428 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954381 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/299366ae-e2cc-4b58-91e4-a0562ffb9311-ca-trust-extracted\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:55.954428 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954397 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-crio-socket\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.954428 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/299366ae-e2cc-4b58-91e4-a0562ffb9311-registry-tls\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:55.954740 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954461 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/299366ae-e2cc-4b58-91e4-a0562ffb9311-bound-sa-token\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:55.954740 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-data-volume\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.954740 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/299366ae-e2cc-4b58-91e4-a0562ffb9311-trusted-ca\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:55.954740 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954733 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-data-volume\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.954860 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.954809 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.956646 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.956614 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:55.962464 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:55.962444 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlp96\" (UniqueName: \"kubernetes.io/projected/2a0a1178-2c8e-4784-b152-39d75a7bbf7e-kube-api-access-wlp96\") pod \"insights-runtime-extractor-x2rgq\" (UID: \"2a0a1178-2c8e-4784-b152-39d75a7bbf7e\") " pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:56.055343 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.055312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/299366ae-e2cc-4b58-91e4-a0562ffb9311-bound-sa-token\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.055524 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.055363 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/299366ae-e2cc-4b58-91e4-a0562ffb9311-trusted-ca\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.055524 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.055389 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cq44\" (UniqueName: \"kubernetes.io/projected/299366ae-e2cc-4b58-91e4-a0562ffb9311-kube-api-access-5cq44\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.055524 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.055419 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/299366ae-e2cc-4b58-91e4-a0562ffb9311-registry-certificates\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.055524 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.055439 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/299366ae-e2cc-4b58-91e4-a0562ffb9311-installation-pull-secrets\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.055524 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.055462 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/299366ae-e2cc-4b58-91e4-a0562ffb9311-image-registry-private-configuration\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.055524 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.055497 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/299366ae-e2cc-4b58-91e4-a0562ffb9311-ca-trust-extracted\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.055524 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.055525 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/299366ae-e2cc-4b58-91e4-a0562ffb9311-registry-tls\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.056081 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.056048 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/299366ae-e2cc-4b58-91e4-a0562ffb9311-ca-trust-extracted\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.056375 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.056355 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/299366ae-e2cc-4b58-91e4-a0562ffb9311-registry-certificates\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.056735 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.056681 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/299366ae-e2cc-4b58-91e4-a0562ffb9311-trusted-ca\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.058039 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.058015 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/299366ae-e2cc-4b58-91e4-a0562ffb9311-installation-pull-secrets\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.058203 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.058186 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/299366ae-e2cc-4b58-91e4-a0562ffb9311-image-registry-private-configuration\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.058259 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.058212 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/299366ae-e2cc-4b58-91e4-a0562ffb9311-registry-tls\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.063950 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.063928 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/299366ae-e2cc-4b58-91e4-a0562ffb9311-bound-sa-token\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.064605 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.064583 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cq44\" (UniqueName: \"kubernetes.io/projected/299366ae-e2cc-4b58-91e4-a0562ffb9311-kube-api-access-5cq44\") pod \"image-registry-77888dc649-wh8qm\" (UID: \"299366ae-e2cc-4b58-91e4-a0562ffb9311\") " pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.117431 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.117399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x2rgq" Jun 11 10:06:56.170482 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.170453 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:56.253021 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.252993 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x2rgq"] Jun 11 10:06:56.256365 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:06:56.256335 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0a1178_2c8e_4784_b152_39d75a7bbf7e.slice/crio-4016321a9950ee22a5cb66911f2cdc70562be9da0a8655101f48dcb8979d97ca WatchSource:0}: Error finding container 4016321a9950ee22a5cb66911f2cdc70562be9da0a8655101f48dcb8979d97ca: Status 404 returned error can't find the container with id 4016321a9950ee22a5cb66911f2cdc70562be9da0a8655101f48dcb8979d97ca Jun 11 10:06:56.300697 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:56.300670 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77888dc649-wh8qm"] Jun 11 10:06:56.304188 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:06:56.304165 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299366ae_e2cc_4b58_91e4_a0562ffb9311.slice/crio-9b958cf231de12bb5d91eec8cddc70470805b4f3c14aa4ec56eab98f65ba8f69 WatchSource:0}: Error finding container 9b958cf231de12bb5d91eec8cddc70470805b4f3c14aa4ec56eab98f65ba8f69: Status 404 returned error can't find the container with id 9b958cf231de12bb5d91eec8cddc70470805b4f3c14aa4ec56eab98f65ba8f69 Jun 11 10:06:57.214297 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:57.214258 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77888dc649-wh8qm" event={"ID":"299366ae-e2cc-4b58-91e4-a0562ffb9311","Type":"ContainerStarted","Data":"e5cc65e369d8d2b3107841a8a76817bcc5338831e05da12a38d30ad5d3b45f1a"} Jun 11 10:06:57.214703 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:57.214313 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77888dc649-wh8qm" event={"ID":"299366ae-e2cc-4b58-91e4-a0562ffb9311","Type":"ContainerStarted","Data":"9b958cf231de12bb5d91eec8cddc70470805b4f3c14aa4ec56eab98f65ba8f69"} Jun 11 10:06:57.214703 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:57.214362 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:06:57.215970 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:57.215949 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2rgq" event={"ID":"2a0a1178-2c8e-4784-b152-39d75a7bbf7e","Type":"ContainerStarted","Data":"dffc1845528082d8809bc4cae931623fc377216a32b5b362eefa841abad3126e"} Jun 11 10:06:57.216095 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:57.215995 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2rgq" event={"ID":"2a0a1178-2c8e-4784-b152-39d75a7bbf7e","Type":"ContainerStarted","Data":"4281ff1827a33228a5a0780fe9f0d6f59c03e82cc90dfd98da099ad66d9ef3bc"} Jun 11 10:06:57.216095 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:57.216027 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2rgq" event={"ID":"2a0a1178-2c8e-4784-b152-39d75a7bbf7e","Type":"ContainerStarted","Data":"4016321a9950ee22a5cb66911f2cdc70562be9da0a8655101f48dcb8979d97ca"} Jun 11 10:06:57.233222 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:57.233184 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77888dc649-wh8qm" podStartSLOduration=2.233172132 podStartE2EDuration="2.233172132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:06:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:06:57.232456504 +0000 UTC m=+269.393753583" watchObservedRunningTime="2026-06-11 10:06:57.233172132 +0000 UTC m=+269.394469190" Jun 11 10:06:59.228413 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:59.228374 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2rgq" event={"ID":"2a0a1178-2c8e-4784-b152-39d75a7bbf7e","Type":"ContainerStarted","Data":"d71807e2e89e6cc89f03972d7d315e46e7046cc12cfb8ce89e3a1d8123a651b7"} Jun 11 10:06:59.246221 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:06:59.246167 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x2rgq" podStartSLOduration=2.172558082 podStartE2EDuration="4.246151351s" totalImagesPullingTime="2.073593269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:06:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:06:59.245665465 +0000 UTC m=+271.406962547" watchObservedRunningTime="2026-06-11 10:06:59.246151351 +0000 UTC m=+271.407448420" Jun 11 10:07:07.102789 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:07.102741 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" podUID="4974ae97-9b1d-4274-8d0b-0ad245a87e78" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 10:07:08.898167 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:07:08.898130 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9nxqp" podUID="5c1a2525-5e0e-4b4f-ab12-7148711938f3" Jun 11 10:07:09.257820 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:09.257787 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9nxqp" Jun 11 10:07:12.416488 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.416425 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88"] Jun 11 10:07:12.419418 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.419398 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.422534 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.422513 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 10:07:12.422633 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.422570 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 10:07:12.423891 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.423872 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 10:07:12.423969 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.423943 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 10:07:12.424024 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.424000 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6tnzp\"" Jun 11 10:07:12.424235 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.424218 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 10:07:12.434996 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.434968 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88"] Jun 11 10:07:12.447442 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.447414 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6rhjz"] Jun 11 10:07:12.450441 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.450423 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.452963 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.452941 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cg7pp\"" Jun 11 10:07:12.453092 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.453020 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 10:07:12.453335 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.453314 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 10:07:12.453422 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.453351 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 10:07:12.483244 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-wtmp\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.483244 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzcpx\" (UniqueName: \"kubernetes.io/projected/0510ca8f-e7cb-4f24-8204-da1fac82fc06-kube-api-access-lzcpx\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.483470 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483276 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee3bba26-fe3a-45d8-a0c5-6aab46c17501-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-88g88\" (UID: \"ee3bba26-fe3a-45d8-a0c5-6aab46c17501\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.483470 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-textfile\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.483470 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483323 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-accelerators-collector-config\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.483470 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483358 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee3bba26-fe3a-45d8-a0c5-6aab46c17501-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-88g88\" (UID: \"ee3bba26-fe3a-45d8-a0c5-6aab46c17501\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.483470 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483389 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0510ca8f-e7cb-4f24-8204-da1fac82fc06-root\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.483470 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-tls\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.483470 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0510ca8f-e7cb-4f24-8204-da1fac82fc06-sys\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.483712 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483509 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.483712 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483526 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbttd\" (UniqueName: \"kubernetes.io/projected/ee3bba26-fe3a-45d8-a0c5-6aab46c17501-kube-api-access-hbttd\") pod \"openshift-state-metrics-65f78d5c66-88g88\" (UID: \"ee3bba26-fe3a-45d8-a0c5-6aab46c17501\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.483712 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483553 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0510ca8f-e7cb-4f24-8204-da1fac82fc06-metrics-client-ca\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.483712 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.483605 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee3bba26-fe3a-45d8-a0c5-6aab46c17501-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-88g88\" (UID: \"ee3bba26-fe3a-45d8-a0c5-6aab46c17501\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.584377 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584343 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.584563 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584391 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbttd\" (UniqueName: \"kubernetes.io/projected/ee3bba26-fe3a-45d8-a0c5-6aab46c17501-kube-api-access-hbttd\") pod \"openshift-state-metrics-65f78d5c66-88g88\" (UID: \"ee3bba26-fe3a-45d8-a0c5-6aab46c17501\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.584563 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584427 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0510ca8f-e7cb-4f24-8204-da1fac82fc06-metrics-client-ca\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.584563 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee3bba26-fe3a-45d8-a0c5-6aab46c17501-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-88g88\" (UID: \"ee3bba26-fe3a-45d8-a0c5-6aab46c17501\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.584563 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-wtmp\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.584563 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584521 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzcpx\" (UniqueName: \"kubernetes.io/projected/0510ca8f-e7cb-4f24-8204-da1fac82fc06-kube-api-access-lzcpx\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.584563 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584552 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee3bba26-fe3a-45d8-a0c5-6aab46c17501-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-88g88\" (UID: \"ee3bba26-fe3a-45d8-a0c5-6aab46c17501\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.584856 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584575 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-textfile\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.584856 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-accelerators-collector-config\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.584856 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee3bba26-fe3a-45d8-a0c5-6aab46c17501-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-88g88\" (UID: \"ee3bba26-fe3a-45d8-a0c5-6aab46c17501\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.584856 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584665 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0510ca8f-e7cb-4f24-8204-da1fac82fc06-root\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.584856 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584713 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-tls\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.584856 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584755 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0510ca8f-e7cb-4f24-8204-da1fac82fc06-sys\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.584856 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584840 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0510ca8f-e7cb-4f24-8204-da1fac82fc06-sys\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.585210 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584915 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-wtmp\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.585210 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.584979 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0510ca8f-e7cb-4f24-8204-da1fac82fc06-root\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.585590 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.585399 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-textfile\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.585590 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:07:12.585509 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 10:07:12.585590 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.585541 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-accelerators-collector-config\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.585590 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:07:12.585580 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-tls podName:0510ca8f-e7cb-4f24-8204-da1fac82fc06 nodeName:}" failed. No retries permitted until 2026-06-11 10:07:13.085559977 +0000 UTC m=+285.246857013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-tls") pod "node-exporter-6rhjz" (UID: "0510ca8f-e7cb-4f24-8204-da1fac82fc06") : secret "node-exporter-tls" not found Jun 11 10:07:12.585869 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.585619 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee3bba26-fe3a-45d8-a0c5-6aab46c17501-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-88g88\" (UID: \"ee3bba26-fe3a-45d8-a0c5-6aab46c17501\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.586218 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.586190 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0510ca8f-e7cb-4f24-8204-da1fac82fc06-metrics-client-ca\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.587229 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.587203 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.587642 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.587602 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee3bba26-fe3a-45d8-a0c5-6aab46c17501-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-88g88\" (UID: \"ee3bba26-fe3a-45d8-a0c5-6aab46c17501\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.588460 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.588004 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee3bba26-fe3a-45d8-a0c5-6aab46c17501-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-88g88\" (UID: \"ee3bba26-fe3a-45d8-a0c5-6aab46c17501\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.597567 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.597544 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzcpx\" (UniqueName: \"kubernetes.io/projected/0510ca8f-e7cb-4f24-8204-da1fac82fc06-kube-api-access-lzcpx\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:12.597675 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.597631 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbttd\" (UniqueName: \"kubernetes.io/projected/ee3bba26-fe3a-45d8-a0c5-6aab46c17501-kube-api-access-hbttd\") pod \"openshift-state-metrics-65f78d5c66-88g88\" (UID: \"ee3bba26-fe3a-45d8-a0c5-6aab46c17501\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.686072 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.685975 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:07:12.688251 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.688231 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c1a2525-5e0e-4b4f-ab12-7148711938f3-metrics-tls\") pod \"dns-default-9nxqp\" (UID: \"5c1a2525-5e0e-4b4f-ab12-7148711938f3\") " pod="openshift-dns/dns-default-9nxqp" Jun 11 10:07:12.728505 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.728480 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" Jun 11 10:07:12.852715 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.852682 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88"] Jun 11 10:07:12.855455 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:07:12.855430 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3bba26_fe3a_45d8_a0c5_6aab46c17501.slice/crio-4f5b15b801732180cc8abc8ffb6223e2dbeb809c7b94cfee96f627805e9ccdfb WatchSource:0}: Error finding container 4f5b15b801732180cc8abc8ffb6223e2dbeb809c7b94cfee96f627805e9ccdfb: Status 404 returned error can't find the container with id 4f5b15b801732180cc8abc8ffb6223e2dbeb809c7b94cfee96f627805e9ccdfb Jun 11 10:07:12.860612 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.860595 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m2lwr\"" Jun 11 10:07:12.868421 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.868399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9nxqp" Jun 11 10:07:12.997970 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:12.997946 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9nxqp"] Jun 11 10:07:13.000975 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:07:13.000948 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1a2525_5e0e_4b4f_ab12_7148711938f3.slice/crio-f0400616d4e02f46ac0ac261c4af2061b6b83f5f4f0a553ecadb8791b0a2e1d1 WatchSource:0}: Error finding container f0400616d4e02f46ac0ac261c4af2061b6b83f5f4f0a553ecadb8791b0a2e1d1: Status 404 returned error can't find the container with id f0400616d4e02f46ac0ac261c4af2061b6b83f5f4f0a553ecadb8791b0a2e1d1 Jun 11 10:07:13.089868 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:13.089829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-tls\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:13.092101 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:13.092071 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0510ca8f-e7cb-4f24-8204-da1fac82fc06-node-exporter-tls\") pod \"node-exporter-6rhjz\" (UID: \"0510ca8f-e7cb-4f24-8204-da1fac82fc06\") " pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:13.270521 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:13.270481 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9nxqp" event={"ID":"5c1a2525-5e0e-4b4f-ab12-7148711938f3","Type":"ContainerStarted","Data":"f0400616d4e02f46ac0ac261c4af2061b6b83f5f4f0a553ecadb8791b0a2e1d1"} Jun 11 10:07:13.272223 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:13.272197 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" event={"ID":"ee3bba26-fe3a-45d8-a0c5-6aab46c17501","Type":"ContainerStarted","Data":"4e8e740891c20d8352b400c8b64569d3cd84a2e0438f3716f3c70fda0ddf1f89"} Jun 11 10:07:13.272330 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:13.272243 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" event={"ID":"ee3bba26-fe3a-45d8-a0c5-6aab46c17501","Type":"ContainerStarted","Data":"9b6fbd2970bdc919f1f36a5baeaf5d307f190ef23c2f1cd4406357a13ef67230"} Jun 11 10:07:13.272330 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:13.272261 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" event={"ID":"ee3bba26-fe3a-45d8-a0c5-6aab46c17501","Type":"ContainerStarted","Data":"4f5b15b801732180cc8abc8ffb6223e2dbeb809c7b94cfee96f627805e9ccdfb"} Jun 11 10:07:13.359386 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:13.359354 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6rhjz" Jun 11 10:07:13.370892 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:07:13.370847 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0510ca8f_e7cb_4f24_8204_da1fac82fc06.slice/crio-b6eb7a13d204c0a08afef09c5cbc50922c0cff1218cd900391803b5bdd6c5318 WatchSource:0}: Error finding container b6eb7a13d204c0a08afef09c5cbc50922c0cff1218cd900391803b5bdd6c5318: Status 404 returned error can't find the container with id b6eb7a13d204c0a08afef09c5cbc50922c0cff1218cd900391803b5bdd6c5318 Jun 11 10:07:14.277432 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:14.277393 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6rhjz" event={"ID":"0510ca8f-e7cb-4f24-8204-da1fac82fc06","Type":"ContainerStarted","Data":"b6eb7a13d204c0a08afef09c5cbc50922c0cff1218cd900391803b5bdd6c5318"} Jun 11 10:07:15.282974 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:15.282944 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" event={"ID":"ee3bba26-fe3a-45d8-a0c5-6aab46c17501","Type":"ContainerStarted","Data":"f42a2bb6bdc5240d4f8d2747a657c33e43e1c1f204265097774ab577b90f7755"} Jun 11 10:07:15.284577 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:15.284540 2575 generic.go:356] "Generic (PLEG): container finished" podID="0510ca8f-e7cb-4f24-8204-da1fac82fc06" containerID="3a9b17f5e7d87c0c15b966f404e3998e6a66a9ef08fab54f893b4289a59db5a7" exitCode=0 Jun 11 10:07:15.284653 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:15.284626 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6rhjz" event={"ID":"0510ca8f-e7cb-4f24-8204-da1fac82fc06","Type":"ContainerDied","Data":"3a9b17f5e7d87c0c15b966f404e3998e6a66a9ef08fab54f893b4289a59db5a7"} Jun 11 10:07:15.286652 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:15.286632 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9nxqp" event={"ID":"5c1a2525-5e0e-4b4f-ab12-7148711938f3","Type":"ContainerStarted","Data":"2ea655d72d66dfa94a7f8446bfe4cbe94cfeac434deaaed19d0706478e2eac25"} Jun 11 10:07:15.286776 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:15.286762 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9nxqp" Jun 11 10:07:15.305690 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:15.305639 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-88g88" podStartSLOduration=1.9040847410000001 podStartE2EDuration="3.305621857s" totalImagesPullingTime="1.401537116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:07:15.304559798 +0000 UTC m=+287.465856856" watchObservedRunningTime="2026-06-11 10:07:15.305621857 +0000 UTC m=+287.466918915" Jun 11 10:07:15.327103 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:15.327063 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9nxqp" podStartSLOduration=251.224365122 podStartE2EDuration="4m13.327046666s" totalImagesPullingTime="2.102681544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:07:15.326380431 +0000 UTC m=+287.487677501" watchObservedRunningTime="2026-06-11 10:07:15.327046666 +0000 UTC m=+287.488343726" Jun 11 10:07:16.175737 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:16.175687 2575 patch_prober.go:28] interesting pod/image-registry-77888dc649-wh8qm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 10:07:16.175943 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:16.175758 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77888dc649-wh8qm" podUID="299366ae-e2cc-4b58-91e4-a0562ffb9311" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 10:07:16.291931 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:16.291888 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6rhjz" event={"ID":"0510ca8f-e7cb-4f24-8204-da1fac82fc06","Type":"ContainerStarted","Data":"caf5718eef527464b26f9f3fa5e4c7e314dda60385cb68b9733c200675d7afc2"} Jun 11 10:07:16.292404 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:16.291990 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6rhjz" event={"ID":"0510ca8f-e7cb-4f24-8204-da1fac82fc06","Type":"ContainerStarted","Data":"a8130616a68073bf317e0d361b097349f97115025c7d4bd39709785f8d0ff7ad"} Jun 11 10:07:16.293588 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:16.293565 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9nxqp" event={"ID":"5c1a2525-5e0e-4b4f-ab12-7148711938f3","Type":"ContainerStarted","Data":"87a4ef0cf024e5100614049b3761de63e390b4462534efe1eeb76a233f3fc941"} Jun 11 10:07:16.314262 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:16.314211 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6rhjz" podStartSLOduration=3.226059003 podStartE2EDuration="4.31419468s" totalImagesPullingTime="1.020156379s" totalInitContainerRuntime="67.979298ms" isStatefulPod=true podCreationTimestamp="2026-06-11 10:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:07:16.312051409 +0000 UTC m=+288.473348467" watchObservedRunningTime="2026-06-11 10:07:16.31419468 +0000 UTC m=+288.475491737" Jun 11 10:07:17.103105 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:17.103066 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" podUID="4974ae97-9b1d-4274-8d0b-0ad245a87e78" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 10:07:18.226038 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:18.226006 2575 patch_prober.go:28] interesting pod/image-registry-77888dc649-wh8qm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 10:07:18.226428 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:18.226056 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77888dc649-wh8qm" podUID="299366ae-e2cc-4b58-91e4-a0562ffb9311" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 10:07:22.338887 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:07:22.338846 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mv8d6" podUID="9b05be19-d3e1-4216-8727-bd84bf476b4b" Jun 11 10:07:26.175196 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:26.175160 2575 patch_prober.go:28] interesting pod/image-registry-77888dc649-wh8qm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 10:07:26.175562 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:26.175215 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77888dc649-wh8qm" podUID="299366ae-e2cc-4b58-91e4-a0562ffb9311" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 10:07:26.300226 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:26.300191 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9nxqp" Jun 11 10:07:27.102795 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:27.102752 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" podUID="4974ae97-9b1d-4274-8d0b-0ad245a87e78" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 10:07:27.102940 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:27.102835 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" Jun 11 10:07:27.103358 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:27.103327 2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"9b97a442529f9b62abd2c7fa02ac4ff47797d22d21d1a76aabee5eb8dda94657"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 10:07:27.103397 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:27.103378 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" podUID="4974ae97-9b1d-4274-8d0b-0ad245a87e78" containerName="service-proxy" containerID="cri-o://9b97a442529f9b62abd2c7fa02ac4ff47797d22d21d1a76aabee5eb8dda94657" gracePeriod=30 Jun 11 10:07:27.333169 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:27.333108 2575 generic.go:356] "Generic (PLEG): container finished" podID="4974ae97-9b1d-4274-8d0b-0ad245a87e78" containerID="9b97a442529f9b62abd2c7fa02ac4ff47797d22d21d1a76aabee5eb8dda94657" exitCode=2 Jun 11 10:07:27.333518 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:27.333187 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" event={"ID":"4974ae97-9b1d-4274-8d0b-0ad245a87e78","Type":"ContainerDied","Data":"9b97a442529f9b62abd2c7fa02ac4ff47797d22d21d1a76aabee5eb8dda94657"} Jun 11 10:07:27.333518 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:27.333229 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d4f57b87-ldk4s" event={"ID":"4974ae97-9b1d-4274-8d0b-0ad245a87e78","Type":"ContainerStarted","Data":"1a78f25ad6e9e21f3f8e8f3aa6d2e89db0d51354c84cf8b54a5704da5393448b"} Jun 11 10:07:28.225891 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:28.225864 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77888dc649-wh8qm" Jun 11 10:07:28.284798 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:28.284771 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:07:28.286225 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:28.286204 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:07:28.292051 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:28.292034 2575 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 10:07:29.811658 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.811618 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd4c5bfdb-k6dcn"] Jun 11 10:07:29.815107 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.815087 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:29.819465 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.819439 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 10:07:29.819575 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.819506 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 10:07:29.819575 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.819530 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 10:07:29.819575 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.819546 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 10:07:29.819575 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.819512 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8rmzh\"" Jun 11 10:07:29.819849 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.819576 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 10:07:29.819849 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.819746 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 10:07:29.819849 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.819775 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 10:07:29.826726 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.826703 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd4c5bfdb-k6dcn"] Jun 11 10:07:29.933964 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.933921 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-config\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:29.933964 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.933966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-oauth-config\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:29.934210 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.934046 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-oauth-serving-cert\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:29.934210 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.934072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-service-ca\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:29.934210 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.934186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2btt\" (UniqueName: \"kubernetes.io/projected/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-kube-api-access-t2btt\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:29.934312 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:29.934220 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-serving-cert\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.034916 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.034873 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2btt\" (UniqueName: \"kubernetes.io/projected/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-kube-api-access-t2btt\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.035110 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.034927 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-serving-cert\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.035110 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.034965 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-config\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.035110 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.034990 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-oauth-config\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.035110 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.035023 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-oauth-serving-cert\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.035110 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.035081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-service-ca\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.035770 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.035743 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-config\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.035899 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.035881 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-oauth-serving-cert\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.035971 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.035881 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-service-ca\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.037454 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.037425 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-oauth-config\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.037551 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.037434 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-serving-cert\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.043012 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.042986 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2btt\" (UniqueName: \"kubernetes.io/projected/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-kube-api-access-t2btt\") pod \"console-7bd4c5bfdb-k6dcn\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.124438 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.124344 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:30.249848 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.249813 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd4c5bfdb-k6dcn"] Jun 11 10:07:30.252908 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:07:30.252868 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6e9b2d_fbf4_45c3_bc3a_a6abcd47ec6b.slice/crio-e34bb9681e3d2dbcd749941530a8105e2af3e292d6ef69dbd9540a5ca3f92319 WatchSource:0}: Error finding container e34bb9681e3d2dbcd749941530a8105e2af3e292d6ef69dbd9540a5ca3f92319: Status 404 returned error can't find the container with id e34bb9681e3d2dbcd749941530a8105e2af3e292d6ef69dbd9540a5ca3f92319 Jun 11 10:07:30.254928 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.254912 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 10:07:30.343667 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:30.343634 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd4c5bfdb-k6dcn" event={"ID":"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b","Type":"ContainerStarted","Data":"e34bb9681e3d2dbcd749941530a8105e2af3e292d6ef69dbd9540a5ca3f92319"} Jun 11 10:07:35.337532 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:35.337497 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:07:35.362572 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:35.362540 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd4c5bfdb-k6dcn" event={"ID":"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b","Type":"ContainerStarted","Data":"ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e"} Jun 11 10:07:35.381849 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:35.381795 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bd4c5bfdb-k6dcn" podStartSLOduration=2.289481365 podStartE2EDuration="6.381780997s" totalImagesPullingTime="4.092299632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:07:35.381707162 +0000 UTC m=+307.543004220" watchObservedRunningTime="2026-06-11 10:07:35.381780997 +0000 UTC m=+307.543078131" Jun 11 10:07:39.402719 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.402682 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6df567bdfc-6k9tp"] Jun 11 10:07:39.406345 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.406323 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.416013 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.415989 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 10:07:39.421053 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.421030 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df567bdfc-6k9tp"] Jun 11 10:07:39.521333 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.521291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-trusted-ca-bundle\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.521333 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.521337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-service-ca\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.521559 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.521359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2qp6\" (UniqueName: \"kubernetes.io/projected/3bb82d22-046d-4061-be27-5f6e6351cbb2-kube-api-access-w2qp6\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.521559 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.521405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-serving-cert\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.521559 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.521442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-oauth-config\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.521559 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.521497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-config\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.521559 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.521540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-oauth-serving-cert\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.622297 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.622256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-oauth-config\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.622504 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.622317 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-config\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.622504 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.622345 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-oauth-serving-cert\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.622504 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.622364 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-trusted-ca-bundle\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.622504 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.622383 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-service-ca\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.622504 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.622400 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qp6\" (UniqueName: \"kubernetes.io/projected/3bb82d22-046d-4061-be27-5f6e6351cbb2-kube-api-access-w2qp6\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.622504 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.622433 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-serving-cert\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.623194 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.623169 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-service-ca\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.623336 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.623243 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-config\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.623336 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.623326 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-oauth-serving-cert\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.623561 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.623541 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-trusted-ca-bundle\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.624899 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.624874 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-serving-cert\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.624989 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.624968 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-oauth-config\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.634588 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.634569 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2qp6\" (UniqueName: \"kubernetes.io/projected/3bb82d22-046d-4061-be27-5f6e6351cbb2-kube-api-access-w2qp6\") pod \"console-6df567bdfc-6k9tp\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.715264 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.715234 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:39.837681 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:39.837653 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df567bdfc-6k9tp"] Jun 11 10:07:39.841293 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:07:39.841261 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb82d22_046d_4061_be27_5f6e6351cbb2.slice/crio-7b809ee7a2e0714fdc5bc1ac27c4a9779fe21d208f01abf5c02b1da5802e57a2 WatchSource:0}: Error finding container 7b809ee7a2e0714fdc5bc1ac27c4a9779fe21d208f01abf5c02b1da5802e57a2: Status 404 returned error can't find the container with id 7b809ee7a2e0714fdc5bc1ac27c4a9779fe21d208f01abf5c02b1da5802e57a2 Jun 11 10:07:40.124931 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:40.124837 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:40.124931 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:40.124902 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:40.129550 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:40.129528 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:40.379819 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:40.379727 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df567bdfc-6k9tp" event={"ID":"3bb82d22-046d-4061-be27-5f6e6351cbb2","Type":"ContainerStarted","Data":"b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db"} Jun 11 10:07:40.379819 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:40.379771 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df567bdfc-6k9tp" event={"ID":"3bb82d22-046d-4061-be27-5f6e6351cbb2","Type":"ContainerStarted","Data":"7b809ee7a2e0714fdc5bc1ac27c4a9779fe21d208f01abf5c02b1da5802e57a2"} Jun 11 10:07:40.383703 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:40.383683 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:07:40.397791 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:40.397750 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6df567bdfc-6k9tp" podStartSLOduration=1.397735558 podStartE2EDuration="1.397735558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:07:40.397273716 +0000 UTC m=+312.558570775" watchObservedRunningTime="2026-06-11 10:07:40.397735558 +0000 UTC m=+312.559032616" Jun 11 10:07:49.715856 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:49.715798 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:49.716303 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:49.715895 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:49.720631 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:49.720605 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:50.418762 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:50.418733 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:07:50.462981 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:50.462951 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd4c5bfdb-k6dcn"] Jun 11 10:07:59.443835 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:59.443798 2575 generic.go:356] "Generic (PLEG): container finished" podID="9bc30512-30a4-4fa1-bc86-fa38bac28aca" containerID="531865154dcdc9de0673962accc1d3164698ac7e61a73da312b9962e4e1b3a89" exitCode=0 Jun 11 10:07:59.444238 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:59.443859 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" event={"ID":"9bc30512-30a4-4fa1-bc86-fa38bac28aca","Type":"ContainerDied","Data":"531865154dcdc9de0673962accc1d3164698ac7e61a73da312b9962e4e1b3a89"} Jun 11 10:07:59.444238 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:07:59.444199 2575 scope.go:117] "RemoveContainer" containerID="531865154dcdc9de0673962accc1d3164698ac7e61a73da312b9962e4e1b3a89" Jun 11 10:08:00.449279 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:00.449241 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znjch" event={"ID":"9bc30512-30a4-4fa1-bc86-fa38bac28aca","Type":"ContainerStarted","Data":"4a94bc9c31f36bfccbbb66b02608f5eb02f3dbfbeb68553245fa594deaa8b02c"} Jun 11 10:08:15.482896 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.482801 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bd4c5bfdb-k6dcn" podUID="df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b" containerName="console" containerID="cri-o://ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e" gracePeriod=15 Jun 11 10:08:15.717620 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.717596 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:08:15.808767 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.808670 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-serving-cert\") pod \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " Jun 11 10:08:15.808767 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.808718 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-service-ca\") pod \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " Jun 11 10:08:15.808993 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.808807 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2btt\" (UniqueName: \"kubernetes.io/projected/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-kube-api-access-t2btt\") pod \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " Jun 11 10:08:15.808993 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.808834 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-oauth-serving-cert\") pod \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " Jun 11 10:08:15.808993 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.808858 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-oauth-config\") pod \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " Jun 11 10:08:15.808993 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.808889 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-config\") pod \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\" (UID: \"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b\") " Jun 11 10:08:15.810587 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.810217 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b" (UID: "df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:08:15.810587 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.810401 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-oauth-serving-cert\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:08:15.811300 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.811154 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-config" (OuterVolumeSpecName: "console-config") pod "df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b" (UID: "df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:08:15.811300 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.811271 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-service-ca" (OuterVolumeSpecName: "service-ca") pod "df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b" (UID: "df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:08:15.813163 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.811866 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-kube-api-access-t2btt" (OuterVolumeSpecName: "kube-api-access-t2btt") pod "df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b" (UID: "df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b"). InnerVolumeSpecName "kube-api-access-t2btt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:08:15.813163 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.811945 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b" (UID: "df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:08:15.814771 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.813544 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b" (UID: "df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:08:15.911788 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.911739 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2btt\" (UniqueName: \"kubernetes.io/projected/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-kube-api-access-t2btt\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:08:15.911788 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.911779 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-oauth-config\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:08:15.911788 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.911791 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-config\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:08:15.912041 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.911803 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-console-serving-cert\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:08:15.912041 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:15.911816 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b-service-ca\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:08:16.503656 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:16.503622 2575 generic.go:356] "Generic (PLEG): container finished" podID="df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b" containerID="ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e" exitCode=0 Jun 11 10:08:16.504210 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:16.503676 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd4c5bfdb-k6dcn" Jun 11 10:08:16.504210 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:16.503707 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd4c5bfdb-k6dcn" event={"ID":"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b","Type":"ContainerDied","Data":"ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e"} Jun 11 10:08:16.504210 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:16.503766 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd4c5bfdb-k6dcn" event={"ID":"df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b","Type":"ContainerDied","Data":"e34bb9681e3d2dbcd749941530a8105e2af3e292d6ef69dbd9540a5ca3f92319"} Jun 11 10:08:16.504210 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:16.503797 2575 scope.go:117] "RemoveContainer" containerID="ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e" Jun 11 10:08:16.511817 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:16.511800 2575 scope.go:117] "RemoveContainer" containerID="ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e" Jun 11 10:08:16.512075 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:08:16.512056 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e\": container with ID starting with ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e not found: ID does not exist" containerID="ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e" Jun 11 10:08:16.512163 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:16.512082 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e"} err="failed to get container status \"ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e\": rpc error: code = NotFound desc = could not find container \"ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e\": container with ID starting with ec61896a750cb041e1c9b2f5f36d32ff113c3bfa3681f577ade87f0b4c5e901e not found: ID does not exist" Jun 11 10:08:16.520589 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:16.520570 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd4c5bfdb-k6dcn"] Jun 11 10:08:16.523835 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:16.523814 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd4c5bfdb-k6dcn"] Jun 11 10:08:18.342086 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:18.342053 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b" path="/var/lib/kubelet/pods/df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b/volumes" Jun 11 10:08:41.314295 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:41.314258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:08:41.316506 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:41.316486 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b05be19-d3e1-4216-8727-bd84bf476b4b-metrics-certs\") pod \"network-metrics-daemon-mv8d6\" (UID: \"9b05be19-d3e1-4216-8727-bd84bf476b4b\") " pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:08:41.341668 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:41.341649 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fr8s2\"" Jun 11 10:08:41.348400 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:41.348380 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv8d6" Jun 11 10:08:41.470921 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:41.470895 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mv8d6"] Jun 11 10:08:41.473334 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:08:41.473302 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b05be19_d3e1_4216_8727_bd84bf476b4b.slice/crio-223a058d7eb3cbc5efb1fd7d9220eba9fa841a68e7c3d52a8c13c01790580842 WatchSource:0}: Error finding container 223a058d7eb3cbc5efb1fd7d9220eba9fa841a68e7c3d52a8c13c01790580842: Status 404 returned error can't find the container with id 223a058d7eb3cbc5efb1fd7d9220eba9fa841a68e7c3d52a8c13c01790580842 Jun 11 10:08:41.588807 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:41.588719 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mv8d6" event={"ID":"9b05be19-d3e1-4216-8727-bd84bf476b4b","Type":"ContainerStarted","Data":"223a058d7eb3cbc5efb1fd7d9220eba9fa841a68e7c3d52a8c13c01790580842"} Jun 11 10:08:42.042367 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.042336 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-758d75d7c4-bqmvt"] Jun 11 10:08:42.042695 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.042676 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b" containerName="console" Jun 11 10:08:42.042784 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.042697 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b" containerName="console" Jun 11 10:08:42.042784 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.042777 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="df6e9b2d-fbf4-45c3-bc3a-a6abcd47ec6b" containerName="console" Jun 11 10:08:42.045571 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.045551 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.057943 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.057922 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-758d75d7c4-bqmvt"] Jun 11 10:08:42.121075 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.121037 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-service-ca\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.121256 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.121097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d901d5c-4390-4077-8bbe-f36e99565f80-console-oauth-config\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.121256 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.121191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-trusted-ca-bundle\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.121256 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.121220 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-oauth-serving-cert\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.121256 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.121250 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d901d5c-4390-4077-8bbe-f36e99565f80-console-serving-cert\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.121448 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.121276 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plbgc\" (UniqueName: \"kubernetes.io/projected/0d901d5c-4390-4077-8bbe-f36e99565f80-kube-api-access-plbgc\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.121448 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.121398 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-console-config\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.222373 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.222327 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-service-ca\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.222552 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.222384 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d901d5c-4390-4077-8bbe-f36e99565f80-console-oauth-config\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.222552 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.222427 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-trusted-ca-bundle\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.222552 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.222453 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-oauth-serving-cert\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.222552 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.222486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d901d5c-4390-4077-8bbe-f36e99565f80-console-serving-cert\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.222552 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.222513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plbgc\" (UniqueName: \"kubernetes.io/projected/0d901d5c-4390-4077-8bbe-f36e99565f80-kube-api-access-plbgc\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.222814 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.222560 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-console-config\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.223213 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.223185 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-service-ca\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.223452 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.223429 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-oauth-serving-cert\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.223656 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.223634 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-trusted-ca-bundle\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.223734 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.223659 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-console-config\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.225190 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.225161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d901d5c-4390-4077-8bbe-f36e99565f80-console-oauth-config\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.225315 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.225296 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d901d5c-4390-4077-8bbe-f36e99565f80-console-serving-cert\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.231578 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.231553 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plbgc\" (UniqueName: \"kubernetes.io/projected/0d901d5c-4390-4077-8bbe-f36e99565f80-kube-api-access-plbgc\") pod \"console-758d75d7c4-bqmvt\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.356101 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.356078 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:42.500771 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.500746 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-758d75d7c4-bqmvt"] Jun 11 10:08:42.502946 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:08:42.502926 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d901d5c_4390_4077_8bbe_f36e99565f80.slice/crio-9a99311643da8c1de643f6a9b0da64740b19821ff3a35272d996a92d4e3c9bb9 WatchSource:0}: Error finding container 9a99311643da8c1de643f6a9b0da64740b19821ff3a35272d996a92d4e3c9bb9: Status 404 returned error can't find the container with id 9a99311643da8c1de643f6a9b0da64740b19821ff3a35272d996a92d4e3c9bb9 Jun 11 10:08:42.594929 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.594885 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758d75d7c4-bqmvt" event={"ID":"0d901d5c-4390-4077-8bbe-f36e99565f80","Type":"ContainerStarted","Data":"18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314"} Jun 11 10:08:42.595107 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.594957 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758d75d7c4-bqmvt" event={"ID":"0d901d5c-4390-4077-8bbe-f36e99565f80","Type":"ContainerStarted","Data":"9a99311643da8c1de643f6a9b0da64740b19821ff3a35272d996a92d4e3c9bb9"} Jun 11 10:08:42.596796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.596772 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mv8d6" event={"ID":"9b05be19-d3e1-4216-8727-bd84bf476b4b","Type":"ContainerStarted","Data":"848155e051fd541c30f85feecd32c56bfd3240da9edfcb250e9f8ea28a61be10"} Jun 11 10:08:42.596891 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.596819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mv8d6" event={"ID":"9b05be19-d3e1-4216-8727-bd84bf476b4b","Type":"ContainerStarted","Data":"9fd028b0ecb7f5c68d4b31c98be3a3c6f817297dadfb34a6f97cff571768375a"} Jun 11 10:08:42.612389 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.612196 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-758d75d7c4-bqmvt" podStartSLOduration=0.61217634 podStartE2EDuration="612.17634ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:08:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:08:42.612133388 +0000 UTC m=+374.773430438" watchObservedRunningTime="2026-06-11 10:08:42.61217634 +0000 UTC m=+374.773473401" Jun 11 10:08:42.627009 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:42.626963 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mv8d6" podStartSLOduration=373.788940251 podStartE2EDuration="6m14.626947591s" totalImagesPullingTime="838.00734ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:08:42.62669588 +0000 UTC m=+374.787992948" watchObservedRunningTime="2026-06-11 10:08:42.626947591 +0000 UTC m=+374.788244651" Jun 11 10:08:52.356370 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:52.356335 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:52.356848 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:52.356394 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:52.360994 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:52.360969 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:52.634964 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:52.634881 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:08:52.682799 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:08:52.682769 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df567bdfc-6k9tp"] Jun 11 10:09:17.708395 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:17.708352 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6df567bdfc-6k9tp" podUID="3bb82d22-046d-4061-be27-5f6e6351cbb2" containerName="console" containerID="cri-o://b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db" gracePeriod=15 Jun 11 10:09:17.944549 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:17.944523 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:09:18.090039 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.089948 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-config\") pod \"3bb82d22-046d-4061-be27-5f6e6351cbb2\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " Jun 11 10:09:18.090039 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.089995 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-oauth-config\") pod \"3bb82d22-046d-4061-be27-5f6e6351cbb2\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " Jun 11 10:09:18.090039 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.090021 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-oauth-serving-cert\") pod \"3bb82d22-046d-4061-be27-5f6e6351cbb2\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " Jun 11 10:09:18.090339 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.090185 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2qp6\" (UniqueName: \"kubernetes.io/projected/3bb82d22-046d-4061-be27-5f6e6351cbb2-kube-api-access-w2qp6\") pod \"3bb82d22-046d-4061-be27-5f6e6351cbb2\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " Jun 11 10:09:18.090339 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.090233 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-serving-cert\") pod \"3bb82d22-046d-4061-be27-5f6e6351cbb2\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " Jun 11 10:09:18.090339 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.090309 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-service-ca\") pod \"3bb82d22-046d-4061-be27-5f6e6351cbb2\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " Jun 11 10:09:18.090339 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.090330 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-trusted-ca-bundle\") pod \"3bb82d22-046d-4061-be27-5f6e6351cbb2\" (UID: \"3bb82d22-046d-4061-be27-5f6e6351cbb2\") " Jun 11 10:09:18.090547 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.090335 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-config" (OuterVolumeSpecName: "console-config") pod "3bb82d22-046d-4061-be27-5f6e6351cbb2" (UID: "3bb82d22-046d-4061-be27-5f6e6351cbb2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:09:18.090547 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.090424 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3bb82d22-046d-4061-be27-5f6e6351cbb2" (UID: "3bb82d22-046d-4061-be27-5f6e6351cbb2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:09:18.090690 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.090671 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-config\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:09:18.090735 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.090696 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-oauth-serving-cert\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:09:18.090735 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.090687 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-service-ca" (OuterVolumeSpecName: "service-ca") pod "3bb82d22-046d-4061-be27-5f6e6351cbb2" (UID: "3bb82d22-046d-4061-be27-5f6e6351cbb2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:09:18.090735 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.090712 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3bb82d22-046d-4061-be27-5f6e6351cbb2" (UID: "3bb82d22-046d-4061-be27-5f6e6351cbb2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:09:18.092278 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.092244 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3bb82d22-046d-4061-be27-5f6e6351cbb2" (UID: "3bb82d22-046d-4061-be27-5f6e6351cbb2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:09:18.092278 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.092269 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3bb82d22-046d-4061-be27-5f6e6351cbb2" (UID: "3bb82d22-046d-4061-be27-5f6e6351cbb2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:09:18.092425 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.092290 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bb82d22-046d-4061-be27-5f6e6351cbb2-kube-api-access-w2qp6" (OuterVolumeSpecName: "kube-api-access-w2qp6") pod "3bb82d22-046d-4061-be27-5f6e6351cbb2" (UID: "3bb82d22-046d-4061-be27-5f6e6351cbb2"). InnerVolumeSpecName "kube-api-access-w2qp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:09:18.191406 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.191352 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2qp6\" (UniqueName: \"kubernetes.io/projected/3bb82d22-046d-4061-be27-5f6e6351cbb2-kube-api-access-w2qp6\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:09:18.191406 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.191399 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-serving-cert\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:09:18.191406 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.191409 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-service-ca\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:09:18.191406 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.191420 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bb82d22-046d-4061-be27-5f6e6351cbb2-trusted-ca-bundle\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:09:18.191406 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.191429 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bb82d22-046d-4061-be27-5f6e6351cbb2-console-oauth-config\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:09:18.721130 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.721078 2575 generic.go:356] "Generic (PLEG): container finished" podID="3bb82d22-046d-4061-be27-5f6e6351cbb2" containerID="b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db" exitCode=0 Jun 11 10:09:18.721603 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.721159 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df567bdfc-6k9tp" event={"ID":"3bb82d22-046d-4061-be27-5f6e6351cbb2","Type":"ContainerDied","Data":"b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db"} Jun 11 10:09:18.721603 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.721222 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df567bdfc-6k9tp" event={"ID":"3bb82d22-046d-4061-be27-5f6e6351cbb2","Type":"ContainerDied","Data":"7b809ee7a2e0714fdc5bc1ac27c4a9779fe21d208f01abf5c02b1da5802e57a2"} Jun 11 10:09:18.721603 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.721159 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df567bdfc-6k9tp" Jun 11 10:09:18.721603 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.721242 2575 scope.go:117] "RemoveContainer" containerID="b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db" Jun 11 10:09:18.731847 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.731825 2575 scope.go:117] "RemoveContainer" containerID="b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db" Jun 11 10:09:18.732105 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:09:18.732085 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db\": container with ID starting with b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db not found: ID does not exist" containerID="b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db" Jun 11 10:09:18.732184 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.732129 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db"} err="failed to get container status \"b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db\": rpc error: code = NotFound desc = could not find container \"b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db\": container with ID starting with b383978cd4a683d6a971495258a97c1a89469fafecb32dd096661e654bd5f4db not found: ID does not exist" Jun 11 10:09:18.739437 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.739403 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df567bdfc-6k9tp"] Jun 11 10:09:18.749359 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:18.749334 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6df567bdfc-6k9tp"] Jun 11 10:09:20.342500 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:09:20.342465 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bb82d22-046d-4061-be27-5f6e6351cbb2" path="/var/lib/kubelet/pods/3bb82d22-046d-4061-be27-5f6e6351cbb2/volumes" Jun 11 10:10:03.215112 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.215067 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dfd67b97-lw6j6"] Jun 11 10:10:03.215628 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.215415 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bb82d22-046d-4061-be27-5f6e6351cbb2" containerName="console" Jun 11 10:10:03.215628 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.215430 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bb82d22-046d-4061-be27-5f6e6351cbb2" containerName="console" Jun 11 10:10:03.215628 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.215472 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bb82d22-046d-4061-be27-5f6e6351cbb2" containerName="console" Jun 11 10:10:03.218335 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.218318 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.230176 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.230151 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dfd67b97-lw6j6"] Jun 11 10:10:03.329326 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.329280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-oauth-serving-cert\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.329326 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.329328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-serving-cert\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.329562 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.329376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thbc9\" (UniqueName: \"kubernetes.io/projected/57f28e74-16b7-4409-86fb-25273a1f0c3a-kube-api-access-thbc9\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.329562 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.329415 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-oauth-config\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.329562 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.329451 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-trusted-ca-bundle\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.329562 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.329466 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-service-ca\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.329562 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.329519 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-config\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.430157 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.430100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thbc9\" (UniqueName: \"kubernetes.io/projected/57f28e74-16b7-4409-86fb-25273a1f0c3a-kube-api-access-thbc9\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.430356 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.430170 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-oauth-config\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.430356 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.430216 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-trusted-ca-bundle\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.430356 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.430237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-service-ca\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.430356 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.430273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-config\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.430356 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.430305 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-oauth-serving-cert\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.430356 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.430339 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-serving-cert\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.431058 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.431030 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-config\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.431225 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.431198 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-oauth-serving-cert\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.431272 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.431259 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-service-ca\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.431307 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.431281 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-trusted-ca-bundle\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.432735 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.432704 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-oauth-config\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.432897 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.432878 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-serving-cert\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.438685 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.438657 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thbc9\" (UniqueName: \"kubernetes.io/projected/57f28e74-16b7-4409-86fb-25273a1f0c3a-kube-api-access-thbc9\") pod \"console-7dfd67b97-lw6j6\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.527723 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.527624 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:03.659631 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.659596 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dfd67b97-lw6j6"] Jun 11 10:10:03.662678 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:10:03.662652 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f28e74_16b7_4409_86fb_25273a1f0c3a.slice/crio-182ee4c86784e07e9dd256bec0f0453509cf649deff6206e0cacac40b10b1572 WatchSource:0}: Error finding container 182ee4c86784e07e9dd256bec0f0453509cf649deff6206e0cacac40b10b1572: Status 404 returned error can't find the container with id 182ee4c86784e07e9dd256bec0f0453509cf649deff6206e0cacac40b10b1572 Jun 11 10:10:03.873098 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.872999 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dfd67b97-lw6j6" event={"ID":"57f28e74-16b7-4409-86fb-25273a1f0c3a","Type":"ContainerStarted","Data":"c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa"} Jun 11 10:10:03.873098 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.873051 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dfd67b97-lw6j6" event={"ID":"57f28e74-16b7-4409-86fb-25273a1f0c3a","Type":"ContainerStarted","Data":"182ee4c86784e07e9dd256bec0f0453509cf649deff6206e0cacac40b10b1572"} Jun 11 10:10:03.890757 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:03.890702 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dfd67b97-lw6j6" podStartSLOduration=0.89068578 podStartE2EDuration="890.68578ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:10:03.890204703 +0000 UTC m=+456.051501774" watchObservedRunningTime="2026-06-11 10:10:03.89068578 +0000 UTC m=+456.051982838" Jun 11 10:10:13.528555 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:13.528511 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:13.529065 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:13.528577 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:13.533421 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:13.533400 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:13.912811 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:13.912731 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:10:13.963694 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:13.963665 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-758d75d7c4-bqmvt"] Jun 11 10:10:38.984932 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:38.984877 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-758d75d7c4-bqmvt" podUID="0d901d5c-4390-4077-8bbe-f36e99565f80" containerName="console" containerID="cri-o://18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314" gracePeriod=15 Jun 11 10:10:39.224267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.224243 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:10:39.295898 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.295805 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d901d5c-4390-4077-8bbe-f36e99565f80-console-serving-cert\") pod \"0d901d5c-4390-4077-8bbe-f36e99565f80\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " Jun 11 10:10:39.295898 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.295847 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-trusted-ca-bundle\") pod \"0d901d5c-4390-4077-8bbe-f36e99565f80\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " Jun 11 10:10:39.295898 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.295864 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-console-config\") pod \"0d901d5c-4390-4077-8bbe-f36e99565f80\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " Jun 11 10:10:39.295898 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.295895 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d901d5c-4390-4077-8bbe-f36e99565f80-console-oauth-config\") pod \"0d901d5c-4390-4077-8bbe-f36e99565f80\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " Jun 11 10:10:39.296337 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.295939 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-oauth-serving-cert\") pod \"0d901d5c-4390-4077-8bbe-f36e99565f80\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " Jun 11 10:10:39.296337 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.295957 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-service-ca\") pod \"0d901d5c-4390-4077-8bbe-f36e99565f80\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " Jun 11 10:10:39.296337 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.295984 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plbgc\" (UniqueName: \"kubernetes.io/projected/0d901d5c-4390-4077-8bbe-f36e99565f80-kube-api-access-plbgc\") pod \"0d901d5c-4390-4077-8bbe-f36e99565f80\" (UID: \"0d901d5c-4390-4077-8bbe-f36e99565f80\") " Jun 11 10:10:39.296464 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.296365 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-console-config" (OuterVolumeSpecName: "console-config") pod "0d901d5c-4390-4077-8bbe-f36e99565f80" (UID: "0d901d5c-4390-4077-8bbe-f36e99565f80"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:10:39.296526 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.296497 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0d901d5c-4390-4077-8bbe-f36e99565f80" (UID: "0d901d5c-4390-4077-8bbe-f36e99565f80"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:10:39.296581 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.296518 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0d901d5c-4390-4077-8bbe-f36e99565f80" (UID: "0d901d5c-4390-4077-8bbe-f36e99565f80"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:10:39.296581 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.296569 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-service-ca" (OuterVolumeSpecName: "service-ca") pod "0d901d5c-4390-4077-8bbe-f36e99565f80" (UID: "0d901d5c-4390-4077-8bbe-f36e99565f80"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:10:39.298157 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.298132 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d901d5c-4390-4077-8bbe-f36e99565f80-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0d901d5c-4390-4077-8bbe-f36e99565f80" (UID: "0d901d5c-4390-4077-8bbe-f36e99565f80"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:10:39.298252 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.298188 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d901d5c-4390-4077-8bbe-f36e99565f80-kube-api-access-plbgc" (OuterVolumeSpecName: "kube-api-access-plbgc") pod "0d901d5c-4390-4077-8bbe-f36e99565f80" (UID: "0d901d5c-4390-4077-8bbe-f36e99565f80"). InnerVolumeSpecName "kube-api-access-plbgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:10:39.298252 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.298223 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d901d5c-4390-4077-8bbe-f36e99565f80-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0d901d5c-4390-4077-8bbe-f36e99565f80" (UID: "0d901d5c-4390-4077-8bbe-f36e99565f80"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:10:39.397439 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.397397 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d901d5c-4390-4077-8bbe-f36e99565f80-console-serving-cert\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:10:39.397439 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.397436 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-trusted-ca-bundle\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:10:39.397439 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.397446 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-console-config\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:10:39.397439 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.397454 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d901d5c-4390-4077-8bbe-f36e99565f80-console-oauth-config\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:10:39.397676 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.397462 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-oauth-serving-cert\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:10:39.397676 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.397470 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d901d5c-4390-4077-8bbe-f36e99565f80-service-ca\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:10:39.397676 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.397478 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plbgc\" (UniqueName: \"kubernetes.io/projected/0d901d5c-4390-4077-8bbe-f36e99565f80-kube-api-access-plbgc\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:10:39.997903 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.997863 2575 generic.go:356] "Generic (PLEG): container finished" podID="0d901d5c-4390-4077-8bbe-f36e99565f80" containerID="18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314" exitCode=0 Jun 11 10:10:39.998341 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.997913 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758d75d7c4-bqmvt" Jun 11 10:10:39.998341 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.997949 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758d75d7c4-bqmvt" event={"ID":"0d901d5c-4390-4077-8bbe-f36e99565f80","Type":"ContainerDied","Data":"18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314"} Jun 11 10:10:39.998341 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.998006 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758d75d7c4-bqmvt" event={"ID":"0d901d5c-4390-4077-8bbe-f36e99565f80","Type":"ContainerDied","Data":"9a99311643da8c1de643f6a9b0da64740b19821ff3a35272d996a92d4e3c9bb9"} Jun 11 10:10:39.998341 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:39.998026 2575 scope.go:117] "RemoveContainer" containerID="18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314" Jun 11 10:10:40.005998 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:40.005981 2575 scope.go:117] "RemoveContainer" containerID="18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314" Jun 11 10:10:40.006303 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:10:40.006285 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314\": container with ID starting with 18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314 not found: ID does not exist" containerID="18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314" Jun 11 10:10:40.006351 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:40.006311 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314"} err="failed to get container status \"18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314\": rpc error: code = NotFound desc = could not find container \"18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314\": container with ID starting with 18b903ecb617c9bca7aa5f7bc50d08e94e88d6de33467db2cd04b3edf6e8c314 not found: ID does not exist" Jun 11 10:10:40.019452 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:40.019424 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-758d75d7c4-bqmvt"] Jun 11 10:10:40.022793 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:40.022773 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-758d75d7c4-bqmvt"] Jun 11 10:10:40.345283 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:10:40.342758 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d901d5c-4390-4077-8bbe-f36e99565f80" path="/var/lib/kubelet/pods/0d901d5c-4390-4077-8bbe-f36e99565f80/volumes" Jun 11 10:11:43.427340 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.427303 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9"] Jun 11 10:11:43.427854 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.427643 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d901d5c-4390-4077-8bbe-f36e99565f80" containerName="console" Jun 11 10:11:43.427854 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.427660 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d901d5c-4390-4077-8bbe-f36e99565f80" containerName="console" Jun 11 10:11:43.427854 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.427738 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d901d5c-4390-4077-8bbe-f36e99565f80" containerName="console" Jun 11 10:11:43.430476 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.430456 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9" Jun 11 10:11:43.433363 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.433344 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 10:11:43.434698 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.434676 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-67r8g\"" Jun 11 10:11:43.434698 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.434686 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 10:11:43.439464 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.439443 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9"] Jun 11 10:11:43.457018 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.456983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77tsk\" (UniqueName: \"kubernetes.io/projected/ba83833c-3d65-4e0b-af4c-cf26d7c89e0f-kube-api-access-77tsk\") pod \"cert-manager-cainjector-5d99449ffd-jdcl9\" (UID: \"ba83833c-3d65-4e0b-af4c-cf26d7c89e0f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9" Jun 11 10:11:43.457167 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.457111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba83833c-3d65-4e0b-af4c-cf26d7c89e0f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-jdcl9\" (UID: \"ba83833c-3d65-4e0b-af4c-cf26d7c89e0f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9" Jun 11 10:11:43.558110 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.558066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77tsk\" (UniqueName: \"kubernetes.io/projected/ba83833c-3d65-4e0b-af4c-cf26d7c89e0f-kube-api-access-77tsk\") pod \"cert-manager-cainjector-5d99449ffd-jdcl9\" (UID: \"ba83833c-3d65-4e0b-af4c-cf26d7c89e0f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9" Jun 11 10:11:43.558274 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.558174 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba83833c-3d65-4e0b-af4c-cf26d7c89e0f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-jdcl9\" (UID: \"ba83833c-3d65-4e0b-af4c-cf26d7c89e0f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9" Jun 11 10:11:43.566529 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.566499 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba83833c-3d65-4e0b-af4c-cf26d7c89e0f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-jdcl9\" (UID: \"ba83833c-3d65-4e0b-af4c-cf26d7c89e0f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9" Jun 11 10:11:43.566641 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.566581 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77tsk\" (UniqueName: \"kubernetes.io/projected/ba83833c-3d65-4e0b-af4c-cf26d7c89e0f-kube-api-access-77tsk\") pod \"cert-manager-cainjector-5d99449ffd-jdcl9\" (UID: \"ba83833c-3d65-4e0b-af4c-cf26d7c89e0f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9" Jun 11 10:11:43.738751 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.738722 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9" Jun 11 10:11:43.861500 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:43.861468 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9"] Jun 11 10:11:43.864548 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:11:43.864523 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba83833c_3d65_4e0b_af4c_cf26d7c89e0f.slice/crio-3e445ecaa1097c301ada897ba4b6de5bb0ab4c63d6a21fb865f86f69e1d0a06f WatchSource:0}: Error finding container 3e445ecaa1097c301ada897ba4b6de5bb0ab4c63d6a21fb865f86f69e1d0a06f: Status 404 returned error can't find the container with id 3e445ecaa1097c301ada897ba4b6de5bb0ab4c63d6a21fb865f86f69e1d0a06f Jun 11 10:11:44.210238 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:44.210203 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9" event={"ID":"ba83833c-3d65-4e0b-af4c-cf26d7c89e0f","Type":"ContainerStarted","Data":"3e445ecaa1097c301ada897ba4b6de5bb0ab4c63d6a21fb865f86f69e1d0a06f"} Jun 11 10:11:48.226358 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:48.226322 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9" event={"ID":"ba83833c-3d65-4e0b-af4c-cf26d7c89e0f","Type":"ContainerStarted","Data":"baa3e834c9abb05161753cf49128335a56fd7b21745646193692f44bdd6825cb"} Jun 11 10:11:48.243529 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:48.243483 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jdcl9" podStartSLOduration=1.457565974 podStartE2EDuration="5.243468529s" totalImagesPullingTime="3.785902555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:11:48.242517585 +0000 UTC m=+560.403814643" watchObservedRunningTime="2026-06-11 10:11:48.243468529 +0000 UTC m=+560.404765587" Jun 11 10:11:55.975016 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:55.974973 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-mzp7z"] Jun 11 10:11:55.977987 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:55.977966 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-mzp7z" Jun 11 10:11:55.980750 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:55.980730 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hr7m9\"" Jun 11 10:11:55.988355 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:55.988331 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-mzp7z"] Jun 11 10:11:56.051158 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:56.051100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71-bound-sa-token\") pod \"cert-manager-59c77684cc-mzp7z\" (UID: \"a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71\") " pod="cert-manager/cert-manager-59c77684cc-mzp7z" Jun 11 10:11:56.051158 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:56.051157 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grzgq\" (UniqueName: \"kubernetes.io/projected/a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71-kube-api-access-grzgq\") pod \"cert-manager-59c77684cc-mzp7z\" (UID: \"a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71\") " pod="cert-manager/cert-manager-59c77684cc-mzp7z" Jun 11 10:11:56.152318 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:56.152284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71-bound-sa-token\") pod \"cert-manager-59c77684cc-mzp7z\" (UID: \"a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71\") " pod="cert-manager/cert-manager-59c77684cc-mzp7z" Jun 11 10:11:56.152318 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:56.152323 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grzgq\" (UniqueName: \"kubernetes.io/projected/a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71-kube-api-access-grzgq\") pod \"cert-manager-59c77684cc-mzp7z\" (UID: \"a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71\") " pod="cert-manager/cert-manager-59c77684cc-mzp7z" Jun 11 10:11:56.160370 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:56.160343 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71-bound-sa-token\") pod \"cert-manager-59c77684cc-mzp7z\" (UID: \"a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71\") " pod="cert-manager/cert-manager-59c77684cc-mzp7z" Jun 11 10:11:56.160487 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:56.160437 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grzgq\" (UniqueName: \"kubernetes.io/projected/a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71-kube-api-access-grzgq\") pod \"cert-manager-59c77684cc-mzp7z\" (UID: \"a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71\") " pod="cert-manager/cert-manager-59c77684cc-mzp7z" Jun 11 10:11:56.286956 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:56.286830 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-mzp7z" Jun 11 10:11:56.412893 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:56.412816 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-mzp7z"] Jun 11 10:11:56.415262 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:11:56.415233 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda21bb7c4_f0ec_4649_9ff9_3d8ce8500d71.slice/crio-3ee2e416ffbcce83cfc9895f5de428ffa50cd98f3f2a1979c222a11600f8e292 WatchSource:0}: Error finding container 3ee2e416ffbcce83cfc9895f5de428ffa50cd98f3f2a1979c222a11600f8e292: Status 404 returned error can't find the container with id 3ee2e416ffbcce83cfc9895f5de428ffa50cd98f3f2a1979c222a11600f8e292 Jun 11 10:11:57.257105 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:57.257065 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-mzp7z" event={"ID":"a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71","Type":"ContainerStarted","Data":"45470b152f6814844e8c90bfe4b9d69bbb50e40b49569e3d1d2fb165dd995a65"} Jun 11 10:11:57.257515 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:57.257135 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-mzp7z" event={"ID":"a21bb7c4-f0ec-4649-9ff9-3d8ce8500d71","Type":"ContainerStarted","Data":"3ee2e416ffbcce83cfc9895f5de428ffa50cd98f3f2a1979c222a11600f8e292"} Jun 11 10:11:57.275208 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:11:57.275164 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-mzp7z" podStartSLOduration=2.2751506040000002 podStartE2EDuration="2.275150604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:11:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:11:57.273223912 +0000 UTC m=+569.434520970" watchObservedRunningTime="2026-06-11 10:11:57.275150604 +0000 UTC m=+569.436447663" Jun 11 10:12:13.002454 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.002415 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq"] Jun 11 10:12:13.005685 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.005667 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.008931 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.008911 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 10:12:13.009050 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.008943 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 10:12:13.009377 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.009356 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 10:12:13.009503 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.009432 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dlmph\"" Jun 11 10:12:13.009503 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.009472 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 10:12:13.032073 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.032050 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq"] Jun 11 10:12:13.082267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.082235 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv2th\" (UniqueName: \"kubernetes.io/projected/55a4dc22-d33c-42a7-9b67-65a76cfa8439-kube-api-access-pv2th\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.082436 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.082286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55a4dc22-d33c-42a7-9b67-65a76cfa8439-tmp\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.082436 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.082318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55a4dc22-d33c-42a7-9b67-65a76cfa8439-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.082436 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.082360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55a4dc22-d33c-42a7-9b67-65a76cfa8439-webhook-cert\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.082436 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.082380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/55a4dc22-d33c-42a7-9b67-65a76cfa8439-manifests\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.183402 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.183368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/55a4dc22-d33c-42a7-9b67-65a76cfa8439-manifests\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.183589 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.183423 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv2th\" (UniqueName: \"kubernetes.io/projected/55a4dc22-d33c-42a7-9b67-65a76cfa8439-kube-api-access-pv2th\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.183589 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.183452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55a4dc22-d33c-42a7-9b67-65a76cfa8439-tmp\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.183589 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.183473 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55a4dc22-d33c-42a7-9b67-65a76cfa8439-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.183589 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.183497 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55a4dc22-d33c-42a7-9b67-65a76cfa8439-webhook-cert\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.183796 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.183748 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/55a4dc22-d33c-42a7-9b67-65a76cfa8439-manifests\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.185716 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.185694 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55a4dc22-d33c-42a7-9b67-65a76cfa8439-tmp\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.186060 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.186038 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55a4dc22-d33c-42a7-9b67-65a76cfa8439-webhook-cert\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.186104 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.186056 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55a4dc22-d33c-42a7-9b67-65a76cfa8439-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.194813 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.194785 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv2th\" (UniqueName: \"kubernetes.io/projected/55a4dc22-d33c-42a7-9b67-65a76cfa8439-kube-api-access-pv2th\") pod \"opendatahub-operator-controller-manager-85dd8cd87b-n2qxq\" (UID: \"55a4dc22-d33c-42a7-9b67-65a76cfa8439\") " pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.316672 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.316591 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:13.446990 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:13.446967 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq"] Jun 11 10:12:13.449494 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:12:13.449469 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a4dc22_d33c_42a7_9b67_65a76cfa8439.slice/crio-f22b22d10f0d3340df3fc4ee3480d48b714f717777007c688d985a0193ec4395 WatchSource:0}: Error finding container f22b22d10f0d3340df3fc4ee3480d48b714f717777007c688d985a0193ec4395: Status 404 returned error can't find the container with id f22b22d10f0d3340df3fc4ee3480d48b714f717777007c688d985a0193ec4395 Jun 11 10:12:14.318982 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:14.318942 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" event={"ID":"55a4dc22-d33c-42a7-9b67-65a76cfa8439","Type":"ContainerStarted","Data":"f22b22d10f0d3340df3fc4ee3480d48b714f717777007c688d985a0193ec4395"} Jun 11 10:12:17.336322 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:17.336279 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" event={"ID":"55a4dc22-d33c-42a7-9b67-65a76cfa8439","Type":"ContainerStarted","Data":"af0266f215716e72a20b519776db71621c1f479abbe596db253cd50606219d54"} Jun 11 10:12:18.341141 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:18.341088 2575 generic.go:356] "Generic (PLEG): container finished" podID="55a4dc22-d33c-42a7-9b67-65a76cfa8439" containerID="af0266f215716e72a20b519776db71621c1f479abbe596db253cd50606219d54" exitCode=0 Jun 11 10:12:18.342537 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:18.342347 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" event={"ID":"55a4dc22-d33c-42a7-9b67-65a76cfa8439","Type":"ContainerDied","Data":"af0266f215716e72a20b519776db71621c1f479abbe596db253cd50606219d54"} Jun 11 10:12:19.347596 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:19.347561 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" event={"ID":"55a4dc22-d33c-42a7-9b67-65a76cfa8439","Type":"ContainerStarted","Data":"3e819315e5a88ab4deae32d16500dc66f482a04d6e0abf12644d82b116eeda25"} Jun 11 10:12:19.348108 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:19.347678 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:19.372389 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:19.372333 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" podStartSLOduration=2.33762443 podStartE2EDuration="7.372315072s" totalImagesPullingTime="4.131233108s" totalInitContainerRuntime="903.457534ms" isStatefulPod=false podCreationTimestamp="2026-06-11 10:12:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:12:19.369958199 +0000 UTC m=+591.531255247" watchObservedRunningTime="2026-06-11 10:12:19.372315072 +0000 UTC m=+591.533612203" Jun 11 10:12:28.307172 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:28.307140 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:12:28.307804 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:28.307785 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:12:30.354560 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:30.354527 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85dd8cd87b-n2qxq" Jun 11 10:12:33.473939 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.473901 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hmhz6"] Jun 11 10:12:33.478494 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.478471 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" Jun 11 10:12:33.481312 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.481278 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 10:12:33.482310 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.482285 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mg74m\"" Jun 11 10:12:33.489540 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.489513 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hmhz6"] Jun 11 10:12:33.657914 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.657869 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvdfk\" (UniqueName: \"kubernetes.io/projected/1768cc13-8f35-45b7-a3a7-5460f257cc11-kube-api-access-nvdfk\") pod \"odh-model-controller-6dc94f689f-hmhz6\" (UID: \"1768cc13-8f35-45b7-a3a7-5460f257cc11\") " pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" Jun 11 10:12:33.658091 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.658001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1768cc13-8f35-45b7-a3a7-5460f257cc11-cert\") pod \"odh-model-controller-6dc94f689f-hmhz6\" (UID: \"1768cc13-8f35-45b7-a3a7-5460f257cc11\") " pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" Jun 11 10:12:33.758808 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.758715 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvdfk\" (UniqueName: \"kubernetes.io/projected/1768cc13-8f35-45b7-a3a7-5460f257cc11-kube-api-access-nvdfk\") pod \"odh-model-controller-6dc94f689f-hmhz6\" (UID: \"1768cc13-8f35-45b7-a3a7-5460f257cc11\") " pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" Jun 11 10:12:33.758980 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.758819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1768cc13-8f35-45b7-a3a7-5460f257cc11-cert\") pod \"odh-model-controller-6dc94f689f-hmhz6\" (UID: \"1768cc13-8f35-45b7-a3a7-5460f257cc11\") " pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" Jun 11 10:12:33.761265 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.761234 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1768cc13-8f35-45b7-a3a7-5460f257cc11-cert\") pod \"odh-model-controller-6dc94f689f-hmhz6\" (UID: \"1768cc13-8f35-45b7-a3a7-5460f257cc11\") " pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" Jun 11 10:12:33.771774 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.771745 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvdfk\" (UniqueName: \"kubernetes.io/projected/1768cc13-8f35-45b7-a3a7-5460f257cc11-kube-api-access-nvdfk\") pod \"odh-model-controller-6dc94f689f-hmhz6\" (UID: \"1768cc13-8f35-45b7-a3a7-5460f257cc11\") " pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" Jun 11 10:12:33.791416 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.791386 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" Jun 11 10:12:33.925516 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.925437 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hmhz6"] Jun 11 10:12:33.927665 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:12:33.927639 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1768cc13_8f35_45b7_a3a7_5460f257cc11.slice/crio-f85d7b7b4dd4cea93e4700ea655a244b17a2d5059940fa89c4998126f56cb3b1 WatchSource:0}: Error finding container f85d7b7b4dd4cea93e4700ea655a244b17a2d5059940fa89c4998126f56cb3b1: Status 404 returned error can't find the container with id f85d7b7b4dd4cea93e4700ea655a244b17a2d5059940fa89c4998126f56cb3b1 Jun 11 10:12:33.928914 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:33.928897 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 10:12:34.375848 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:34.375807 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sqlr4"] Jun 11 10:12:34.380445 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:34.380422 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" Jun 11 10:12:34.383687 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:34.383663 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-gnvpj\"" Jun 11 10:12:34.383820 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:34.383803 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 10:12:34.391383 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:34.391358 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sqlr4"] Jun 11 10:12:34.405692 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:34.405662 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" event={"ID":"1768cc13-8f35-45b7-a3a7-5460f257cc11","Type":"ContainerStarted","Data":"f85d7b7b4dd4cea93e4700ea655a244b17a2d5059940fa89c4998126f56cb3b1"} Jun 11 10:12:34.465069 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:34.465035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/101646e7-fa11-4695-b2a0-f8088d1e7d9c-tls-certs\") pod \"model-serving-api-5dd488fc48-sqlr4\" (UID: \"101646e7-fa11-4695-b2a0-f8088d1e7d9c\") " pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" Jun 11 10:12:34.465254 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:34.465088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjj9q\" (UniqueName: \"kubernetes.io/projected/101646e7-fa11-4695-b2a0-f8088d1e7d9c-kube-api-access-rjj9q\") pod \"model-serving-api-5dd488fc48-sqlr4\" (UID: \"101646e7-fa11-4695-b2a0-f8088d1e7d9c\") " pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" Jun 11 10:12:34.566372 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:34.566336 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/101646e7-fa11-4695-b2a0-f8088d1e7d9c-tls-certs\") pod \"model-serving-api-5dd488fc48-sqlr4\" (UID: \"101646e7-fa11-4695-b2a0-f8088d1e7d9c\") " pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" Jun 11 10:12:34.566855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:34.566392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjj9q\" (UniqueName: \"kubernetes.io/projected/101646e7-fa11-4695-b2a0-f8088d1e7d9c-kube-api-access-rjj9q\") pod \"model-serving-api-5dd488fc48-sqlr4\" (UID: \"101646e7-fa11-4695-b2a0-f8088d1e7d9c\") " pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" Jun 11 10:12:34.566855 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:12:34.566497 2575 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 10:12:34.566855 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:12:34.566566 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/101646e7-fa11-4695-b2a0-f8088d1e7d9c-tls-certs podName:101646e7-fa11-4695-b2a0-f8088d1e7d9c nodeName:}" failed. No retries permitted until 2026-06-11 10:12:35.066548772 +0000 UTC m=+607.227845808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/101646e7-fa11-4695-b2a0-f8088d1e7d9c-tls-certs") pod "model-serving-api-5dd488fc48-sqlr4" (UID: "101646e7-fa11-4695-b2a0-f8088d1e7d9c") : secret "model-serving-api-tls" not found Jun 11 10:12:34.576108 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:34.576066 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjj9q\" (UniqueName: \"kubernetes.io/projected/101646e7-fa11-4695-b2a0-f8088d1e7d9c-kube-api-access-rjj9q\") pod \"model-serving-api-5dd488fc48-sqlr4\" (UID: \"101646e7-fa11-4695-b2a0-f8088d1e7d9c\") " pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" Jun 11 10:12:35.071745 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:35.071699 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/101646e7-fa11-4695-b2a0-f8088d1e7d9c-tls-certs\") pod \"model-serving-api-5dd488fc48-sqlr4\" (UID: \"101646e7-fa11-4695-b2a0-f8088d1e7d9c\") " pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" Jun 11 10:12:35.075281 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:35.075248 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/101646e7-fa11-4695-b2a0-f8088d1e7d9c-tls-certs\") pod \"model-serving-api-5dd488fc48-sqlr4\" (UID: \"101646e7-fa11-4695-b2a0-f8088d1e7d9c\") " pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" Jun 11 10:12:35.292473 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:35.292430 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" Jun 11 10:12:35.455659 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:35.455578 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sqlr4"] Jun 11 10:12:35.459508 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:12:35.459471 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101646e7_fa11_4695_b2a0_f8088d1e7d9c.slice/crio-710f9b707852153c7542e42b1f9fa76cd4ba848726bfa564a6bfd739ae90f75b WatchSource:0}: Error finding container 710f9b707852153c7542e42b1f9fa76cd4ba848726bfa564a6bfd739ae90f75b: Status 404 returned error can't find the container with id 710f9b707852153c7542e42b1f9fa76cd4ba848726bfa564a6bfd739ae90f75b Jun 11 10:12:36.415935 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:36.415889 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" event={"ID":"101646e7-fa11-4695-b2a0-f8088d1e7d9c","Type":"ContainerStarted","Data":"710f9b707852153c7542e42b1f9fa76cd4ba848726bfa564a6bfd739ae90f75b"} Jun 11 10:12:37.422033 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:37.421993 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" event={"ID":"1768cc13-8f35-45b7-a3a7-5460f257cc11","Type":"ContainerStarted","Data":"6f6807794ec75a2bd3fc4571c198e39f4a8fd23c656f60d2e923d8b252f0c453"} Jun 11 10:12:37.422526 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:37.422207 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" Jun 11 10:12:37.440206 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:37.440151 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" podStartSLOduration=1.6274719869999998 podStartE2EDuration="4.440111253s" totalImagesPullingTime="2.812639266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:12:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:12:37.437975975 +0000 UTC m=+609.599273034" watchObservedRunningTime="2026-06-11 10:12:37.440111253 +0000 UTC m=+609.601408312" Jun 11 10:12:38.750801 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.750769 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc"] Jun 11 10:12:38.754288 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.754267 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" Jun 11 10:12:38.757126 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.757097 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 10:12:38.757233 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.757148 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-p822n\"" Jun 11 10:12:38.757233 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.757106 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 10:12:38.757233 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.757212 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 10:12:38.758372 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.758355 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 10:12:38.764215 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.764186 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc"] Jun 11 10:12:38.801259 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.801229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fb67aeb-5a6f-42dc-a9f4-4cdafa992369-tls-certs\") pod \"kube-auth-proxy-7ccc9cd975-2fqpc\" (UID: \"4fb67aeb-5a6f-42dc-a9f4-4cdafa992369\") " pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" Jun 11 10:12:38.801343 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.801286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb67aeb-5a6f-42dc-a9f4-4cdafa992369-tmp\") pod \"kube-auth-proxy-7ccc9cd975-2fqpc\" (UID: \"4fb67aeb-5a6f-42dc-a9f4-4cdafa992369\") " pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" Jun 11 10:12:38.801343 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.801312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7dsw\" (UniqueName: \"kubernetes.io/projected/4fb67aeb-5a6f-42dc-a9f4-4cdafa992369-kube-api-access-k7dsw\") pod \"kube-auth-proxy-7ccc9cd975-2fqpc\" (UID: \"4fb67aeb-5a6f-42dc-a9f4-4cdafa992369\") " pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" Jun 11 10:12:38.902215 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.902177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7dsw\" (UniqueName: \"kubernetes.io/projected/4fb67aeb-5a6f-42dc-a9f4-4cdafa992369-kube-api-access-k7dsw\") pod \"kube-auth-proxy-7ccc9cd975-2fqpc\" (UID: \"4fb67aeb-5a6f-42dc-a9f4-4cdafa992369\") " pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" Jun 11 10:12:38.902380 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.902228 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fb67aeb-5a6f-42dc-a9f4-4cdafa992369-tls-certs\") pod \"kube-auth-proxy-7ccc9cd975-2fqpc\" (UID: \"4fb67aeb-5a6f-42dc-a9f4-4cdafa992369\") " pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" Jun 11 10:12:38.902380 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.902276 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb67aeb-5a6f-42dc-a9f4-4cdafa992369-tmp\") pod \"kube-auth-proxy-7ccc9cd975-2fqpc\" (UID: \"4fb67aeb-5a6f-42dc-a9f4-4cdafa992369\") " pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" Jun 11 10:12:38.902380 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:12:38.902370 2575 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 11 10:12:38.902534 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:12:38.902445 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fb67aeb-5a6f-42dc-a9f4-4cdafa992369-tls-certs podName:4fb67aeb-5a6f-42dc-a9f4-4cdafa992369 nodeName:}" failed. No retries permitted until 2026-06-11 10:12:39.402423534 +0000 UTC m=+611.563720579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4fb67aeb-5a6f-42dc-a9f4-4cdafa992369-tls-certs") pod "kube-auth-proxy-7ccc9cd975-2fqpc" (UID: "4fb67aeb-5a6f-42dc-a9f4-4cdafa992369") : secret "kube-auth-proxy-tls" not found Jun 11 10:12:38.904507 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.904483 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb67aeb-5a6f-42dc-a9f4-4cdafa992369-tmp\") pod \"kube-auth-proxy-7ccc9cd975-2fqpc\" (UID: \"4fb67aeb-5a6f-42dc-a9f4-4cdafa992369\") " pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" Jun 11 10:12:38.915108 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:38.915083 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7dsw\" (UniqueName: \"kubernetes.io/projected/4fb67aeb-5a6f-42dc-a9f4-4cdafa992369-kube-api-access-k7dsw\") pod \"kube-auth-proxy-7ccc9cd975-2fqpc\" (UID: \"4fb67aeb-5a6f-42dc-a9f4-4cdafa992369\") " pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" Jun 11 10:12:39.406324 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:39.406269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fb67aeb-5a6f-42dc-a9f4-4cdafa992369-tls-certs\") pod \"kube-auth-proxy-7ccc9cd975-2fqpc\" (UID: \"4fb67aeb-5a6f-42dc-a9f4-4cdafa992369\") " pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" Jun 11 10:12:39.408609 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:39.408586 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fb67aeb-5a6f-42dc-a9f4-4cdafa992369-tls-certs\") pod \"kube-auth-proxy-7ccc9cd975-2fqpc\" (UID: \"4fb67aeb-5a6f-42dc-a9f4-4cdafa992369\") " pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" Jun 11 10:12:39.430904 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:39.430873 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" event={"ID":"101646e7-fa11-4695-b2a0-f8088d1e7d9c","Type":"ContainerStarted","Data":"b11d759dcc804fa5f199dcdbca5ced9778b03917bce364083978fe94624f93f3"} Jun 11 10:12:39.431047 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:39.430983 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" Jun 11 10:12:39.449354 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:39.449300 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" podStartSLOduration=2.125379015 podStartE2EDuration="5.449287017s" totalImagesPullingTime="3.323908002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:12:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:12:39.446736802 +0000 UTC m=+611.608033912" watchObservedRunningTime="2026-06-11 10:12:39.449287017 +0000 UTC m=+611.610584075" Jun 11 10:12:39.667290 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:39.667191 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" Jun 11 10:12:39.803439 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:39.803413 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc"] Jun 11 10:12:39.805702 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:12:39.805670 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb67aeb_5a6f_42dc_a9f4_4cdafa992369.slice/crio-3e3177bab7403e7e2b089c22075df55043d50340094998ee27730f1f444d76f8 WatchSource:0}: Error finding container 3e3177bab7403e7e2b089c22075df55043d50340094998ee27730f1f444d76f8: Status 404 returned error can't find the container with id 3e3177bab7403e7e2b089c22075df55043d50340094998ee27730f1f444d76f8 Jun 11 10:12:40.437187 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:40.437082 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" event={"ID":"4fb67aeb-5a6f-42dc-a9f4-4cdafa992369","Type":"ContainerStarted","Data":"3e3177bab7403e7e2b089c22075df55043d50340094998ee27730f1f444d76f8"} Jun 11 10:12:43.452857 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.452819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" event={"ID":"4fb67aeb-5a6f-42dc-a9f4-4cdafa992369","Type":"ContainerStarted","Data":"39096b7e615541a34228bd95809d7c5a67026b88950b2a9ba96736c6a3fe2776"} Jun 11 10:12:43.476267 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.476217 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7ccc9cd975-2fqpc" podStartSLOduration=2.370425881 podStartE2EDuration="5.476202048s" totalImagesPullingTime="3.105776167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:12:43.475147675 +0000 UTC m=+615.636444725" watchObservedRunningTime="2026-06-11 10:12:43.476202048 +0000 UTC m=+615.637499106" Jun 11 10:12:43.752737 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.752657 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-2t5pq"] Jun 11 10:12:43.755726 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.755709 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" Jun 11 10:12:43.758727 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.758704 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9mgjt\"" Jun 11 10:12:43.758894 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.758875 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 10:12:43.759509 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.759490 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc"] Jun 11 10:12:43.762326 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.762308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" Jun 11 10:12:43.767155 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.767134 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 10:12:43.767626 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.767608 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qj92m\"" Jun 11 10:12:43.768900 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.768878 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-2t5pq"] Jun 11 10:12:43.775549 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.775527 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc"] Jun 11 10:12:43.842780 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.842746 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eebe61db-4ae2-4307-8c67-0f4a9dc49969-cert\") pod \"kserve-controller-manager-69fc866d76-2t5pq\" (UID: \"eebe61db-4ae2-4307-8c67-0f4a9dc49969\") " pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" Jun 11 10:12:43.842780 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.842778 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/143f080b-c015-498e-bf0e-0663ad926f27-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8q2tc\" (UID: \"143f080b-c015-498e-bf0e-0663ad926f27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" Jun 11 10:12:43.843013 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.842809 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snqkg\" (UniqueName: \"kubernetes.io/projected/143f080b-c015-498e-bf0e-0663ad926f27-kube-api-access-snqkg\") pod \"llmisvc-controller-manager-864bfd7bc9-8q2tc\" (UID: \"143f080b-c015-498e-bf0e-0663ad926f27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" Jun 11 10:12:43.843013 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.842828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlkhx\" (UniqueName: \"kubernetes.io/projected/eebe61db-4ae2-4307-8c67-0f4a9dc49969-kube-api-access-rlkhx\") pod \"kserve-controller-manager-69fc866d76-2t5pq\" (UID: \"eebe61db-4ae2-4307-8c67-0f4a9dc49969\") " pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" Jun 11 10:12:43.943556 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.943521 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eebe61db-4ae2-4307-8c67-0f4a9dc49969-cert\") pod \"kserve-controller-manager-69fc866d76-2t5pq\" (UID: \"eebe61db-4ae2-4307-8c67-0f4a9dc49969\") " pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" Jun 11 10:12:43.943556 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.943553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/143f080b-c015-498e-bf0e-0663ad926f27-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8q2tc\" (UID: \"143f080b-c015-498e-bf0e-0663ad926f27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" Jun 11 10:12:43.943811 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.943583 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snqkg\" (UniqueName: \"kubernetes.io/projected/143f080b-c015-498e-bf0e-0663ad926f27-kube-api-access-snqkg\") pod \"llmisvc-controller-manager-864bfd7bc9-8q2tc\" (UID: \"143f080b-c015-498e-bf0e-0663ad926f27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" Jun 11 10:12:43.943811 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.943601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlkhx\" (UniqueName: \"kubernetes.io/projected/eebe61db-4ae2-4307-8c67-0f4a9dc49969-kube-api-access-rlkhx\") pod \"kserve-controller-manager-69fc866d76-2t5pq\" (UID: \"eebe61db-4ae2-4307-8c67-0f4a9dc49969\") " pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" Jun 11 10:12:43.945976 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.945949 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/143f080b-c015-498e-bf0e-0663ad926f27-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8q2tc\" (UID: \"143f080b-c015-498e-bf0e-0663ad926f27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" Jun 11 10:12:43.946077 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.945977 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eebe61db-4ae2-4307-8c67-0f4a9dc49969-cert\") pod \"kserve-controller-manager-69fc866d76-2t5pq\" (UID: \"eebe61db-4ae2-4307-8c67-0f4a9dc49969\") " pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" Jun 11 10:12:43.957936 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.957911 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snqkg\" (UniqueName: \"kubernetes.io/projected/143f080b-c015-498e-bf0e-0663ad926f27-kube-api-access-snqkg\") pod \"llmisvc-controller-manager-864bfd7bc9-8q2tc\" (UID: \"143f080b-c015-498e-bf0e-0663ad926f27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" Jun 11 10:12:43.958048 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:43.957978 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlkhx\" (UniqueName: \"kubernetes.io/projected/eebe61db-4ae2-4307-8c67-0f4a9dc49969-kube-api-access-rlkhx\") pod \"kserve-controller-manager-69fc866d76-2t5pq\" (UID: \"eebe61db-4ae2-4307-8c67-0f4a9dc49969\") " pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" Jun 11 10:12:44.066049 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:44.065959 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" Jun 11 10:12:44.075234 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:44.075204 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" Jun 11 10:12:44.224387 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:44.224230 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-2t5pq"] Jun 11 10:12:44.226406 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:12:44.226378 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeebe61db_4ae2_4307_8c67_0f4a9dc49969.slice/crio-70034c1f584556163e49c01c0e0ed09ecfa5c3502962113e384e4dc5442e7985 WatchSource:0}: Error finding container 70034c1f584556163e49c01c0e0ed09ecfa5c3502962113e384e4dc5442e7985: Status 404 returned error can't find the container with id 70034c1f584556163e49c01c0e0ed09ecfa5c3502962113e384e4dc5442e7985 Jun 11 10:12:44.252662 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:44.252637 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc"] Jun 11 10:12:44.254893 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:12:44.254865 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod143f080b_c015_498e_bf0e_0663ad926f27.slice/crio-aa067e731f276d2592771e015fd6e3c391b9d20eacf0d65c4c7b9c11412856e8 WatchSource:0}: Error finding container aa067e731f276d2592771e015fd6e3c391b9d20eacf0d65c4c7b9c11412856e8: Status 404 returned error can't find the container with id aa067e731f276d2592771e015fd6e3c391b9d20eacf0d65c4c7b9c11412856e8 Jun 11 10:12:44.458572 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:44.458535 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" event={"ID":"143f080b-c015-498e-bf0e-0663ad926f27","Type":"ContainerStarted","Data":"aa067e731f276d2592771e015fd6e3c391b9d20eacf0d65c4c7b9c11412856e8"} Jun 11 10:12:44.459700 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:44.459676 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" event={"ID":"eebe61db-4ae2-4307-8c67-0f4a9dc49969","Type":"ContainerStarted","Data":"70034c1f584556163e49c01c0e0ed09ecfa5c3502962113e384e4dc5442e7985"} Jun 11 10:12:48.438660 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:48.438627 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-hmhz6" Jun 11 10:12:48.485376 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:48.485339 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" event={"ID":"143f080b-c015-498e-bf0e-0663ad926f27","Type":"ContainerStarted","Data":"8e951ff1ca5a52b7123c4c4f6973d311510d98ea5747e844be8ac8e615633867"} Jun 11 10:12:48.485636 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:48.485621 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" Jun 11 10:12:48.487393 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:48.487365 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" event={"ID":"eebe61db-4ae2-4307-8c67-0f4a9dc49969","Type":"ContainerStarted","Data":"f305b814a4b4720a8b296b174d9e93327cd1c5890016b98183c618b747e3a64b"} Jun 11 10:12:48.487539 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:48.487416 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" Jun 11 10:12:48.521044 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:48.520973 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" podStartSLOduration=1.4771822079999999 podStartE2EDuration="5.52095319s" totalImagesPullingTime="4.043770982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:12:48.519356446 +0000 UTC m=+620.680653505" watchObservedRunningTime="2026-06-11 10:12:48.52095319 +0000 UTC m=+620.682250249" Jun 11 10:12:48.564852 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:48.564744 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" podStartSLOduration=1.494564203 podStartE2EDuration="5.564721981s" totalImagesPullingTime="4.070157778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:12:48.563423307 +0000 UTC m=+620.724720369" watchObservedRunningTime="2026-06-11 10:12:48.564721981 +0000 UTC m=+620.726019040" Jun 11 10:12:50.442165 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:50.442139 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-sqlr4" Jun 11 10:12:54.343396 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.343367 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w"] Jun 11 10:12:54.346628 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.346610 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" Jun 11 10:12:54.350515 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.350488 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 10:12:54.350667 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.350637 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-zmtpn\"" Jun 11 10:12:54.351280 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.351264 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 10:12:54.373732 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.373699 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w"] Jun 11 10:12:54.433669 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.433637 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7b01af1d-d28d-42ff-90db-4dc7a6523555-operator-config\") pod \"servicemesh-operator3-57f65f65fb-f4q2w\" (UID: \"7b01af1d-d28d-42ff-90db-4dc7a6523555\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" Jun 11 10:12:54.433855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.433708 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svmnx\" (UniqueName: \"kubernetes.io/projected/7b01af1d-d28d-42ff-90db-4dc7a6523555-kube-api-access-svmnx\") pod \"servicemesh-operator3-57f65f65fb-f4q2w\" (UID: \"7b01af1d-d28d-42ff-90db-4dc7a6523555\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" Jun 11 10:12:54.534856 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.534824 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svmnx\" (UniqueName: \"kubernetes.io/projected/7b01af1d-d28d-42ff-90db-4dc7a6523555-kube-api-access-svmnx\") pod \"servicemesh-operator3-57f65f65fb-f4q2w\" (UID: \"7b01af1d-d28d-42ff-90db-4dc7a6523555\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" Jun 11 10:12:54.534856 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.534867 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7b01af1d-d28d-42ff-90db-4dc7a6523555-operator-config\") pod \"servicemesh-operator3-57f65f65fb-f4q2w\" (UID: \"7b01af1d-d28d-42ff-90db-4dc7a6523555\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" Jun 11 10:12:54.537451 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.537426 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7b01af1d-d28d-42ff-90db-4dc7a6523555-operator-config\") pod \"servicemesh-operator3-57f65f65fb-f4q2w\" (UID: \"7b01af1d-d28d-42ff-90db-4dc7a6523555\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" Jun 11 10:12:54.544107 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.544084 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svmnx\" (UniqueName: \"kubernetes.io/projected/7b01af1d-d28d-42ff-90db-4dc7a6523555-kube-api-access-svmnx\") pod \"servicemesh-operator3-57f65f65fb-f4q2w\" (UID: \"7b01af1d-d28d-42ff-90db-4dc7a6523555\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" Jun 11 10:12:54.657263 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.657168 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" Jun 11 10:12:54.786579 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:54.786547 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w"] Jun 11 10:12:54.789745 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:12:54.789716 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b01af1d_d28d_42ff_90db_4dc7a6523555.slice/crio-7aebc0dfe4ea0f6f064c07c6652eb66958740e90ae018045a06aa0092e55aea2 WatchSource:0}: Error finding container 7aebc0dfe4ea0f6f064c07c6652eb66958740e90ae018045a06aa0092e55aea2: Status 404 returned error can't find the container with id 7aebc0dfe4ea0f6f064c07c6652eb66958740e90ae018045a06aa0092e55aea2 Jun 11 10:12:55.116219 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.116179 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6967679dd4-lc55h"] Jun 11 10:12:55.121332 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.121308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6967679dd4-lc55h" Jun 11 10:12:55.124562 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.124523 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 10:12:55.124698 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.124662 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-66dnm\"" Jun 11 10:12:55.128947 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.128924 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6967679dd4-lc55h"] Jun 11 10:12:55.240986 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.240951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/801ff3f1-8294-49aa-9131-fe0ebc2876d6-redirect-config\") pod \"dashboard-redirect-6967679dd4-lc55h\" (UID: \"801ff3f1-8294-49aa-9131-fe0ebc2876d6\") " pod="opendatahub/dashboard-redirect-6967679dd4-lc55h" Jun 11 10:12:55.241175 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.240999 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf2fs\" (UniqueName: \"kubernetes.io/projected/801ff3f1-8294-49aa-9131-fe0ebc2876d6-kube-api-access-kf2fs\") pod \"dashboard-redirect-6967679dd4-lc55h\" (UID: \"801ff3f1-8294-49aa-9131-fe0ebc2876d6\") " pod="opendatahub/dashboard-redirect-6967679dd4-lc55h" Jun 11 10:12:55.342382 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.342347 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/801ff3f1-8294-49aa-9131-fe0ebc2876d6-redirect-config\") pod \"dashboard-redirect-6967679dd4-lc55h\" (UID: \"801ff3f1-8294-49aa-9131-fe0ebc2876d6\") " pod="opendatahub/dashboard-redirect-6967679dd4-lc55h" Jun 11 10:12:55.342580 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.342402 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2fs\" (UniqueName: \"kubernetes.io/projected/801ff3f1-8294-49aa-9131-fe0ebc2876d6-kube-api-access-kf2fs\") pod \"dashboard-redirect-6967679dd4-lc55h\" (UID: \"801ff3f1-8294-49aa-9131-fe0ebc2876d6\") " pod="opendatahub/dashboard-redirect-6967679dd4-lc55h" Jun 11 10:12:55.343019 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.342998 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/801ff3f1-8294-49aa-9131-fe0ebc2876d6-redirect-config\") pod \"dashboard-redirect-6967679dd4-lc55h\" (UID: \"801ff3f1-8294-49aa-9131-fe0ebc2876d6\") " pod="opendatahub/dashboard-redirect-6967679dd4-lc55h" Jun 11 10:12:55.357939 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.357918 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf2fs\" (UniqueName: \"kubernetes.io/projected/801ff3f1-8294-49aa-9131-fe0ebc2876d6-kube-api-access-kf2fs\") pod \"dashboard-redirect-6967679dd4-lc55h\" (UID: \"801ff3f1-8294-49aa-9131-fe0ebc2876d6\") " pod="opendatahub/dashboard-redirect-6967679dd4-lc55h" Jun 11 10:12:55.433982 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.433896 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6967679dd4-lc55h" Jun 11 10:12:55.523416 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.523381 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" event={"ID":"7b01af1d-d28d-42ff-90db-4dc7a6523555","Type":"ContainerStarted","Data":"7aebc0dfe4ea0f6f064c07c6652eb66958740e90ae018045a06aa0092e55aea2"} Jun 11 10:12:55.576295 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:55.576268 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6967679dd4-lc55h"] Jun 11 10:12:55.578994 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:12:55.578965 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801ff3f1_8294_49aa_9131_fe0ebc2876d6.slice/crio-184f6945a22e58da299248d5fd078ecd7665c032ce41686e73ea054b959e2fe1 WatchSource:0}: Error finding container 184f6945a22e58da299248d5fd078ecd7665c032ce41686e73ea054b959e2fe1: Status 404 returned error can't find the container with id 184f6945a22e58da299248d5fd078ecd7665c032ce41686e73ea054b959e2fe1 Jun 11 10:12:56.529048 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:12:56.529011 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6967679dd4-lc55h" event={"ID":"801ff3f1-8294-49aa-9131-fe0ebc2876d6","Type":"ContainerStarted","Data":"184f6945a22e58da299248d5fd078ecd7665c032ce41686e73ea054b959e2fe1"} Jun 11 10:13:01.557142 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:01.557080 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6967679dd4-lc55h" event={"ID":"801ff3f1-8294-49aa-9131-fe0ebc2876d6","Type":"ContainerStarted","Data":"871abb5abb24e1e39e2114c2058b11c28190b2c83ebf3e2773576eea75d48a34"} Jun 11 10:13:01.558957 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:01.558913 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" event={"ID":"7b01af1d-d28d-42ff-90db-4dc7a6523555","Type":"ContainerStarted","Data":"32786679f09b782773a493480b857d23a5e6aea5a4f68a267524805b49f65d69"} Jun 11 10:13:01.559358 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:01.559032 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" Jun 11 10:13:01.589478 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:01.589426 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6967679dd4-lc55h" podStartSLOduration=1.024781566 podStartE2EDuration="6.58941296s" totalImagesPullingTime="5.564631394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:13:01.588618723 +0000 UTC m=+633.749915782" watchObservedRunningTime="2026-06-11 10:13:01.58941296 +0000 UTC m=+633.750709996" Jun 11 10:13:07.457950 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.457900 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" podStartSLOduration=7.176973588 podStartE2EDuration="13.457883728s" totalImagesPullingTime="6.28091014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:12:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:13:01.6274907 +0000 UTC m=+633.788787757" watchObservedRunningTime="2026-06-11 10:13:07.457883728 +0000 UTC m=+639.619180785" Jun 11 10:13:07.458344 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.458038 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr"] Jun 11 10:13:07.462508 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.462490 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.465066 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.465047 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 10:13:07.465206 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.465055 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 10:13:07.465296 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.465279 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 10:13:07.465400 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.465384 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-44hkz\"" Jun 11 10:13:07.465487 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.465471 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 10:13:07.471590 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.471565 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr"] Jun 11 10:13:07.554995 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.554961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.555298 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.555018 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.555298 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.555088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.555298 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.555150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.555298 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.555191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.555298 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.555220 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.555298 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.555258 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wjwh\" (UniqueName: \"kubernetes.io/projected/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-kube-api-access-9wjwh\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.655885 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.655835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wjwh\" (UniqueName: \"kubernetes.io/projected/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-kube-api-access-9wjwh\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.656094 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.655894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.656094 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.655943 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.656256 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.656083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.656256 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.656150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.656256 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.656184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.656256 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.656227 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.656919 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.656865 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.658348 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.658327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.658494 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.658474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.658663 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.658644 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.658855 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.658840 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.664852 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.664828 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wjwh\" (UniqueName: \"kubernetes.io/projected/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-kube-api-access-9wjwh\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.664938 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.664902 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3533c1-d5f8-4ba9-9921-40ae0823c5b0-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-drlkr\" (UID: \"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.773638 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.773545 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:07.912571 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:07.912541 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr"] Jun 11 10:13:07.914774 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:13:07.914743 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3533c1_d5f8_4ba9_9921_40ae0823c5b0.slice/crio-96c437b27616d2a3b6bd8d8c437a798ba28f1b99aeea789b7c225cc3d1aaf85c WatchSource:0}: Error finding container 96c437b27616d2a3b6bd8d8c437a798ba28f1b99aeea789b7c225cc3d1aaf85c: Status 404 returned error can't find the container with id 96c437b27616d2a3b6bd8d8c437a798ba28f1b99aeea789b7c225cc3d1aaf85c Jun 11 10:13:08.589861 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:08.589821 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" event={"ID":"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0","Type":"ContainerStarted","Data":"96c437b27616d2a3b6bd8d8c437a798ba28f1b99aeea789b7c225cc3d1aaf85c"} Jun 11 10:13:11.350636 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:11.350592 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 10:13:11.350994 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:11.350676 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 10:13:11.606354 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:11.606265 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" event={"ID":"2c3533c1-d5f8-4ba9-9921-40ae0823c5b0","Type":"ContainerStarted","Data":"ccf551c548953e756cc5300c357c50f64742e184f838846d9fa4d9717ba2263a"} Jun 11 10:13:11.606528 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:11.606421 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:11.627546 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:11.627494 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" podStartSLOduration=1.194046786 podStartE2EDuration="4.627476864s" totalImagesPullingTime="3.433430078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:13:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:13:11.625968384 +0000 UTC m=+643.787265456" watchObservedRunningTime="2026-06-11 10:13:11.627476864 +0000 UTC m=+643.788773922" Jun 11 10:13:12.565325 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:12.565293 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-f4q2w" Jun 11 10:13:12.613156 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:12.613095 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drlkr" Jun 11 10:13:19.493895 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:19.493864 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q2tc" Jun 11 10:13:19.496937 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:13:19.496920 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-2t5pq" Jun 11 10:14:15.118830 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:15.118753 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78"] Jun 11 10:14:15.120962 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:15.120945 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" Jun 11 10:14:15.124001 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:15.123981 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 10:14:15.125394 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:15.125374 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 10:14:15.125496 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:15.125394 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2qclc\"" Jun 11 10:14:15.130699 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:15.130675 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78"] Jun 11 10:14:15.150862 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:15.150836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt9xn\" (UniqueName: \"kubernetes.io/projected/62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3-kube-api-access-bt9xn\") pod \"limitador-operator-controller-manager-859d7b78bd-p4m78\" (UID: \"62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" Jun 11 10:14:15.252059 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:15.252022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt9xn\" (UniqueName: \"kubernetes.io/projected/62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3-kube-api-access-bt9xn\") pod \"limitador-operator-controller-manager-859d7b78bd-p4m78\" (UID: \"62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" Jun 11 10:14:15.263382 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:15.263348 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt9xn\" (UniqueName: \"kubernetes.io/projected/62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3-kube-api-access-bt9xn\") pod \"limitador-operator-controller-manager-859d7b78bd-p4m78\" (UID: \"62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" Jun 11 10:14:15.431430 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:15.431337 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" Jun 11 10:14:15.559686 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:15.559659 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78"] Jun 11 10:14:15.562844 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:14:15.562807 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62cb6b1f_acb9_44de_9e8b_c0b0bb32d0a3.slice/crio-6410927ed3884c09b24dd5ad01cbd4181be24fbb3379af6c6c5da438d2b30ea2 WatchSource:0}: Error finding container 6410927ed3884c09b24dd5ad01cbd4181be24fbb3379af6c6c5da438d2b30ea2: Status 404 returned error can't find the container with id 6410927ed3884c09b24dd5ad01cbd4181be24fbb3379af6c6c5da438d2b30ea2 Jun 11 10:14:15.879284 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:15.879247 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" event={"ID":"62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3","Type":"ContainerStarted","Data":"6410927ed3884c09b24dd5ad01cbd4181be24fbb3379af6c6c5da438d2b30ea2"} Jun 11 10:14:17.890037 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:17.889998 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" event={"ID":"62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3","Type":"ContainerStarted","Data":"2be2c180d853a9173be41ef6588fbcf1c14a54746be96978c43dbcb85b55bc63"} Jun 11 10:14:17.890458 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:17.890143 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" Jun 11 10:14:17.911708 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:17.911657 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" podStartSLOduration=0.696844813 podStartE2EDuration="2.911643313s" totalImagesPullingTime="2.2147985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:14:17.911506416 +0000 UTC m=+710.072803475" watchObservedRunningTime="2026-06-11 10:14:17.911643313 +0000 UTC m=+710.072940371" Jun 11 10:14:28.899925 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:28.899893 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" Jun 11 10:14:30.182366 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.182324 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78"] Jun 11 10:14:30.182827 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.182560 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" podUID="62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3" containerName="manager" containerID="cri-o://2be2c180d853a9173be41ef6588fbcf1c14a54746be96978c43dbcb85b55bc63" gracePeriod=2 Jun 11 10:14:30.191779 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.191750 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78"] Jun 11 10:14:30.215978 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.215938 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn"] Jun 11 10:14:30.216446 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.216426 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3" containerName="manager" Jun 11 10:14:30.216446 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.216448 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3" containerName="manager" Jun 11 10:14:30.216598 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.216534 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3" containerName="manager" Jun 11 10:14:30.218379 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.218361 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn" Jun 11 10:14:30.220920 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:14:30.220892 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p4m78\" is forbidden: User \"system:node:ip-10-0-137-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-68.ec2.internal' and this object" podUID="62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" Jun 11 10:14:30.234265 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.234231 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn"] Jun 11 10:14:30.285724 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.285694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86x8c\" (UniqueName: \"kubernetes.io/projected/85004e58-888b-4d1e-8e74-abbf4d48479a-kube-api-access-86x8c\") pod \"limitador-operator-controller-manager-859d7b78bd-4l2mn\" (UID: \"85004e58-888b-4d1e-8e74-abbf4d48479a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn" Jun 11 10:14:30.386722 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.386684 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86x8c\" (UniqueName: \"kubernetes.io/projected/85004e58-888b-4d1e-8e74-abbf4d48479a-kube-api-access-86x8c\") pod \"limitador-operator-controller-manager-859d7b78bd-4l2mn\" (UID: \"85004e58-888b-4d1e-8e74-abbf4d48479a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn" Jun 11 10:14:30.400943 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.400916 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86x8c\" (UniqueName: \"kubernetes.io/projected/85004e58-888b-4d1e-8e74-abbf4d48479a-kube-api-access-86x8c\") pod \"limitador-operator-controller-manager-859d7b78bd-4l2mn\" (UID: \"85004e58-888b-4d1e-8e74-abbf4d48479a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn" Jun 11 10:14:30.421197 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.421174 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" Jun 11 10:14:30.487340 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.487316 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt9xn\" (UniqueName: \"kubernetes.io/projected/62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3-kube-api-access-bt9xn\") pod \"62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3\" (UID: \"62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3\") " Jun 11 10:14:30.489408 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.489375 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3-kube-api-access-bt9xn" (OuterVolumeSpecName: "kube-api-access-bt9xn") pod "62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3" (UID: "62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3"). InnerVolumeSpecName "kube-api-access-bt9xn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:14:30.562666 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.562629 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn" Jun 11 10:14:30.588799 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.588772 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt9xn\" (UniqueName: \"kubernetes.io/projected/62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3-kube-api-access-bt9xn\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:14:30.693022 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.692996 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn"] Jun 11 10:14:30.695285 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:14:30.695255 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85004e58_888b_4d1e_8e74_abbf4d48479a.slice/crio-246beb8ccf2486f8704acaaaa5540b1d45d87daf29e6469aa21748d5a89f6a2d WatchSource:0}: Error finding container 246beb8ccf2486f8704acaaaa5540b1d45d87daf29e6469aa21748d5a89f6a2d: Status 404 returned error can't find the container with id 246beb8ccf2486f8704acaaaa5540b1d45d87daf29e6469aa21748d5a89f6a2d Jun 11 10:14:30.951026 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.950988 2575 generic.go:356] "Generic (PLEG): container finished" podID="62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3" containerID="2be2c180d853a9173be41ef6588fbcf1c14a54746be96978c43dbcb85b55bc63" exitCode=0 Jun 11 10:14:30.951243 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.951046 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4m78" Jun 11 10:14:30.951243 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.951080 2575 scope.go:117] "RemoveContainer" containerID="2be2c180d853a9173be41ef6588fbcf1c14a54746be96978c43dbcb85b55bc63" Jun 11 10:14:30.952857 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.952819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn" event={"ID":"85004e58-888b-4d1e-8e74-abbf4d48479a","Type":"ContainerStarted","Data":"a288885e6b825d49bb548b1d0068077733c1244bfe5b43e7a451014c5857bac2"} Jun 11 10:14:30.952999 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.952884 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn" event={"ID":"85004e58-888b-4d1e-8e74-abbf4d48479a","Type":"ContainerStarted","Data":"246beb8ccf2486f8704acaaaa5540b1d45d87daf29e6469aa21748d5a89f6a2d"} Jun 11 10:14:30.952999 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.952915 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn" Jun 11 10:14:30.960813 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.960795 2575 scope.go:117] "RemoveContainer" containerID="2be2c180d853a9173be41ef6588fbcf1c14a54746be96978c43dbcb85b55bc63" Jun 11 10:14:30.961075 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:14:30.961056 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2be2c180d853a9173be41ef6588fbcf1c14a54746be96978c43dbcb85b55bc63\": container with ID starting with 2be2c180d853a9173be41ef6588fbcf1c14a54746be96978c43dbcb85b55bc63 not found: ID does not exist" containerID="2be2c180d853a9173be41ef6588fbcf1c14a54746be96978c43dbcb85b55bc63" Jun 11 10:14:30.961169 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.961087 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2be2c180d853a9173be41ef6588fbcf1c14a54746be96978c43dbcb85b55bc63"} err="failed to get container status \"2be2c180d853a9173be41ef6588fbcf1c14a54746be96978c43dbcb85b55bc63\": rpc error: code = NotFound desc = could not find container \"2be2c180d853a9173be41ef6588fbcf1c14a54746be96978c43dbcb85b55bc63\": container with ID starting with 2be2c180d853a9173be41ef6588fbcf1c14a54746be96978c43dbcb85b55bc63 not found: ID does not exist" Jun 11 10:14:30.978276 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:30.978234 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn" podStartSLOduration=0.978221273 podStartE2EDuration="978.221273ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:14:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:14:30.976856215 +0000 UTC m=+723.138153272" watchObservedRunningTime="2026-06-11 10:14:30.978221273 +0000 UTC m=+723.139518331" Jun 11 10:14:32.342702 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:32.342659 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3" path="/var/lib/kubelet/pods/62cb6b1f-acb9-44de-9e8b-c0b0bb32d0a3/volumes" Jun 11 10:14:41.960604 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:14:41.960564 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4l2mn" Jun 11 10:16:36.770895 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.770848 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66ff5dc694-qwnp6"] Jun 11 10:16:36.774258 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.774234 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66ff5dc694-qwnp6" Jun 11 10:16:36.778635 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.778615 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 10:16:36.778635 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.778625 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s7tgh\"" Jun 11 10:16:36.778809 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.778654 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 10:16:36.784972 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.784949 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66ff5dc694-qwnp6"] Jun 11 10:16:36.860658 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.860623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fd17c36-6002-45bb-8269-f9d16e7255fe-webhook-cert\") pod \"maas-controller-66ff5dc694-qwnp6\" (UID: \"9fd17c36-6002-45bb-8269-f9d16e7255fe\") " pod="opendatahub/maas-controller-66ff5dc694-qwnp6" Jun 11 10:16:36.860849 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.860752 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4slr\" (UniqueName: \"kubernetes.io/projected/9fd17c36-6002-45bb-8269-f9d16e7255fe-kube-api-access-z4slr\") pod \"maas-controller-66ff5dc694-qwnp6\" (UID: \"9fd17c36-6002-45bb-8269-f9d16e7255fe\") " pod="opendatahub/maas-controller-66ff5dc694-qwnp6" Jun 11 10:16:36.946500 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.946463 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c8d5c9cb8-t85tl"] Jun 11 10:16:36.950906 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.950881 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" Jun 11 10:16:36.956168 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.956140 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c8d5c9cb8-t85tl"] Jun 11 10:16:36.962035 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.962003 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5wv5\" (UniqueName: \"kubernetes.io/projected/a1c17208-a031-4706-a628-5574d2c859d0-kube-api-access-s5wv5\") pod \"maas-controller-c8d5c9cb8-t85tl\" (UID: \"a1c17208-a031-4706-a628-5574d2c859d0\") " pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" Jun 11 10:16:36.962193 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.962165 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4slr\" (UniqueName: \"kubernetes.io/projected/9fd17c36-6002-45bb-8269-f9d16e7255fe-kube-api-access-z4slr\") pod \"maas-controller-66ff5dc694-qwnp6\" (UID: \"9fd17c36-6002-45bb-8269-f9d16e7255fe\") " pod="opendatahub/maas-controller-66ff5dc694-qwnp6" Jun 11 10:16:36.962277 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.962219 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1c17208-a031-4706-a628-5574d2c859d0-webhook-cert\") pod \"maas-controller-c8d5c9cb8-t85tl\" (UID: \"a1c17208-a031-4706-a628-5574d2c859d0\") " pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" Jun 11 10:16:36.962277 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.962253 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fd17c36-6002-45bb-8269-f9d16e7255fe-webhook-cert\") pod \"maas-controller-66ff5dc694-qwnp6\" (UID: \"9fd17c36-6002-45bb-8269-f9d16e7255fe\") " pod="opendatahub/maas-controller-66ff5dc694-qwnp6" Jun 11 10:16:36.964605 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.964583 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fd17c36-6002-45bb-8269-f9d16e7255fe-webhook-cert\") pod \"maas-controller-66ff5dc694-qwnp6\" (UID: \"9fd17c36-6002-45bb-8269-f9d16e7255fe\") " pod="opendatahub/maas-controller-66ff5dc694-qwnp6" Jun 11 10:16:36.972765 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:36.972733 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4slr\" (UniqueName: \"kubernetes.io/projected/9fd17c36-6002-45bb-8269-f9d16e7255fe-kube-api-access-z4slr\") pod \"maas-controller-66ff5dc694-qwnp6\" (UID: \"9fd17c36-6002-45bb-8269-f9d16e7255fe\") " pod="opendatahub/maas-controller-66ff5dc694-qwnp6" Jun 11 10:16:37.063066 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:37.062982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1c17208-a031-4706-a628-5574d2c859d0-webhook-cert\") pod \"maas-controller-c8d5c9cb8-t85tl\" (UID: \"a1c17208-a031-4706-a628-5574d2c859d0\") " pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" Jun 11 10:16:37.063066 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:37.063040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5wv5\" (UniqueName: \"kubernetes.io/projected/a1c17208-a031-4706-a628-5574d2c859d0-kube-api-access-s5wv5\") pod \"maas-controller-c8d5c9cb8-t85tl\" (UID: \"a1c17208-a031-4706-a628-5574d2c859d0\") " pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" Jun 11 10:16:37.065395 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:37.065373 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1c17208-a031-4706-a628-5574d2c859d0-webhook-cert\") pod \"maas-controller-c8d5c9cb8-t85tl\" (UID: \"a1c17208-a031-4706-a628-5574d2c859d0\") " pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" Jun 11 10:16:37.071164 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:37.071142 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5wv5\" (UniqueName: \"kubernetes.io/projected/a1c17208-a031-4706-a628-5574d2c859d0-kube-api-access-s5wv5\") pod \"maas-controller-c8d5c9cb8-t85tl\" (UID: \"a1c17208-a031-4706-a628-5574d2c859d0\") " pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" Jun 11 10:16:37.084944 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:37.084922 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66ff5dc694-qwnp6" Jun 11 10:16:37.212893 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:37.212856 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66ff5dc694-qwnp6"] Jun 11 10:16:37.215722 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:16:37.215700 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd17c36_6002_45bb_8269_f9d16e7255fe.slice/crio-587801bb288446d2bc7456946cd97d51eb7748ffdc56e65aef9b68bc09be854f WatchSource:0}: Error finding container 587801bb288446d2bc7456946cd97d51eb7748ffdc56e65aef9b68bc09be854f: Status 404 returned error can't find the container with id 587801bb288446d2bc7456946cd97d51eb7748ffdc56e65aef9b68bc09be854f Jun 11 10:16:37.262264 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:37.262235 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" Jun 11 10:16:37.388332 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:37.388304 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c8d5c9cb8-t85tl"] Jun 11 10:16:37.390097 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:16:37.390070 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c17208_a031_4706_a628_5574d2c859d0.slice/crio-c5459b8f38fa90e50f158dbcc2e5f9b49b9e0c117a34a8a98d32a2e5e180778a WatchSource:0}: Error finding container c5459b8f38fa90e50f158dbcc2e5f9b49b9e0c117a34a8a98d32a2e5e180778a: Status 404 returned error can't find the container with id c5459b8f38fa90e50f158dbcc2e5f9b49b9e0c117a34a8a98d32a2e5e180778a Jun 11 10:16:37.507539 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:37.507504 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66ff5dc694-qwnp6" event={"ID":"9fd17c36-6002-45bb-8269-f9d16e7255fe","Type":"ContainerStarted","Data":"587801bb288446d2bc7456946cd97d51eb7748ffdc56e65aef9b68bc09be854f"} Jun 11 10:16:37.508672 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:37.508644 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" event={"ID":"a1c17208-a031-4706-a628-5574d2c859d0","Type":"ContainerStarted","Data":"c5459b8f38fa90e50f158dbcc2e5f9b49b9e0c117a34a8a98d32a2e5e180778a"} Jun 11 10:16:40.525717 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:40.525675 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" event={"ID":"a1c17208-a031-4706-a628-5574d2c859d0","Type":"ContainerStarted","Data":"9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f"} Jun 11 10:16:40.526186 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:40.525752 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" Jun 11 10:16:40.527322 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:40.527294 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66ff5dc694-qwnp6" event={"ID":"9fd17c36-6002-45bb-8269-f9d16e7255fe","Type":"ContainerStarted","Data":"4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397"} Jun 11 10:16:40.527435 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:40.527413 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66ff5dc694-qwnp6" Jun 11 10:16:40.545926 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:40.545874 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" podStartSLOduration=2.12771177 podStartE2EDuration="4.545858736s" totalImagesPullingTime="2.418146966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:16:40.545377757 +0000 UTC m=+852.706674816" watchObservedRunningTime="2026-06-11 10:16:40.545858736 +0000 UTC m=+852.707155794" Jun 11 10:16:40.563462 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:40.563416 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66ff5dc694-qwnp6" podStartSLOduration=1.883506533 podStartE2EDuration="4.563399891s" totalImagesPullingTime="2.679893358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:16:40.562515455 +0000 UTC m=+852.723812514" watchObservedRunningTime="2026-06-11 10:16:40.563399891 +0000 UTC m=+852.724696948" Jun 11 10:16:51.536730 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:51.536692 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" Jun 11 10:16:51.537110 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:51.536782 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66ff5dc694-qwnp6" Jun 11 10:16:51.596592 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:51.596559 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66ff5dc694-qwnp6"] Jun 11 10:16:51.596802 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:51.596780 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-66ff5dc694-qwnp6" podUID="9fd17c36-6002-45bb-8269-f9d16e7255fe" containerName="manager" containerID="cri-o://4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397" gracePeriod=30 Jun 11 10:16:51.849554 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:51.849528 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66ff5dc694-qwnp6" Jun 11 10:16:51.889675 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:51.889639 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4slr\" (UniqueName: \"kubernetes.io/projected/9fd17c36-6002-45bb-8269-f9d16e7255fe-kube-api-access-z4slr\") pod \"9fd17c36-6002-45bb-8269-f9d16e7255fe\" (UID: \"9fd17c36-6002-45bb-8269-f9d16e7255fe\") " Jun 11 10:16:51.889843 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:51.889678 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fd17c36-6002-45bb-8269-f9d16e7255fe-webhook-cert\") pod \"9fd17c36-6002-45bb-8269-f9d16e7255fe\" (UID: \"9fd17c36-6002-45bb-8269-f9d16e7255fe\") " Jun 11 10:16:51.891921 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:51.891894 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fd17c36-6002-45bb-8269-f9d16e7255fe-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9fd17c36-6002-45bb-8269-f9d16e7255fe" (UID: "9fd17c36-6002-45bb-8269-f9d16e7255fe"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:16:51.892041 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:51.891892 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fd17c36-6002-45bb-8269-f9d16e7255fe-kube-api-access-z4slr" (OuterVolumeSpecName: "kube-api-access-z4slr") pod "9fd17c36-6002-45bb-8269-f9d16e7255fe" (UID: "9fd17c36-6002-45bb-8269-f9d16e7255fe"). InnerVolumeSpecName "kube-api-access-z4slr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:16:51.991031 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:51.990989 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4slr\" (UniqueName: \"kubernetes.io/projected/9fd17c36-6002-45bb-8269-f9d16e7255fe-kube-api-access-z4slr\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:16:51.991031 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:51.991023 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fd17c36-6002-45bb-8269-f9d16e7255fe-webhook-cert\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:16:52.580066 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:52.580030 2575 generic.go:356] "Generic (PLEG): container finished" podID="9fd17c36-6002-45bb-8269-f9d16e7255fe" containerID="4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397" exitCode=0 Jun 11 10:16:52.580066 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:52.580070 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66ff5dc694-qwnp6" Jun 11 10:16:52.580589 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:52.580093 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66ff5dc694-qwnp6" event={"ID":"9fd17c36-6002-45bb-8269-f9d16e7255fe","Type":"ContainerDied","Data":"4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397"} Jun 11 10:16:52.580589 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:52.580163 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66ff5dc694-qwnp6" event={"ID":"9fd17c36-6002-45bb-8269-f9d16e7255fe","Type":"ContainerDied","Data":"587801bb288446d2bc7456946cd97d51eb7748ffdc56e65aef9b68bc09be854f"} Jun 11 10:16:52.580589 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:52.580196 2575 scope.go:117] "RemoveContainer" containerID="4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397" Jun 11 10:16:52.588494 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:52.588476 2575 scope.go:117] "RemoveContainer" containerID="4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397" Jun 11 10:16:52.588747 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:16:52.588730 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397\": container with ID starting with 4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397 not found: ID does not exist" containerID="4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397" Jun 11 10:16:52.588827 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:52.588754 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397"} err="failed to get container status \"4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397\": rpc error: code = NotFound desc = could not find container \"4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397\": container with ID starting with 4a3b3edcff7caaa80a504f312b984de1cdb080dcadbcb34c272c2a4befdd3397 not found: ID does not exist" Jun 11 10:16:52.597872 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:52.597850 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66ff5dc694-qwnp6"] Jun 11 10:16:52.601411 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:52.601355 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-66ff5dc694-qwnp6"] Jun 11 10:16:54.343096 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:16:54.343060 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fd17c36-6002-45bb-8269-f9d16e7255fe" path="/var/lib/kubelet/pods/9fd17c36-6002-45bb-8269-f9d16e7255fe/volumes" Jun 11 10:17:11.108302 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.108262 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-58b59bbf57-5vcwr"] Jun 11 10:17:11.108901 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.108732 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fd17c36-6002-45bb-8269-f9d16e7255fe" containerName="manager" Jun 11 10:17:11.108901 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.108752 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fd17c36-6002-45bb-8269-f9d16e7255fe" containerName="manager" Jun 11 10:17:11.108901 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.108857 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fd17c36-6002-45bb-8269-f9d16e7255fe" containerName="manager" Jun 11 10:17:11.113372 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.113350 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-58b59bbf57-5vcwr" Jun 11 10:17:11.117978 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.117956 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 10:17:11.117978 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.117968 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cqql9\"" Jun 11 10:17:11.121651 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.121629 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-58b59bbf57-5vcwr"] Jun 11 10:17:11.257159 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.257101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9szsf\" (UniqueName: \"kubernetes.io/projected/830319b1-3cae-454d-b52c-45f2256c543d-kube-api-access-9szsf\") pod \"maas-api-58b59bbf57-5vcwr\" (UID: \"830319b1-3cae-454d-b52c-45f2256c543d\") " pod="opendatahub/maas-api-58b59bbf57-5vcwr" Jun 11 10:17:11.257330 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.257227 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/830319b1-3cae-454d-b52c-45f2256c543d-maas-api-tls\") pod \"maas-api-58b59bbf57-5vcwr\" (UID: \"830319b1-3cae-454d-b52c-45f2256c543d\") " pod="opendatahub/maas-api-58b59bbf57-5vcwr" Jun 11 10:17:11.358294 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.358261 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/830319b1-3cae-454d-b52c-45f2256c543d-maas-api-tls\") pod \"maas-api-58b59bbf57-5vcwr\" (UID: \"830319b1-3cae-454d-b52c-45f2256c543d\") " pod="opendatahub/maas-api-58b59bbf57-5vcwr" Jun 11 10:17:11.358475 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.358404 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9szsf\" (UniqueName: \"kubernetes.io/projected/830319b1-3cae-454d-b52c-45f2256c543d-kube-api-access-9szsf\") pod \"maas-api-58b59bbf57-5vcwr\" (UID: \"830319b1-3cae-454d-b52c-45f2256c543d\") " pod="opendatahub/maas-api-58b59bbf57-5vcwr" Jun 11 10:17:11.360697 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.360676 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/830319b1-3cae-454d-b52c-45f2256c543d-maas-api-tls\") pod \"maas-api-58b59bbf57-5vcwr\" (UID: \"830319b1-3cae-454d-b52c-45f2256c543d\") " pod="opendatahub/maas-api-58b59bbf57-5vcwr" Jun 11 10:17:11.368022 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.367995 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9szsf\" (UniqueName: \"kubernetes.io/projected/830319b1-3cae-454d-b52c-45f2256c543d-kube-api-access-9szsf\") pod \"maas-api-58b59bbf57-5vcwr\" (UID: \"830319b1-3cae-454d-b52c-45f2256c543d\") " pod="opendatahub/maas-api-58b59bbf57-5vcwr" Jun 11 10:17:11.446999 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.446928 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-58b59bbf57-5vcwr" Jun 11 10:17:11.582531 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.582496 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-cwp48"] Jun 11 10:17:11.586056 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.586035 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-cwp48" Jun 11 10:17:11.589192 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.589172 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 10:17:11.589296 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.589199 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-58b59bbf57-5vcwr"] Jun 11 10:17:11.592498 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:17:11.592445 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830319b1_3cae_454d_b52c_45f2256c543d.slice/crio-859f54f7c1104dd9aa2c71040b7f7359e201f356488d5a4565b497177acd7a23 WatchSource:0}: Error finding container 859f54f7c1104dd9aa2c71040b7f7359e201f356488d5a4565b497177acd7a23: Status 404 returned error can't find the container with id 859f54f7c1104dd9aa2c71040b7f7359e201f356488d5a4565b497177acd7a23 Jun 11 10:17:11.595715 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.595679 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-cwp48"] Jun 11 10:17:11.617733 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.617656 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-8jzhl"] Jun 11 10:17:11.621113 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.621088 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-8jzhl" Jun 11 10:17:11.624018 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.623994 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pl5xb\"" Jun 11 10:17:11.630859 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.630834 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-8jzhl"] Jun 11 10:17:11.661055 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.661021 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-277l6\" (UniqueName: \"kubernetes.io/projected/fab9dc7e-3558-42bf-81f0-6805eb2a3b4f-kube-api-access-277l6\") pod \"payload-pre-processing-579785bc64-cwp48\" (UID: \"fab9dc7e-3558-42bf-81f0-6805eb2a3b4f\") " pod="openshift-ingress/payload-pre-processing-579785bc64-cwp48" Jun 11 10:17:11.667485 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.667459 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-58b59bbf57-5vcwr" event={"ID":"830319b1-3cae-454d-b52c-45f2256c543d","Type":"ContainerStarted","Data":"859f54f7c1104dd9aa2c71040b7f7359e201f356488d5a4565b497177acd7a23"} Jun 11 10:17:11.761842 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.761786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-277l6\" (UniqueName: \"kubernetes.io/projected/fab9dc7e-3558-42bf-81f0-6805eb2a3b4f-kube-api-access-277l6\") pod \"payload-pre-processing-579785bc64-cwp48\" (UID: \"fab9dc7e-3558-42bf-81f0-6805eb2a3b4f\") " pod="openshift-ingress/payload-pre-processing-579785bc64-cwp48" Jun 11 10:17:11.762038 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.761906 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcgv6\" (UniqueName: \"kubernetes.io/projected/538549fd-7425-44cb-ae6a-0dde1dd38a1a-kube-api-access-bcgv6\") pod \"payload-processing-699b6cd6c-8jzhl\" (UID: \"538549fd-7425-44cb-ae6a-0dde1dd38a1a\") " pod="openshift-ingress/payload-processing-699b6cd6c-8jzhl" Jun 11 10:17:11.770848 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.770809 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-277l6\" (UniqueName: \"kubernetes.io/projected/fab9dc7e-3558-42bf-81f0-6805eb2a3b4f-kube-api-access-277l6\") pod \"payload-pre-processing-579785bc64-cwp48\" (UID: \"fab9dc7e-3558-42bf-81f0-6805eb2a3b4f\") " pod="openshift-ingress/payload-pre-processing-579785bc64-cwp48" Jun 11 10:17:11.863371 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.863335 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcgv6\" (UniqueName: \"kubernetes.io/projected/538549fd-7425-44cb-ae6a-0dde1dd38a1a-kube-api-access-bcgv6\") pod \"payload-processing-699b6cd6c-8jzhl\" (UID: \"538549fd-7425-44cb-ae6a-0dde1dd38a1a\") " pod="openshift-ingress/payload-processing-699b6cd6c-8jzhl" Jun 11 10:17:11.873272 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.873199 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcgv6\" (UniqueName: \"kubernetes.io/projected/538549fd-7425-44cb-ae6a-0dde1dd38a1a-kube-api-access-bcgv6\") pod \"payload-processing-699b6cd6c-8jzhl\" (UID: \"538549fd-7425-44cb-ae6a-0dde1dd38a1a\") " pod="openshift-ingress/payload-processing-699b6cd6c-8jzhl" Jun 11 10:17:11.900042 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.900007 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-cwp48" Jun 11 10:17:11.933105 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:11.933074 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-8jzhl" Jun 11 10:17:12.048597 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:12.048559 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-cwp48"] Jun 11 10:17:12.052846 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:17:12.052813 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab9dc7e_3558_42bf_81f0_6805eb2a3b4f.slice/crio-fcc3b1af550eda593edd94cef08eacb5deb70a182c601df4e212a4a459292a3f WatchSource:0}: Error finding container fcc3b1af550eda593edd94cef08eacb5deb70a182c601df4e212a4a459292a3f: Status 404 returned error can't find the container with id fcc3b1af550eda593edd94cef08eacb5deb70a182c601df4e212a4a459292a3f Jun 11 10:17:12.081343 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:12.081317 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-8jzhl"] Jun 11 10:17:12.083596 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:17:12.083567 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod538549fd_7425_44cb_ae6a_0dde1dd38a1a.slice/crio-b456c470330bfc25048864bbe457a2b257e875bd342c14669e1343ecfdc25caa WatchSource:0}: Error finding container b456c470330bfc25048864bbe457a2b257e875bd342c14669e1343ecfdc25caa: Status 404 returned error can't find the container with id b456c470330bfc25048864bbe457a2b257e875bd342c14669e1343ecfdc25caa Jun 11 10:17:12.675367 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:12.675326 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-8jzhl" event={"ID":"538549fd-7425-44cb-ae6a-0dde1dd38a1a","Type":"ContainerStarted","Data":"b456c470330bfc25048864bbe457a2b257e875bd342c14669e1343ecfdc25caa"} Jun 11 10:17:12.676675 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:12.676648 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-cwp48" event={"ID":"fab9dc7e-3558-42bf-81f0-6805eb2a3b4f","Type":"ContainerStarted","Data":"fcc3b1af550eda593edd94cef08eacb5deb70a182c601df4e212a4a459292a3f"} Jun 11 10:17:14.694396 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:14.694354 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-58b59bbf57-5vcwr" event={"ID":"830319b1-3cae-454d-b52c-45f2256c543d","Type":"ContainerStarted","Data":"579b6f11edeeeeb2ce51b7cd68bb62853a228caf753d9819c455710a6c959226"} Jun 11 10:17:14.694786 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:14.694459 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-58b59bbf57-5vcwr" Jun 11 10:17:14.713709 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:14.713652 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-58b59bbf57-5vcwr" podStartSLOduration=1.663868564 podStartE2EDuration="3.713632179s" totalImagesPullingTime="2.049763615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:17:14.71206506 +0000 UTC m=+886.873362119" watchObservedRunningTime="2026-06-11 10:17:14.713632179 +0000 UTC m=+886.874929242" Jun 11 10:17:15.701286 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:15.701250 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-8jzhl" event={"ID":"538549fd-7425-44cb-ae6a-0dde1dd38a1a","Type":"ContainerStarted","Data":"87870caaa585de0bb770569dbd4581f35c3724404a32aa67d16255aa8b2bc04b"} Jun 11 10:17:15.701762 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:15.701369 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-8jzhl" Jun 11 10:17:15.702788 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:15.702765 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-cwp48" event={"ID":"fab9dc7e-3558-42bf-81f0-6805eb2a3b4f","Type":"ContainerStarted","Data":"90db9607fb7f7491f94ddd1d27b831c195541504b2ec0bcc3e90e4cab899f6a1"} Jun 11 10:17:15.702884 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:15.702807 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-cwp48" Jun 11 10:17:15.717970 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:15.717929 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-8jzhl" podStartSLOduration=2.09274557 podStartE2EDuration="4.717915501s" totalImagesPullingTime="2.625169931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:17:15.716525344 +0000 UTC m=+887.877822427" watchObservedRunningTime="2026-06-11 10:17:15.717915501 +0000 UTC m=+887.879212537" Jun 11 10:17:15.732048 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:15.732002 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-cwp48" podStartSLOduration=2.082771108 podStartE2EDuration="4.731989426s" totalImagesPullingTime="2.649218318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:17:15.73151356 +0000 UTC m=+887.892810628" watchObservedRunningTime="2026-06-11 10:17:15.731989426 +0000 UTC m=+887.893286484" Jun 11 10:17:20.708657 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:20.708626 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-58b59bbf57-5vcwr" Jun 11 10:17:26.708924 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:26.708877 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-8jzhl" Jun 11 10:17:26.709439 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:26.709110 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-cwp48" Jun 11 10:17:28.333311 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:28.333282 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:17:28.334531 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:17:28.334503 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:18:05.118180 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.118146 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5"] Jun 11 10:18:05.121271 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.121253 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.125877 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.125853 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 10:18:05.125877 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.125865 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 10:18:05.126051 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.125884 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d4pv8\"" Jun 11 10:18:05.126051 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.125865 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 10:18:05.132740 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.132716 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5"] Jun 11 10:18:05.210861 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.210824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6p8p\" (UniqueName: \"kubernetes.io/projected/f248912b-8920-4f93-88e4-593c7de807ab-kube-api-access-s6p8p\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.210861 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.210861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f248912b-8920-4f93-88e4-593c7de807ab-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.211064 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.210896 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f248912b-8920-4f93-88e4-593c7de807ab-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.211064 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.210943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f248912b-8920-4f93-88e4-593c7de807ab-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.211064 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.210961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f248912b-8920-4f93-88e4-593c7de807ab-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.211064 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.210988 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f248912b-8920-4f93-88e4-593c7de807ab-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.311564 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.311526 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f248912b-8920-4f93-88e4-593c7de807ab-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.311742 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.311574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f248912b-8920-4f93-88e4-593c7de807ab-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.311742 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.311685 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f248912b-8920-4f93-88e4-593c7de807ab-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.311830 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.311762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f248912b-8920-4f93-88e4-593c7de807ab-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.311872 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.311834 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6p8p\" (UniqueName: \"kubernetes.io/projected/f248912b-8920-4f93-88e4-593c7de807ab-kube-api-access-s6p8p\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.311917 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.311869 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f248912b-8920-4f93-88e4-593c7de807ab-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.311917 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.311893 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f248912b-8920-4f93-88e4-593c7de807ab-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.312101 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.312081 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f248912b-8920-4f93-88e4-593c7de807ab-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.312225 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.312208 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f248912b-8920-4f93-88e4-593c7de807ab-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.314005 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.313975 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f248912b-8920-4f93-88e4-593c7de807ab-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.314199 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.314182 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f248912b-8920-4f93-88e4-593c7de807ab-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.321000 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.320976 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6p8p\" (UniqueName: \"kubernetes.io/projected/f248912b-8920-4f93-88e4-593c7de807ab-kube-api-access-s6p8p\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5\" (UID: \"f248912b-8920-4f93-88e4-593c7de807ab\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.431475 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.431378 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:05.569448 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.569420 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5"] Jun 11 10:18:05.572472 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:18:05.572446 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf248912b_8920_4f93_88e4_593c7de807ab.slice/crio-99c25bae9a555a74c30e788beafb216d555154212999a991e60bae0df0a7f28c WatchSource:0}: Error finding container 99c25bae9a555a74c30e788beafb216d555154212999a991e60bae0df0a7f28c: Status 404 returned error can't find the container with id 99c25bae9a555a74c30e788beafb216d555154212999a991e60bae0df0a7f28c Jun 11 10:18:05.574859 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.574840 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 10:18:05.931843 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:05.931804 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" event={"ID":"f248912b-8920-4f93-88e4-593c7de807ab","Type":"ContainerStarted","Data":"99c25bae9a555a74c30e788beafb216d555154212999a991e60bae0df0a7f28c"} Jun 11 10:18:09.955341 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:09.955306 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" event={"ID":"f248912b-8920-4f93-88e4-593c7de807ab","Type":"ContainerStarted","Data":"40ab8e165b45333a32b4053e2b7011202ad0716e62329a81eda386a884073852"} Jun 11 10:18:10.961447 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:10.961413 2575 generic.go:356] "Generic (PLEG): container finished" podID="f248912b-8920-4f93-88e4-593c7de807ab" containerID="40ab8e165b45333a32b4053e2b7011202ad0716e62329a81eda386a884073852" exitCode=0 Jun 11 10:18:10.961849 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:10.961497 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" event={"ID":"f248912b-8920-4f93-88e4-593c7de807ab","Type":"ContainerDied","Data":"40ab8e165b45333a32b4053e2b7011202ad0716e62329a81eda386a884073852"} Jun 11 10:18:12.974261 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:12.974219 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" event={"ID":"f248912b-8920-4f93-88e4-593c7de807ab","Type":"ContainerStarted","Data":"c159cd52f5ce0a98713683d3a6e47c6fa42aa927dea6d46f074eb4707a512a85"} Jun 11 10:18:12.994756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:12.994692 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" podStartSLOduration=1.650835209 podStartE2EDuration="7.994673321s" totalImagesPullingTime="4.924649814s" totalInitContainerRuntime="1.419188298s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:18:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:18:12.99357106 +0000 UTC m=+945.154868123" watchObservedRunningTime="2026-06-11 10:18:12.994673321 +0000 UTC m=+945.155970382" Jun 11 10:18:15.432266 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:15.432219 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:15.432266 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:15.432285 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:15.444994 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:15.444966 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:15.999772 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:15.999739 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5" Jun 11 10:18:27.808268 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:27.808235 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr"] Jun 11 10:18:27.821799 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:27.821765 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:27.822303 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:27.822276 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr"] Jun 11 10:18:27.824752 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:27.824731 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 10:18:27.906529 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:27.906490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htlnf\" (UniqueName: \"kubernetes.io/projected/093e9280-e26a-4f2f-8b7c-6377b73d7769-kube-api-access-htlnf\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:27.906695 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:27.906559 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/093e9280-e26a-4f2f-8b7c-6377b73d7769-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:27.906695 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:27.906585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/093e9280-e26a-4f2f-8b7c-6377b73d7769-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:27.906695 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:27.906608 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/093e9280-e26a-4f2f-8b7c-6377b73d7769-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:27.906695 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:27.906629 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/093e9280-e26a-4f2f-8b7c-6377b73d7769-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:27.906831 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:27.906709 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/093e9280-e26a-4f2f-8b7c-6377b73d7769-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.007615 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.007576 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/093e9280-e26a-4f2f-8b7c-6377b73d7769-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.007808 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.007627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htlnf\" (UniqueName: \"kubernetes.io/projected/093e9280-e26a-4f2f-8b7c-6377b73d7769-kube-api-access-htlnf\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.007808 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.007691 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/093e9280-e26a-4f2f-8b7c-6377b73d7769-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.007808 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.007715 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/093e9280-e26a-4f2f-8b7c-6377b73d7769-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.007808 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.007746 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/093e9280-e26a-4f2f-8b7c-6377b73d7769-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.007808 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.007775 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/093e9280-e26a-4f2f-8b7c-6377b73d7769-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.008112 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.008091 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/093e9280-e26a-4f2f-8b7c-6377b73d7769-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.008216 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.008165 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/093e9280-e26a-4f2f-8b7c-6377b73d7769-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.008216 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.008203 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/093e9280-e26a-4f2f-8b7c-6377b73d7769-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.009835 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.009814 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/093e9280-e26a-4f2f-8b7c-6377b73d7769-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.010154 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.010136 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/093e9280-e26a-4f2f-8b7c-6377b73d7769-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.015808 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.015788 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htlnf\" (UniqueName: \"kubernetes.io/projected/093e9280-e26a-4f2f-8b7c-6377b73d7769-kube-api-access-htlnf\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9cvrr\" (UID: \"093e9280-e26a-4f2f-8b7c-6377b73d7769\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.132775 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.132691 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:18:28.274681 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:28.274654 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr"] Jun 11 10:18:28.276742 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:18:28.276713 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093e9280_e26a_4f2f_8b7c_6377b73d7769.slice/crio-a38da748c55d8836171e86053b6c0f96de70cc00b975476671d6dc71c7b160ff WatchSource:0}: Error finding container a38da748c55d8836171e86053b6c0f96de70cc00b975476671d6dc71c7b160ff: Status 404 returned error can't find the container with id a38da748c55d8836171e86053b6c0f96de70cc00b975476671d6dc71c7b160ff Jun 11 10:18:29.056874 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:29.056835 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" event={"ID":"093e9280-e26a-4f2f-8b7c-6377b73d7769","Type":"ContainerStarted","Data":"9a271f015096bb8e628ebab7aad4d8202f6882c9d870df4e12b89f0d01f5ca20"} Jun 11 10:18:29.057357 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:29.056900 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" event={"ID":"093e9280-e26a-4f2f-8b7c-6377b73d7769","Type":"ContainerStarted","Data":"a38da748c55d8836171e86053b6c0f96de70cc00b975476671d6dc71c7b160ff"} Jun 11 10:18:40.919802 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:40.919766 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4"] Jun 11 10:18:40.924679 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:40.924655 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:40.927762 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:40.927740 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 10:18:40.935354 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:40.935329 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4"] Jun 11 10:18:41.024023 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.023983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78261f2b-0f1d-43bf-8146-f10a9ea48574-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.024023 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.024025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78261f2b-0f1d-43bf-8146-f10a9ea48574-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.024254 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.024161 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78261f2b-0f1d-43bf-8146-f10a9ea48574-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.024254 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.024190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbr6d\" (UniqueName: \"kubernetes.io/projected/78261f2b-0f1d-43bf-8146-f10a9ea48574-kube-api-access-fbr6d\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.024254 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.024227 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78261f2b-0f1d-43bf-8146-f10a9ea48574-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.024353 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.024274 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78261f2b-0f1d-43bf-8146-f10a9ea48574-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.125544 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.125505 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78261f2b-0f1d-43bf-8146-f10a9ea48574-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.125544 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.125541 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbr6d\" (UniqueName: \"kubernetes.io/projected/78261f2b-0f1d-43bf-8146-f10a9ea48574-kube-api-access-fbr6d\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.125766 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.125569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78261f2b-0f1d-43bf-8146-f10a9ea48574-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.125766 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.125616 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78261f2b-0f1d-43bf-8146-f10a9ea48574-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.125766 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.125650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78261f2b-0f1d-43bf-8146-f10a9ea48574-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.125925 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.125803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78261f2b-0f1d-43bf-8146-f10a9ea48574-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.126058 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.126037 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78261f2b-0f1d-43bf-8146-f10a9ea48574-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.126154 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.126055 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78261f2b-0f1d-43bf-8146-f10a9ea48574-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.126236 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.126210 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78261f2b-0f1d-43bf-8146-f10a9ea48574-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.127785 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.127768 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78261f2b-0f1d-43bf-8146-f10a9ea48574-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.128085 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.128066 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78261f2b-0f1d-43bf-8146-f10a9ea48574-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.134638 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.134616 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbr6d\" (UniqueName: \"kubernetes.io/projected/78261f2b-0f1d-43bf-8146-f10a9ea48574-kube-api-access-fbr6d\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4\" (UID: \"78261f2b-0f1d-43bf-8146-f10a9ea48574\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.236074 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.236035 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:41.376383 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:41.376349 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4"] Jun 11 10:18:42.117791 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:42.117751 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" event={"ID":"78261f2b-0f1d-43bf-8146-f10a9ea48574","Type":"ContainerStarted","Data":"93d3ef35305901b8c7d50b7767a190fef4c88652338542ccb87a601c2ab973b2"} Jun 11 10:18:42.118210 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:42.117809 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" event={"ID":"78261f2b-0f1d-43bf-8146-f10a9ea48574","Type":"ContainerStarted","Data":"aaadb15f2cca3bea3a00fec6828cbc832b8e49844b1ff03f3f252ea5061fe8f5"} Jun 11 10:18:43.124433 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:43.124334 2575 generic.go:356] "Generic (PLEG): container finished" podID="78261f2b-0f1d-43bf-8146-f10a9ea48574" containerID="93d3ef35305901b8c7d50b7767a190fef4c88652338542ccb87a601c2ab973b2" exitCode=0 Jun 11 10:18:43.124433 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:43.124417 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" event={"ID":"78261f2b-0f1d-43bf-8146-f10a9ea48574","Type":"ContainerDied","Data":"93d3ef35305901b8c7d50b7767a190fef4c88652338542ccb87a601c2ab973b2"} Jun 11 10:18:44.130771 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:44.130733 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" event={"ID":"78261f2b-0f1d-43bf-8146-f10a9ea48574","Type":"ContainerStarted","Data":"80af7edc39c2e935eb4d56987d552148e11182f316b7c65166509ca7bc3138af"} Jun 11 10:18:44.154967 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:44.154915 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" podStartSLOduration=2.591202553 podStartE2EDuration="4.154896423s" totalImagesPullingTime="204.3993ms" totalInitContainerRuntime="1.35929457s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:18:44.152714992 +0000 UTC m=+976.314012068" watchObservedRunningTime="2026-06-11 10:18:44.154896423 +0000 UTC m=+976.316193485" Jun 11 10:18:48.900084 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:48.900044 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh"] Jun 11 10:18:48.905230 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:48.905209 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:48.908110 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:48.908082 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 10:18:48.911659 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:48.911634 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh"] Jun 11 10:18:48.996456 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:48.996423 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmzwh\" (UniqueName: \"kubernetes.io/projected/14624d4a-f268-44d3-bc41-1f63af0e2601-kube-api-access-cmzwh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:48.996456 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:48.996459 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14624d4a-f268-44d3-bc41-1f63af0e2601-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:48.996704 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:48.996496 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14624d4a-f268-44d3-bc41-1f63af0e2601-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:48.996704 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:48.996531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14624d4a-f268-44d3-bc41-1f63af0e2601-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:48.996704 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:48.996617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14624d4a-f268-44d3-bc41-1f63af0e2601-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:48.996812 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:48.996706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14624d4a-f268-44d3-bc41-1f63af0e2601-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.097634 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.097600 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmzwh\" (UniqueName: \"kubernetes.io/projected/14624d4a-f268-44d3-bc41-1f63af0e2601-kube-api-access-cmzwh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.097634 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.097639 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14624d4a-f268-44d3-bc41-1f63af0e2601-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.097873 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.097664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14624d4a-f268-44d3-bc41-1f63af0e2601-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.097873 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.097695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14624d4a-f268-44d3-bc41-1f63af0e2601-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.097873 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.097734 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14624d4a-f268-44d3-bc41-1f63af0e2601-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.097873 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.097780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14624d4a-f268-44d3-bc41-1f63af0e2601-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.098164 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.098102 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14624d4a-f268-44d3-bc41-1f63af0e2601-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.098281 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.098171 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14624d4a-f268-44d3-bc41-1f63af0e2601-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.098281 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.098195 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14624d4a-f268-44d3-bc41-1f63af0e2601-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.099939 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.099917 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14624d4a-f268-44d3-bc41-1f63af0e2601-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.100257 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.100240 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14624d4a-f268-44d3-bc41-1f63af0e2601-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.106095 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.106074 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmzwh\" (UniqueName: \"kubernetes.io/projected/14624d4a-f268-44d3-bc41-1f63af0e2601-kube-api-access-cmzwh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh\" (UID: \"14624d4a-f268-44d3-bc41-1f63af0e2601\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.218569 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.218528 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:49.365093 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:49.365063 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh"] Jun 11 10:18:49.366962 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:18:49.366925 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14624d4a_f268_44d3_bc41_1f63af0e2601.slice/crio-52256d42e8ebd63afe65d0aafb1e05e740690f8e7cbddffb3d54292af1ea7b27 WatchSource:0}: Error finding container 52256d42e8ebd63afe65d0aafb1e05e740690f8e7cbddffb3d54292af1ea7b27: Status 404 returned error can't find the container with id 52256d42e8ebd63afe65d0aafb1e05e740690f8e7cbddffb3d54292af1ea7b27 Jun 11 10:18:50.166970 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:50.166932 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" event={"ID":"14624d4a-f268-44d3-bc41-1f63af0e2601","Type":"ContainerStarted","Data":"e7fcbf71ed077df4b35aee1b2a6ed1425dc38f0fefaed8f399858f6f60e8f5b6"} Jun 11 10:18:50.167396 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:50.166988 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" event={"ID":"14624d4a-f268-44d3-bc41-1f63af0e2601","Type":"ContainerStarted","Data":"52256d42e8ebd63afe65d0aafb1e05e740690f8e7cbddffb3d54292af1ea7b27"} Jun 11 10:18:51.173185 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:51.173091 2575 generic.go:356] "Generic (PLEG): container finished" podID="14624d4a-f268-44d3-bc41-1f63af0e2601" containerID="e7fcbf71ed077df4b35aee1b2a6ed1425dc38f0fefaed8f399858f6f60e8f5b6" exitCode=0 Jun 11 10:18:51.173533 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:51.173178 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" event={"ID":"14624d4a-f268-44d3-bc41-1f63af0e2601","Type":"ContainerDied","Data":"e7fcbf71ed077df4b35aee1b2a6ed1425dc38f0fefaed8f399858f6f60e8f5b6"} Jun 11 10:18:51.237081 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:51.237037 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:51.237322 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:51.237147 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:51.249761 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:51.249733 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:52.188692 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:52.188664 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4" Jun 11 10:18:57.205681 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:57.205645 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" event={"ID":"14624d4a-f268-44d3-bc41-1f63af0e2601","Type":"ContainerStarted","Data":"0bce1421405d59e0e131ecce34d44490587e058704d124d2d9aff2f983b99120"} Jun 11 10:18:57.225182 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:57.225111 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" podStartSLOduration=2.547625782 podStartE2EDuration="9.225097808s" totalImagesPullingTime="5.307388312s" totalInitContainerRuntime="1.370083714s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:18:57.224279307 +0000 UTC m=+989.385576377" watchObservedRunningTime="2026-06-11 10:18:57.225097808 +0000 UTC m=+989.386394866" Jun 11 10:18:59.218803 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:59.218772 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:59.219182 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:59.218826 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:18:59.231393 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:18:59.231367 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:19:00.231037 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:00.231007 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh" Jun 11 10:19:00.998698 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:00.998657 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc"] Jun 11 10:19:01.003073 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.003048 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.005879 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.005857 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 10:19:01.014625 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.014596 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc"] Jun 11 10:19:01.107241 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.107200 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2s6z\" (UniqueName: \"kubernetes.io/projected/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-kube-api-access-j2s6z\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.107426 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.107312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.107426 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.107371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.107426 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.107417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.107547 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.107435 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.107547 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.107479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.208848 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.208811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.209029 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.208868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.209029 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.208921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.209029 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.208947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.209029 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.208990 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.209252 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.209043 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2s6z\" (UniqueName: \"kubernetes.io/projected/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-kube-api-access-j2s6z\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.209425 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.209398 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.209526 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.209459 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.209568 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.209544 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.211395 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.211363 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.211651 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.211629 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.217769 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.217746 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2s6z\" (UniqueName: \"kubernetes.io/projected/ad6772c5-0b71-48b8-84a8-50d9a44c3ef1-kube-api-access-j2s6z\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-shwxc\" (UID: \"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.316798 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.316710 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:01.454007 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:01.453976 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc"] Jun 11 10:19:01.456579 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:19:01.456548 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6772c5_0b71_48b8_84a8_50d9a44c3ef1.slice/crio-4d22dc55f9fc30becffe31953be90335b029dfe9bd1dfdd55e7fd12935656f55 WatchSource:0}: Error finding container 4d22dc55f9fc30becffe31953be90335b029dfe9bd1dfdd55e7fd12935656f55: Status 404 returned error can't find the container with id 4d22dc55f9fc30becffe31953be90335b029dfe9bd1dfdd55e7fd12935656f55 Jun 11 10:19:02.231780 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:02.231743 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" event={"ID":"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1","Type":"ContainerStarted","Data":"3502472cbcdeba1fb06982d3e5b6ea84640beb7ebfa627cdbd65651431f93315"} Jun 11 10:19:02.231980 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:02.231803 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" event={"ID":"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1","Type":"ContainerStarted","Data":"4d22dc55f9fc30becffe31953be90335b029dfe9bd1dfdd55e7fd12935656f55"} Jun 11 10:19:04.244036 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:04.244003 2575 generic.go:356] "Generic (PLEG): container finished" podID="ad6772c5-0b71-48b8-84a8-50d9a44c3ef1" containerID="3502472cbcdeba1fb06982d3e5b6ea84640beb7ebfa627cdbd65651431f93315" exitCode=0 Jun 11 10:19:04.244409 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:04.244083 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" event={"ID":"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1","Type":"ContainerDied","Data":"3502472cbcdeba1fb06982d3e5b6ea84640beb7ebfa627cdbd65651431f93315"} Jun 11 10:19:06.085330 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.085295 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7"] Jun 11 10:19:06.093662 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.093633 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.096768 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.096734 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 10:19:06.101595 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.101568 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7"] Jun 11 10:19:06.256349 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.256315 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" event={"ID":"ad6772c5-0b71-48b8-84a8-50d9a44c3ef1","Type":"ContainerStarted","Data":"5f6b2fdf2c80285a7d0164a24c558adbe953bd9c1b5b7467ecc3dd11dfd31cb6"} Jun 11 10:19:06.259083 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.259055 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31a15579-03a5-456a-b590-4c89c1983ae4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.259242 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.259197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31a15579-03a5-456a-b590-4c89c1983ae4-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.259242 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.259226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/31a15579-03a5-456a-b590-4c89c1983ae4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.259344 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.259264 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31a15579-03a5-456a-b590-4c89c1983ae4-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.259344 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.259284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tkdj\" (UniqueName: \"kubernetes.io/projected/31a15579-03a5-456a-b590-4c89c1983ae4-kube-api-access-9tkdj\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.259436 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.259413 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31a15579-03a5-456a-b590-4c89c1983ae4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.275436 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.275391 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" podStartSLOduration=3.155702146 podStartE2EDuration="6.275376246s" totalImagesPullingTime="1.245376339s" totalInitContainerRuntime="1.874297761s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:19:06.274000903 +0000 UTC m=+998.435297972" watchObservedRunningTime="2026-06-11 10:19:06.275376246 +0000 UTC m=+998.436673303" Jun 11 10:19:06.360835 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.360742 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31a15579-03a5-456a-b590-4c89c1983ae4-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.360835 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.360779 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/31a15579-03a5-456a-b590-4c89c1983ae4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.360835 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.360806 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31a15579-03a5-456a-b590-4c89c1983ae4-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.360835 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.360829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tkdj\" (UniqueName: \"kubernetes.io/projected/31a15579-03a5-456a-b590-4c89c1983ae4-kube-api-access-9tkdj\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.361220 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.360912 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31a15579-03a5-456a-b590-4c89c1983ae4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.361220 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.360962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31a15579-03a5-456a-b590-4c89c1983ae4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.361377 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.361352 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31a15579-03a5-456a-b590-4c89c1983ae4-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.361439 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.361388 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31a15579-03a5-456a-b590-4c89c1983ae4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.361593 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.361564 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/31a15579-03a5-456a-b590-4c89c1983ae4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.363112 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.363093 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31a15579-03a5-456a-b590-4c89c1983ae4-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.363444 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.363426 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31a15579-03a5-456a-b590-4c89c1983ae4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.369128 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.369091 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tkdj\" (UniqueName: \"kubernetes.io/projected/31a15579-03a5-456a-b590-4c89c1983ae4-kube-api-access-9tkdj\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-b4bs7\" (UID: \"31a15579-03a5-456a-b590-4c89c1983ae4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.406084 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.406054 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:06.540577 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:06.540541 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7"] Jun 11 10:19:06.541828 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:19:06.541801 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a15579_03a5_456a_b590_4c89c1983ae4.slice/crio-e7db1420843312590ba224b36ed5f7c5bc3f6126c6609e1d400356a993227650 WatchSource:0}: Error finding container e7db1420843312590ba224b36ed5f7c5bc3f6126c6609e1d400356a993227650: Status 404 returned error can't find the container with id e7db1420843312590ba224b36ed5f7c5bc3f6126c6609e1d400356a993227650 Jun 11 10:19:07.264271 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:07.264238 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" event={"ID":"31a15579-03a5-456a-b590-4c89c1983ae4","Type":"ContainerStarted","Data":"3e3be09d9f6610ede27ec0839ed9b35ae2410489ff339e43cc0d2856483ac01a"} Jun 11 10:19:07.264701 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:07.264295 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" event={"ID":"31a15579-03a5-456a-b590-4c89c1983ae4","Type":"ContainerStarted","Data":"e7db1420843312590ba224b36ed5f7c5bc3f6126c6609e1d400356a993227650"} Jun 11 10:19:08.270359 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:08.270318 2575 generic.go:356] "Generic (PLEG): container finished" podID="31a15579-03a5-456a-b590-4c89c1983ae4" containerID="3e3be09d9f6610ede27ec0839ed9b35ae2410489ff339e43cc0d2856483ac01a" exitCode=0 Jun 11 10:19:08.270759 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:08.270374 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" event={"ID":"31a15579-03a5-456a-b590-4c89c1983ae4","Type":"ContainerDied","Data":"3e3be09d9f6610ede27ec0839ed9b35ae2410489ff339e43cc0d2856483ac01a"} Jun 11 10:19:09.277546 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:09.277507 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" event={"ID":"31a15579-03a5-456a-b590-4c89c1983ae4","Type":"ContainerStarted","Data":"ab48a9670e46b50dbf349a0b3eef83d5ef8d229bd4689d01387ee91a3eea9e63"} Jun 11 10:19:09.298726 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:09.298666 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" podStartSLOduration=1.497042287 podStartE2EDuration="3.298648494s" totalImagesPullingTime="289.463694ms" totalInitContainerRuntime="1.512142513s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:19:09.296874215 +0000 UTC m=+1001.458171298" watchObservedRunningTime="2026-06-11 10:19:09.298648494 +0000 UTC m=+1001.459945551" Jun 11 10:19:11.316980 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:11.316947 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:11.317509 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:11.317034 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:11.329537 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:11.329513 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:12.311834 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:12.311800 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-shwxc" Jun 11 10:19:16.406980 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:16.406938 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:16.407439 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:16.406996 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:16.419756 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:16.419729 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:17.335405 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:17.335377 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-b4bs7" Jun 11 10:19:22.354138 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:22.354039 2575 generic.go:356] "Generic (PLEG): container finished" podID="093e9280-e26a-4f2f-8b7c-6377b73d7769" containerID="9a271f015096bb8e628ebab7aad4d8202f6882c9d870df4e12b89f0d01f5ca20" exitCode=0 Jun 11 10:19:22.354138 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:22.354076 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" event={"ID":"093e9280-e26a-4f2f-8b7c-6377b73d7769","Type":"ContainerDied","Data":"9a271f015096bb8e628ebab7aad4d8202f6882c9d870df4e12b89f0d01f5ca20"} Jun 11 10:19:23.360766 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:23.360730 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" event={"ID":"093e9280-e26a-4f2f-8b7c-6377b73d7769","Type":"ContainerStarted","Data":"1346bbc7ab26ba752aa8e0ebd784b8d678b0a196fb9e63e4f3ed711f3b93649a"} Jun 11 10:19:23.399963 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:23.399901 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" podStartSLOduration=2.553407511 podStartE2EDuration="56.399884182s" totalImagesPullingTime="228.221078ms" totalInitContainerRuntime="53.618255593s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:19:23.399497755 +0000 UTC m=+1015.560794810" watchObservedRunningTime="2026-06-11 10:19:23.399884182 +0000 UTC m=+1015.561181277" Jun 11 10:19:28.133485 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:28.133432 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:19:28.133968 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:28.133513 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:19:28.146399 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:28.146373 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:19:28.396201 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:19:28.396091 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9cvrr" Jun 11 10:21:38.501784 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:38.501744 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c8d5c9cb8-t85tl"] Jun 11 10:21:38.502423 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:38.501991 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" podUID="a1c17208-a031-4706-a628-5574d2c859d0" containerName="manager" containerID="cri-o://9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f" gracePeriod=30 Jun 11 10:21:38.765308 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:38.765251 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" Jun 11 10:21:38.857481 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:38.857448 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5wv5\" (UniqueName: \"kubernetes.io/projected/a1c17208-a031-4706-a628-5574d2c859d0-kube-api-access-s5wv5\") pod \"a1c17208-a031-4706-a628-5574d2c859d0\" (UID: \"a1c17208-a031-4706-a628-5574d2c859d0\") " Jun 11 10:21:38.859486 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:38.859461 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1c17208-a031-4706-a628-5574d2c859d0-kube-api-access-s5wv5" (OuterVolumeSpecName: "kube-api-access-s5wv5") pod "a1c17208-a031-4706-a628-5574d2c859d0" (UID: "a1c17208-a031-4706-a628-5574d2c859d0"). InnerVolumeSpecName "kube-api-access-s5wv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:21:38.958050 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:38.958010 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1c17208-a031-4706-a628-5574d2c859d0-webhook-cert\") pod \"a1c17208-a031-4706-a628-5574d2c859d0\" (UID: \"a1c17208-a031-4706-a628-5574d2c859d0\") " Jun 11 10:21:38.958250 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:38.958189 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5wv5\" (UniqueName: \"kubernetes.io/projected/a1c17208-a031-4706-a628-5574d2c859d0-kube-api-access-s5wv5\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:21:38.960071 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:38.960030 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1c17208-a031-4706-a628-5574d2c859d0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a1c17208-a031-4706-a628-5574d2c859d0" (UID: "a1c17208-a031-4706-a628-5574d2c859d0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:21:39.032896 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:39.032811 2575 generic.go:356] "Generic (PLEG): container finished" podID="a1c17208-a031-4706-a628-5574d2c859d0" containerID="9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f" exitCode=0 Jun 11 10:21:39.032896 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:39.032866 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" Jun 11 10:21:39.033070 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:39.032899 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" event={"ID":"a1c17208-a031-4706-a628-5574d2c859d0","Type":"ContainerDied","Data":"9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f"} Jun 11 10:21:39.033070 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:39.032978 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8d5c9cb8-t85tl" event={"ID":"a1c17208-a031-4706-a628-5574d2c859d0","Type":"ContainerDied","Data":"c5459b8f38fa90e50f158dbcc2e5f9b49b9e0c117a34a8a98d32a2e5e180778a"} Jun 11 10:21:39.033070 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:39.033001 2575 scope.go:117] "RemoveContainer" containerID="9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f" Jun 11 10:21:39.041687 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:39.041671 2575 scope.go:117] "RemoveContainer" containerID="9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f" Jun 11 10:21:39.041925 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:21:39.041904 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f\": container with ID starting with 9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f not found: ID does not exist" containerID="9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f" Jun 11 10:21:39.041973 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:39.041932 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f"} err="failed to get container status \"9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f\": rpc error: code = NotFound desc = could not find container \"9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f\": container with ID starting with 9b48c70283356eb06fbda1c04d6927175a6be5f73b545f6d0a92c3f3023fe42f not found: ID does not exist" Jun 11 10:21:39.059145 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:39.058683 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1c17208-a031-4706-a628-5574d2c859d0-webhook-cert\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:21:39.059145 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:39.058735 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c8d5c9cb8-t85tl"] Jun 11 10:21:39.061864 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:39.061843 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c8d5c9cb8-t85tl"] Jun 11 10:21:40.343727 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:21:40.343694 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1c17208-a031-4706-a628-5574d2c859d0" path="/var/lib/kubelet/pods/a1c17208-a031-4706-a628-5574d2c859d0/volumes" Jun 11 10:22:28.369372 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:22:28.369338 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:22:28.371033 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:22:28.371011 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:27:28.400352 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:27:28.400326 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:27:28.402079 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:27:28.402058 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:32:28.429405 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:32:28.429317 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:32:28.431472 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:32:28.431448 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:34:25.945987 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:25.945947 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d46c5797c-wm67m"] Jun 11 10:34:25.946486 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:25.946350 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1c17208-a031-4706-a628-5574d2c859d0" containerName="manager" Jun 11 10:34:25.946486 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:25.946362 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1c17208-a031-4706-a628-5574d2c859d0" containerName="manager" Jun 11 10:34:25.946486 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:25.946427 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1c17208-a031-4706-a628-5574d2c859d0" containerName="manager" Jun 11 10:34:25.949473 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:25.949432 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:25.963373 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:25.963344 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d46c5797c-wm67m"] Jun 11 10:34:26.070543 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.070500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f78172a9-4e6d-448c-93ac-6ef1214d6615-console-oauth-config\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.070543 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.070540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f78172a9-4e6d-448c-93ac-6ef1214d6615-console-config\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.070785 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.070568 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f78172a9-4e6d-448c-93ac-6ef1214d6615-service-ca\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.070785 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.070652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78172a9-4e6d-448c-93ac-6ef1214d6615-trusted-ca-bundle\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.070785 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.070678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f78172a9-4e6d-448c-93ac-6ef1214d6615-oauth-serving-cert\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.070785 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.070712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f78172a9-4e6d-448c-93ac-6ef1214d6615-console-serving-cert\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.070785 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.070726 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d78pc\" (UniqueName: \"kubernetes.io/projected/f78172a9-4e6d-448c-93ac-6ef1214d6615-kube-api-access-d78pc\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.171281 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.171246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78172a9-4e6d-448c-93ac-6ef1214d6615-trusted-ca-bundle\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.171281 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.171282 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f78172a9-4e6d-448c-93ac-6ef1214d6615-oauth-serving-cert\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.171532 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.171325 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f78172a9-4e6d-448c-93ac-6ef1214d6615-console-serving-cert\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.171532 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.171342 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d78pc\" (UniqueName: \"kubernetes.io/projected/f78172a9-4e6d-448c-93ac-6ef1214d6615-kube-api-access-d78pc\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.171532 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.171385 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f78172a9-4e6d-448c-93ac-6ef1214d6615-console-oauth-config\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.171532 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.171403 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f78172a9-4e6d-448c-93ac-6ef1214d6615-console-config\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.171532 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.171432 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f78172a9-4e6d-448c-93ac-6ef1214d6615-service-ca\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.172308 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.172242 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f78172a9-4e6d-448c-93ac-6ef1214d6615-service-ca\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.172308 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.172295 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f78172a9-4e6d-448c-93ac-6ef1214d6615-console-config\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.172464 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.172338 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f78172a9-4e6d-448c-93ac-6ef1214d6615-oauth-serving-cert\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.172464 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.172457 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78172a9-4e6d-448c-93ac-6ef1214d6615-trusted-ca-bundle\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.173969 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.173943 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f78172a9-4e6d-448c-93ac-6ef1214d6615-console-serving-cert\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.174317 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.174302 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f78172a9-4e6d-448c-93ac-6ef1214d6615-console-oauth-config\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.179962 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.179941 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d78pc\" (UniqueName: \"kubernetes.io/projected/f78172a9-4e6d-448c-93ac-6ef1214d6615-kube-api-access-d78pc\") pod \"console-7d46c5797c-wm67m\" (UID: \"f78172a9-4e6d-448c-93ac-6ef1214d6615\") " pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.258938 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.258898 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:26.399167 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.399142 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d46c5797c-wm67m"] Jun 11 10:34:26.400993 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:34:26.400960 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78172a9_4e6d_448c_93ac_6ef1214d6615.slice/crio-4119334536c358afb20a4ab376e9b7c9c7dc428b4b37a4d6c82bc39912e4ec2e WatchSource:0}: Error finding container 4119334536c358afb20a4ab376e9b7c9c7dc428b4b37a4d6c82bc39912e4ec2e: Status 404 returned error can't find the container with id 4119334536c358afb20a4ab376e9b7c9c7dc428b4b37a4d6c82bc39912e4ec2e Jun 11 10:34:26.806456 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.806417 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d46c5797c-wm67m" event={"ID":"f78172a9-4e6d-448c-93ac-6ef1214d6615","Type":"ContainerStarted","Data":"ccd9180365b18693065ec22c7680b9c247d082fb90b31bbbdce2d864acee8f38"} Jun 11 10:34:26.806642 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.806473 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d46c5797c-wm67m" event={"ID":"f78172a9-4e6d-448c-93ac-6ef1214d6615","Type":"ContainerStarted","Data":"4119334536c358afb20a4ab376e9b7c9c7dc428b4b37a4d6c82bc39912e4ec2e"} Jun 11 10:34:26.825850 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:26.825800 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d46c5797c-wm67m" podStartSLOduration=1.825783224 podStartE2EDuration="1.825783224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:34:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:34:26.823337306 +0000 UTC m=+1918.984634394" watchObservedRunningTime="2026-06-11 10:34:26.825783224 +0000 UTC m=+1918.987080356" Jun 11 10:34:36.259737 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:36.259700 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:36.260241 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:36.259992 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:36.264767 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:36.264743 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:36.859845 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:36.859813 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d46c5797c-wm67m" Jun 11 10:34:36.910538 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:34:36.910501 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dfd67b97-lw6j6"] Jun 11 10:35:01.930848 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:01.930799 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7dfd67b97-lw6j6" podUID="57f28e74-16b7-4409-86fb-25273a1f0c3a" containerName="console" containerID="cri-o://c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa" gracePeriod=15 Jun 11 10:35:02.173827 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.173801 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:35:02.189046 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.188968 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-oauth-serving-cert\") pod \"57f28e74-16b7-4409-86fb-25273a1f0c3a\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " Jun 11 10:35:02.189046 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.189024 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-oauth-config\") pod \"57f28e74-16b7-4409-86fb-25273a1f0c3a\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " Jun 11 10:35:02.189361 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.189053 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-config\") pod \"57f28e74-16b7-4409-86fb-25273a1f0c3a\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " Jun 11 10:35:02.189361 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.189097 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-service-ca\") pod \"57f28e74-16b7-4409-86fb-25273a1f0c3a\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " Jun 11 10:35:02.189361 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.189143 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-serving-cert\") pod \"57f28e74-16b7-4409-86fb-25273a1f0c3a\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " Jun 11 10:35:02.189361 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.189175 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-trusted-ca-bundle\") pod \"57f28e74-16b7-4409-86fb-25273a1f0c3a\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " Jun 11 10:35:02.189361 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.189230 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thbc9\" (UniqueName: \"kubernetes.io/projected/57f28e74-16b7-4409-86fb-25273a1f0c3a-kube-api-access-thbc9\") pod \"57f28e74-16b7-4409-86fb-25273a1f0c3a\" (UID: \"57f28e74-16b7-4409-86fb-25273a1f0c3a\") " Jun 11 10:35:02.189630 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.189441 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "57f28e74-16b7-4409-86fb-25273a1f0c3a" (UID: "57f28e74-16b7-4409-86fb-25273a1f0c3a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:35:02.189689 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.189650 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "57f28e74-16b7-4409-86fb-25273a1f0c3a" (UID: "57f28e74-16b7-4409-86fb-25273a1f0c3a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:35:02.189989 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.189950 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-config" (OuterVolumeSpecName: "console-config") pod "57f28e74-16b7-4409-86fb-25273a1f0c3a" (UID: "57f28e74-16b7-4409-86fb-25273a1f0c3a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:35:02.190156 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.190109 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-service-ca" (OuterVolumeSpecName: "service-ca") pod "57f28e74-16b7-4409-86fb-25273a1f0c3a" (UID: "57f28e74-16b7-4409-86fb-25273a1f0c3a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:35:02.191825 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.191782 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "57f28e74-16b7-4409-86fb-25273a1f0c3a" (UID: "57f28e74-16b7-4409-86fb-25273a1f0c3a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:35:02.191972 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.191937 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57f28e74-16b7-4409-86fb-25273a1f0c3a-kube-api-access-thbc9" (OuterVolumeSpecName: "kube-api-access-thbc9") pod "57f28e74-16b7-4409-86fb-25273a1f0c3a" (UID: "57f28e74-16b7-4409-86fb-25273a1f0c3a"). InnerVolumeSpecName "kube-api-access-thbc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:35:02.192157 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.192139 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "57f28e74-16b7-4409-86fb-25273a1f0c3a" (UID: "57f28e74-16b7-4409-86fb-25273a1f0c3a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:35:02.290301 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.290257 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-service-ca\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:35:02.290301 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.290295 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-serving-cert\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:35:02.290301 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.290309 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-trusted-ca-bundle\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:35:02.290545 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.290322 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thbc9\" (UniqueName: \"kubernetes.io/projected/57f28e74-16b7-4409-86fb-25273a1f0c3a-kube-api-access-thbc9\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:35:02.290545 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.290336 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-oauth-serving-cert\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:35:02.290545 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.290347 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-oauth-config\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:35:02.290545 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.290360 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57f28e74-16b7-4409-86fb-25273a1f0c3a-console-config\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 11 10:35:02.985938 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.985902 2575 generic.go:356] "Generic (PLEG): container finished" podID="57f28e74-16b7-4409-86fb-25273a1f0c3a" containerID="c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa" exitCode=0 Jun 11 10:35:02.986453 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.985966 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dfd67b97-lw6j6" Jun 11 10:35:02.986453 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.985991 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dfd67b97-lw6j6" event={"ID":"57f28e74-16b7-4409-86fb-25273a1f0c3a","Type":"ContainerDied","Data":"c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa"} Jun 11 10:35:02.986453 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.986054 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dfd67b97-lw6j6" event={"ID":"57f28e74-16b7-4409-86fb-25273a1f0c3a","Type":"ContainerDied","Data":"182ee4c86784e07e9dd256bec0f0453509cf649deff6206e0cacac40b10b1572"} Jun 11 10:35:02.986453 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.986086 2575 scope.go:117] "RemoveContainer" containerID="c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa" Jun 11 10:35:02.994879 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.994842 2575 scope.go:117] "RemoveContainer" containerID="c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa" Jun 11 10:35:02.995180 ip-10-0-137-68 kubenswrapper[2575]: E0611 10:35:02.995158 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa\": container with ID starting with c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa not found: ID does not exist" containerID="c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa" Jun 11 10:35:02.995273 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:02.995192 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa"} err="failed to get container status \"c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa\": rpc error: code = NotFound desc = could not find container \"c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa\": container with ID starting with c3e500e9bf0b2b5c397867c65c4afc8e8c80c68afe7cf8710260cefdd4253baa not found: ID does not exist" Jun 11 10:35:03.004253 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:03.004222 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dfd67b97-lw6j6"] Jun 11 10:35:03.015127 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:03.015095 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dfd67b97-lw6j6"] Jun 11 10:35:04.344218 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:35:04.344187 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57f28e74-16b7-4409-86fb-25273a1f0c3a" path="/var/lib/kubelet/pods/57f28e74-16b7-4409-86fb-25273a1f0c3a/volumes" Jun 11 10:37:28.460422 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:37:28.460395 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:37:28.463910 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:37:28.463863 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:42:28.489292 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:28.489258 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:42:28.495305 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:28.495279 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:42:32.751601 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:32.751575 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6967679dd4-lc55h_801ff3f1-8294-49aa-9131-fe0ebc2876d6/nginx/0.log" Jun 11 10:42:32.863192 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:32.863163 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-2t5pq_eebe61db-4ae2-4307-8c67-0f4a9dc49969/manager/0.log" Jun 11 10:42:32.977783 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:32.977749 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8q2tc_143f080b-c015-498e-bf0e-0663ad926f27/manager/0.log" Jun 11 10:42:33.096085 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:33.095991 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-58b59bbf57-5vcwr_830319b1-3cae-454d-b52c-45f2256c543d/maas-api/0.log" Jun 11 10:42:33.420811 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:33.420739 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sqlr4_101646e7-fa11-4695-b2a0-f8088d1e7d9c/server/0.log" Jun 11 10:42:33.534650 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:33.534623 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-hmhz6_1768cc13-8f35-45b7-a3a7-5460f257cc11/manager/0.log" Jun 11 10:42:33.879727 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:33.879699 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85dd8cd87b-n2qxq_55a4dc22-d33c-42a7-9b67-65a76cfa8439/copy-manifests/0.log" Jun 11 10:42:33.892859 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:33.892832 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85dd8cd87b-n2qxq_55a4dc22-d33c-42a7-9b67-65a76cfa8439/manager/0.log" Jun 11 10:42:36.033879 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:36.033847 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4l2mn_85004e58-888b-4d1e-8e74-abbf4d48479a/manager/0.log" Jun 11 10:42:36.476094 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:36.476066 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-drlkr_2c3533c1-d5f8-4ba9-9921-40ae0823c5b0/discovery/0.log" Jun 11 10:42:36.581770 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:36.581743 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccc9cd975-2fqpc_4fb67aeb-5a6f-42dc-a9f4-4cdafa992369/kube-auth-proxy/0.log" Jun 11 10:42:36.914043 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:36.913968 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cwp48_fab9dc7e-3558-42bf-81f0-6805eb2a3b4f/payload-pre-processing/0.log" Jun 11 10:42:37.024478 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:37.024448 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8jzhl_538549fd-7425-44cb-ae6a-0dde1dd38a1a/payload-processing/0.log" Jun 11 10:42:37.455392 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:37.455362 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5_f248912b-8920-4f93-88e4-593c7de807ab/storage-initializer/0.log" Jun 11 10:42:37.462397 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:37.462370 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-glpz5_f248912b-8920-4f93-88e4-593c7de807ab/main/0.log" Jun 11 10:42:37.569308 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:37.569272 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-9cvrr_093e9280-e26a-4f2f-8b7c-6377b73d7769/storage-initializer/0.log" Jun 11 10:42:37.576997 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:37.576974 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-9cvrr_093e9280-e26a-4f2f-8b7c-6377b73d7769/main/0.log" Jun 11 10:42:37.683708 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:37.683680 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4_78261f2b-0f1d-43bf-8146-f10a9ea48574/storage-initializer/0.log" Jun 11 10:42:37.691164 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:37.691132 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-qcqs4_78261f2b-0f1d-43bf-8146-f10a9ea48574/main/0.log" Jun 11 10:42:37.792104 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:37.792020 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh_14624d4a-f268-44d3-bc41-1f63af0e2601/storage-initializer/0.log" Jun 11 10:42:37.798496 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:37.798470 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64nhh_14624d4a-f268-44d3-bc41-1f63af0e2601/main/0.log" Jun 11 10:42:37.908670 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:37.908638 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-shwxc_ad6772c5-0b71-48b8-84a8-50d9a44c3ef1/storage-initializer/0.log" Jun 11 10:42:37.916014 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:37.915984 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-shwxc_ad6772c5-0b71-48b8-84a8-50d9a44c3ef1/main/0.log" Jun 11 10:42:38.023662 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:38.023638 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-b4bs7_31a15579-03a5-456a-b590-4c89c1983ae4/main/0.log" Jun 11 10:42:38.030465 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:38.030422 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-b4bs7_31a15579-03a5-456a-b590-4c89c1983ae4/storage-initializer/0.log" Jun 11 10:42:45.222662 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:45.222584 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pvbq4_09b38e2b-4c8d-496a-930c-9cf28a6ef771/global-pull-secret-syncer/0.log" Jun 11 10:42:45.339633 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:45.339606 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wtrj6_28a97a3a-5f40-4d67-bf31-71562e304205/konnectivity-agent/0.log" Jun 11 10:42:45.421157 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:45.421109 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-68.ec2.internal_86da014a9cd3afb75ae148ad505b00b6/haproxy/0.log" Jun 11 10:42:49.227971 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:49.227938 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-f4q2w_7b01af1d-d28d-42ff-90db-4dc7a6523555/sail-operator/0.log" Jun 11 10:42:50.307132 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:50.307087 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4l2mn_85004e58-888b-4d1e-8e74-abbf4d48479a/manager/0.log" Jun 11 10:42:52.415627 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:52.415602 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6rhjz_0510ca8f-e7cb-4f24-8204-da1fac82fc06/node-exporter/0.log" Jun 11 10:42:52.442519 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:52.442490 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6rhjz_0510ca8f-e7cb-4f24-8204-da1fac82fc06/kube-rbac-proxy/0.log" Jun 11 10:42:52.467642 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:52.467616 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6rhjz_0510ca8f-e7cb-4f24-8204-da1fac82fc06/init-textfile/0.log" Jun 11 10:42:52.660907 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:52.660878 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-88g88_ee3bba26-fe3a-45d8-a0c5-6aab46c17501/kube-rbac-proxy-main/0.log" Jun 11 10:42:52.697661 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:52.697579 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-88g88_ee3bba26-fe3a-45d8-a0c5-6aab46c17501/kube-rbac-proxy-self/0.log" Jun 11 10:42:52.721922 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:52.721898 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-88g88_ee3bba26-fe3a-45d8-a0c5-6aab46c17501/openshift-state-metrics/0.log" Jun 11 10:42:55.838794 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:55.838759 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d46c5797c-wm67m_f78172a9-4e6d-448c-93ac-6ef1214d6615/console/0.log" Jun 11 10:42:56.978789 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:56.978754 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj"] Jun 11 10:42:56.979208 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:56.979159 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57f28e74-16b7-4409-86fb-25273a1f0c3a" containerName="console" Jun 11 10:42:56.979208 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:56.979171 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="57f28e74-16b7-4409-86fb-25273a1f0c3a" containerName="console" Jun 11 10:42:56.979285 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:56.979234 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="57f28e74-16b7-4409-86fb-25273a1f0c3a" containerName="console" Jun 11 10:42:56.982057 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:56.982041 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:56.985052 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:56.985025 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fzfdp\"/\"openshift-service-ca.crt\"" Jun 11 10:42:56.985052 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:56.985025 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fzfdp\"/\"default-dockercfg-lblv8\"" Jun 11 10:42:56.986680 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:56.986659 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fzfdp\"/\"kube-root-ca.crt\"" Jun 11 10:42:56.990251 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:56.990194 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj"] Jun 11 10:42:57.061975 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.061934 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/869758d2-0221-4421-a6bf-5b0197826e6e-sys\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.061975 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.061976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/869758d2-0221-4421-a6bf-5b0197826e6e-podres\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.062287 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.061996 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9jh7\" (UniqueName: \"kubernetes.io/projected/869758d2-0221-4421-a6bf-5b0197826e6e-kube-api-access-f9jh7\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.062287 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.062140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/869758d2-0221-4421-a6bf-5b0197826e6e-lib-modules\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.062287 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.062258 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/869758d2-0221-4421-a6bf-5b0197826e6e-proc\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.163324 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.163272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/869758d2-0221-4421-a6bf-5b0197826e6e-proc\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.163537 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.163362 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/869758d2-0221-4421-a6bf-5b0197826e6e-sys\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.163537 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.163389 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/869758d2-0221-4421-a6bf-5b0197826e6e-podres\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.163537 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.163412 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/869758d2-0221-4421-a6bf-5b0197826e6e-proc\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.163537 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.163416 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9jh7\" (UniqueName: \"kubernetes.io/projected/869758d2-0221-4421-a6bf-5b0197826e6e-kube-api-access-f9jh7\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.163537 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.163476 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/869758d2-0221-4421-a6bf-5b0197826e6e-sys\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.163537 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.163515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/869758d2-0221-4421-a6bf-5b0197826e6e-lib-modules\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.163819 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.163561 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/869758d2-0221-4421-a6bf-5b0197826e6e-podres\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.163819 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.163687 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/869758d2-0221-4421-a6bf-5b0197826e6e-lib-modules\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.172363 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.172344 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9jh7\" (UniqueName: \"kubernetes.io/projected/869758d2-0221-4421-a6bf-5b0197826e6e-kube-api-access-f9jh7\") pod \"perf-node-gather-daemonset-85ctj\" (UID: \"869758d2-0221-4421-a6bf-5b0197826e6e\") " pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.293893 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.293805 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:57.428327 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.428301 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj"] Jun 11 10:42:57.430390 ip-10-0-137-68 kubenswrapper[2575]: W0611 10:42:57.430363 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod869758d2_0221_4421_a6bf_5b0197826e6e.slice/crio-e24bdc1ce8ffc625c616c01e7cfff18ee0abb244ee5b297f3d4291e81ad8521b WatchSource:0}: Error finding container e24bdc1ce8ffc625c616c01e7cfff18ee0abb244ee5b297f3d4291e81ad8521b: Status 404 returned error can't find the container with id e24bdc1ce8ffc625c616c01e7cfff18ee0abb244ee5b297f3d4291e81ad8521b Jun 11 10:42:57.871535 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.871463 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9nxqp_5c1a2525-5e0e-4b4f-ab12-7148711938f3/dns/0.log" Jun 11 10:42:57.893243 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:57.893221 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9nxqp_5c1a2525-5e0e-4b4f-ab12-7148711938f3/kube-rbac-proxy/0.log" Jun 11 10:42:58.073524 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:58.073492 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xjcfv_2d2a03f3-1cd0-4ff2-95e8-8d764948c65e/dns-node-resolver/0.log" Jun 11 10:42:58.318453 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:58.318415 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" event={"ID":"869758d2-0221-4421-a6bf-5b0197826e6e","Type":"ContainerStarted","Data":"c4106588e45b1dfd767b180b5a78e029b4902a852230298dfba411ee9be8dc1d"} Jun 11 10:42:58.318650 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:58.318475 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" event={"ID":"869758d2-0221-4421-a6bf-5b0197826e6e","Type":"ContainerStarted","Data":"e24bdc1ce8ffc625c616c01e7cfff18ee0abb244ee5b297f3d4291e81ad8521b"} Jun 11 10:42:58.318650 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:58.318553 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:42:58.337923 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:58.337862 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" podStartSLOduration=2.33784375 podStartE2EDuration="2.33784375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:42:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:42:58.337646673 +0000 UTC m=+2430.498943754" watchObservedRunningTime="2026-06-11 10:42:58.33784375 +0000 UTC m=+2430.499140811" Jun 11 10:42:58.638299 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:58.638204 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-77888dc649-wh8qm_299366ae-e2cc-4b58-91e4-a0562ffb9311/registry/0.log" Jun 11 10:42:58.661707 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:58.661672 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2jqvs_d8360a73-ef7e-4c2d-8906-fd2431a63516/node-ca/0.log" Jun 11 10:42:59.713493 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:59.713460 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-drlkr_2c3533c1-d5f8-4ba9-9921-40ae0823c5b0/discovery/0.log" Jun 11 10:42:59.735553 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:59.735529 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccc9cd975-2fqpc_4fb67aeb-5a6f-42dc-a9f4-4cdafa992369/kube-auth-proxy/0.log" Jun 11 10:42:59.862755 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:59.862724 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cwp48_fab9dc7e-3558-42bf-81f0-6805eb2a3b4f/payload-pre-processing/0.log" Jun 11 10:42:59.921876 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:42:59.921847 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8jzhl_538549fd-7425-44cb-ae6a-0dde1dd38a1a/payload-processing/0.log" Jun 11 10:43:00.604259 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:00.604230 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k4fzc_06917c6e-4f6f-4b26-8973-c11a7b6c789f/serve-healthcheck-canary/0.log" Jun 11 10:43:01.302943 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:01.302915 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2rgq_2a0a1178-2c8e-4784-b152-39d75a7bbf7e/kube-rbac-proxy/0.log" Jun 11 10:43:01.327515 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:01.327487 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2rgq_2a0a1178-2c8e-4784-b152-39d75a7bbf7e/exporter/0.log" Jun 11 10:43:01.352579 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:01.352554 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2rgq_2a0a1178-2c8e-4784-b152-39d75a7bbf7e/extractor/0.log" Jun 11 10:43:03.637666 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:03.637640 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6967679dd4-lc55h_801ff3f1-8294-49aa-9131-fe0ebc2876d6/nginx/0.log" Jun 11 10:43:03.666134 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:03.666101 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-2t5pq_eebe61db-4ae2-4307-8c67-0f4a9dc49969/manager/0.log" Jun 11 10:43:03.744624 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:03.744595 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8q2tc_143f080b-c015-498e-bf0e-0663ad926f27/manager/0.log" Jun 11 10:43:03.779551 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:03.779525 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-58b59bbf57-5vcwr_830319b1-3cae-454d-b52c-45f2256c543d/maas-api/0.log" Jun 11 10:43:03.955608 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:03.955583 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sqlr4_101646e7-fa11-4695-b2a0-f8088d1e7d9c/server/0.log" Jun 11 10:43:04.009616 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:04.009585 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-hmhz6_1768cc13-8f35-45b7-a3a7-5460f257cc11/manager/0.log" Jun 11 10:43:04.234879 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:04.234781 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85dd8cd87b-n2qxq_55a4dc22-d33c-42a7-9b67-65a76cfa8439/manager/0.log" Jun 11 10:43:04.252806 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:04.252780 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85dd8cd87b-n2qxq_55a4dc22-d33c-42a7-9b67-65a76cfa8439/copy-manifests/0.log" Jun 11 10:43:04.333953 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:04.333924 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fzfdp/perf-node-gather-daemonset-85ctj" Jun 11 10:43:10.021982 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:10.021942 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-drlkr_2c3533c1-d5f8-4ba9-9921-40ae0823c5b0/discovery/0.log" Jun 11 10:43:10.032942 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:10.032917 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccc9cd975-2fqpc_4fb67aeb-5a6f-42dc-a9f4-4cdafa992369/kube-auth-proxy/0.log" Jun 11 10:43:10.135400 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:10.135364 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cwp48_fab9dc7e-3558-42bf-81f0-6805eb2a3b4f/payload-pre-processing/0.log" Jun 11 10:43:10.185009 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:10.184975 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8jzhl_538549fd-7425-44cb-ae6a-0dde1dd38a1a/payload-processing/0.log" Jun 11 10:43:11.315105 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:11.315067 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-drlkr_2c3533c1-d5f8-4ba9-9921-40ae0823c5b0/discovery/0.log" Jun 11 10:43:11.327015 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:11.326996 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccc9cd975-2fqpc_4fb67aeb-5a6f-42dc-a9f4-4cdafa992369/kube-auth-proxy/0.log" Jun 11 10:43:11.424898 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:11.424871 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cwp48_fab9dc7e-3558-42bf-81f0-6805eb2a3b4f/payload-pre-processing/0.log" Jun 11 10:43:11.477631 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:11.477600 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8jzhl_538549fd-7425-44cb-ae6a-0dde1dd38a1a/payload-processing/0.log" Jun 11 10:43:12.979338 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:12.979305 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxrtq_6f223dd5-92de-45ba-8a4a-734cc6a4ecd2/kube-multus-additional-cni-plugins/0.log" Jun 11 10:43:13.000740 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.000707 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxrtq_6f223dd5-92de-45ba-8a4a-734cc6a4ecd2/egress-router-binary-copy/0.log" Jun 11 10:43:13.024281 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.024254 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxrtq_6f223dd5-92de-45ba-8a4a-734cc6a4ecd2/cni-plugins/0.log" Jun 11 10:43:13.049921 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.049861 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxrtq_6f223dd5-92de-45ba-8a4a-734cc6a4ecd2/bond-cni-plugin/0.log" Jun 11 10:43:13.075638 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.075615 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxrtq_6f223dd5-92de-45ba-8a4a-734cc6a4ecd2/routeoverride-cni/0.log" Jun 11 10:43:13.096576 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.096552 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxrtq_6f223dd5-92de-45ba-8a4a-734cc6a4ecd2/whereabouts-cni-bincopy/0.log" Jun 11 10:43:13.116825 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.116802 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxrtq_6f223dd5-92de-45ba-8a4a-734cc6a4ecd2/whereabouts-cni/0.log" Jun 11 10:43:13.185275 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.185244 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-drlkr_2c3533c1-d5f8-4ba9-9921-40ae0823c5b0/discovery/0.log" Jun 11 10:43:13.195044 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.195020 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccc9cd975-2fqpc_4fb67aeb-5a6f-42dc-a9f4-4cdafa992369/kube-auth-proxy/0.log" Jun 11 10:43:13.284506 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.284480 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cwp48_fab9dc7e-3558-42bf-81f0-6805eb2a3b4f/payload-pre-processing/0.log" Jun 11 10:43:13.333990 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.333908 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8jzhl_538549fd-7425-44cb-ae6a-0dde1dd38a1a/payload-processing/0.log" Jun 11 10:43:13.478934 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.478902 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bntjw_ba76fc15-0a09-4485-a2af-868156b60f32/kube-multus/0.log" Jun 11 10:43:13.572015 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.571985 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mv8d6_9b05be19-d3e1-4216-8727-bd84bf476b4b/network-metrics-daemon/0.log" Jun 11 10:43:13.592381 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:13.592308 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mv8d6_9b05be19-d3e1-4216-8727-bd84bf476b4b/kube-rbac-proxy/0.log" Jun 11 10:43:15.025564 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:15.025536 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-controller/0.log" Jun 11 10:43:15.046635 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:15.046605 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/0.log" Jun 11 10:43:15.046783 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:15.046613 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/ovn-acl-logging/1.log" Jun 11 10:43:15.070541 ip-10-0-137-68 kubenswrapper[2575]: I0611 10:43:15.070514 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjzkh_d8462886-9f16-4e49-9990-86e5c70d0695/kube-rbac-proxy-node/0.log"